[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:30:32 dist-test-slave-45dx krb5kdc[25055](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:30:32 dist-test-slave-45dx krb5kdc[25055](info): set up 2 sockets
Aug 08 02:30:32 dist-test-slave-45dx krb5kdc[25055](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 02:30:33.612497 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.463s user 0.004s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:30:33 dist-test-slave-45dx krb5kdc[25055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156233, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:30:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:30:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:30:33.821125 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:37141
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:43061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:37141
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:30:34.193758 25075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:30:34.194343 25075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:30:34.194545 25075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:30:34.203011 25075 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:30:34.203135 25075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:30:34.203274 25075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:30:34.203373 25075 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:30:34.203493 25075 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:30:34.215234 25075 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:43061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:37141
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:37141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:30:34.216835 25075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:30:34.218426 25075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:30:34.232070 25080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:34.232041 25082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:34.232055 25084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:30:34.233366 25075 server_base.cc:1034] running on GCE node
I20260808 02:30:34.234185 25075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:30:34.235608 25075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:30:34.236847 25075 hybrid_clock.cc:648] HybridClock initialized: now 1786156234236769 us; error 86 us; skew 500 ppm
I20260808 02:30:34.237201 25075 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:30:34 dist-test-slave-45dx krb5kdc[25055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156234, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:30:34.240880 25075 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:30:34.242362 25075 webserver.cc:460] Webserver started at http://127.24.116.254:39163/ using document root <none> and password file <none>
I20260808 02:30:34.243057 25075 fs_manager.cc:359] Metadata directory not provided
I20260808 02:30:34.243206 25075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:30:34.243534 25075 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:30:34.246956 25075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "4bbd1a469bfd487c84729b11b44aca87"
format_stamp: "Formatted at 2026-08-08 02:30:34 on dist-test-slave-45dx"
server_key: "dad9a832deba4bc58d69e77e9edd15df"
server_key_iv: "bc4895c4c7a6640500405e21f388f961"
server_key_version: "encryptionkey@0"
I20260808 02:30:34.248040 25075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "4bbd1a469bfd487c84729b11b44aca87"
format_stamp: "Formatted at 2026-08-08 02:30:34 on dist-test-slave-45dx"
server_key: "dad9a832deba4bc58d69e77e9edd15df"
server_key_iv: "bc4895c4c7a6640500405e21f388f961"
server_key_version: "encryptionkey@0"
I20260808 02:30:34.254887 25075 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260808 02:30:34.258971 25095 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:34.260277 25075 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 02:30:34.260521 25075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "4bbd1a469bfd487c84729b11b44aca87"
format_stamp: "Formatted at 2026-08-08 02:30:34 on dist-test-slave-45dx"
server_key: "dad9a832deba4bc58d69e77e9edd15df"
server_key_iv: "bc4895c4c7a6640500405e21f388f961"
server_key_version: "encryptionkey@0"
I20260808 02:30:34.260798 25075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:30:34.285210 25075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:30:34.290256 25075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:30:34.290570 25075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:30:34.312022 25075 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:37141
I20260808 02:30:34.312091 25183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:37141 every 8 connection(s)
I20260808 02:30:34.313547 25075 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:30:34.317543 25184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:34.322445 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 25075
I20260808 02:30:34.322759 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:30:34.324669 25043 external_mini_cluster.cc:1428] Setting key f0f38218f49061efa743cd54b4f73ff5
I20260808 02:30:34.329241 25184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bbd1a469bfd487c84729b11b44aca87: Bootstrap starting.
I20260808 02:30:34.332938 25184 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4bbd1a469bfd487c84729b11b44aca87: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:34.333977 25184 log.cc:824] T 00000000000000000000000000000000 P 4bbd1a469bfd487c84729b11b44aca87: Log is configured to *not* fsync() on all Append() calls
I20260808 02:30:34.337035 25184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bbd1a469bfd487c84729b11b44aca87: No bootstrap required, opened a new log
I20260808 02:30:34.345890 25184 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4bbd1a469bfd487c84729b11b44aca87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bbd1a469bfd487c84729b11b44aca87" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 37141 } }
I20260808 02:30:34.346488 25184 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4bbd1a469bfd487c84729b11b44aca87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:34.346611 25184 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4bbd1a469bfd487c84729b11b44aca87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bbd1a469bfd487c84729b11b44aca87, State: Initialized, Role: FOLLOWER
I20260808 02:30:34.347203 25184 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4bbd1a469bfd487c84729b11b44aca87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bbd1a469bfd487c84729b11b44aca87" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 37141 } }
I20260808 02:30:34.347468 25184 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4bbd1a469bfd487c84729b11b44aca87 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:30:34.347620 25184 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4bbd1a469bfd487c84729b11b44aca87 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:30:34.347787 25184 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4bbd1a469bfd487c84729b11b44aca87 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:34.350217 25184 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4bbd1a469bfd487c84729b11b44aca87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bbd1a469bfd487c84729b11b44aca87" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 37141 } }
I20260808 02:30:34.350780 25184 leader_election.cc:302] T 00000000000000000000000000000000 P 4bbd1a469bfd487c84729b11b44aca87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4bbd1a469bfd487c84729b11b44aca87; no voters:
I20260808 02:30:34.351514 25184 leader_election.cc:288] T 00000000000000000000000000000000 P 4bbd1a469bfd487c84729b11b44aca87 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:30:34.351647 25194 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4bbd1a469bfd487c84729b11b44aca87 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:30:34.354292 25184 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4bbd1a469bfd487c84729b11b44aca87 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:30:34.355124 25194 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4bbd1a469bfd487c84729b11b44aca87 [term 1 LEADER]: Becoming Leader. State: Replica: 4bbd1a469bfd487c84729b11b44aca87, State: Running, Role: LEADER
Aug 08 02:30:34 dist-test-slave-45dx krb5kdc[25055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156233, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:30:34.355722 25194 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4bbd1a469bfd487c84729b11b44aca87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bbd1a469bfd487c84729b11b44aca87" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 37141 } }
I20260808 02:30:34.360636 25197 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bbd1a469bfd487c84729b11b44aca87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4bbd1a469bfd487c84729b11b44aca87. Latest consensus state: current_term: 1 leader_uuid: "4bbd1a469bfd487c84729b11b44aca87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bbd1a469bfd487c84729b11b44aca87" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 37141 } } }
I20260808 02:30:34.361039 25197 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bbd1a469bfd487c84729b11b44aca87 [sys.catalog]: This master's current role is: LEADER
I20260808 02:30:34.361593 25195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bbd1a469bfd487c84729b11b44aca87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4bbd1a469bfd487c84729b11b44aca87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bbd1a469bfd487c84729b11b44aca87" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 37141 } } }
I20260808 02:30:34.361915 25195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bbd1a469bfd487c84729b11b44aca87 [sys.catalog]: This master's current role is: LEADER
I20260808 02:30:34.369136 25210 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:30:34.370512 25187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:34.328564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57302 (local address 127.24.116.254:37141)
0808 02:30:34.329707 (+ 1143us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:34.329726 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:34.330820 (+ 1094us) server_negotiation.cc:407] Connection header received
0808 02:30:34.341948 (+ 11128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:34.341972 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:34.342368 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:34.342795 (+ 427us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:34.345819 (+ 3024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:34.347470 (+ 1651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:34.349293 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:34.349966 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:34.350163 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:34.357159 (+ 6996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:34.357176 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:34.357198 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:34.357269 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:34.363170 (+ 5901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:34.364544 (+ 1374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:34.364556 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:34.364568 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:34.364851 (+ 283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:34.365677 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:34.365685 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:34.365691 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:34.366831 (+ 1140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:34.367416 (+ 585us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:34.368449 (+ 1033us) server_negotiation.cc:299] Negotiation successful
0808 02:30:34.368941 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":865,"thread_start_us":627,"threads_started":1}
I20260808 02:30:34.376155 25210 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:30:34.390033 25210 catalog_manager.cc:1347] Generated new cluster ID: be00e019938440dfa738d667a137751b
I20260808 02:30:34.390259 25210 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:30:34.400141 25210 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:30:34.402056 25210 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:30:34.417583 25210 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4bbd1a469bfd487c84729b11b44aca87: Generated new TSK 0
I20260808 02:30:34.418745 25210 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.116.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
I20260808 02:30:34.477113 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:37141
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:43061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:30:34.849530 25226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:30:34.849867 25226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:30:34.849979 25226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:30:34.858089 25226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:30:34.858227 25226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:30:34.858349 25226 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:30:34.869342 25226 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:43061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:37141
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:30:34.870697 25226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:30:34.872083 25226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:30:34.887065 25235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:34.887173 25238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:34.887110 25241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:30:34.887939 25226 server_base.cc:1034] running on GCE node
I20260808 02:30:34.888638 25226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:30:34.889601 25226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:30:34.890842 25226 hybrid_clock.cc:648] HybridClock initialized: now 1786156234890806 us; error 41 us; skew 500 ppm
I20260808 02:30:34.891172 25226 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:30:34 dist-test-slave-45dx krb5kdc[25055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156234, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:30:34.899674 25226 init.cc:377] Logged in from keytab as kudu/127.24.116.193@KRBTEST.COM (short username kudu)
I20260808 02:30:34.901250 25226 webserver.cc:460] Webserver started at http://127.24.116.193:37101/ using document root <none> and password file <none>
I20260808 02:30:34.901984 25226 fs_manager.cc:359] Metadata directory not provided
I20260808 02:30:34.902129 25226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:30:34.902472 25226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:30:34.905530 25226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "8fd0b27ecead407ab044d94346b95f4c"
format_stamp: "Formatted at 2026-08-08 02:30:34 on dist-test-slave-45dx"
server_key: "bda4aeea5eaf4a6ac4b2c0582f7b4b51"
server_key_iv: "39b27346fe451a8dccdb0a8cf937e70b"
server_key_version: "encryptionkey@0"
I20260808 02:30:34.906308 25226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "8fd0b27ecead407ab044d94346b95f4c"
format_stamp: "Formatted at 2026-08-08 02:30:34 on dist-test-slave-45dx"
server_key: "bda4aeea5eaf4a6ac4b2c0582f7b4b51"
server_key_iv: "39b27346fe451a8dccdb0a8cf937e70b"
server_key_version: "encryptionkey@0"
I20260808 02:30:34.911867 25226 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260808 02:30:34.915539 25252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:34.917125 25226 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:30:34.917335 25226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "8fd0b27ecead407ab044d94346b95f4c"
format_stamp: "Formatted at 2026-08-08 02:30:34 on dist-test-slave-45dx"
server_key: "bda4aeea5eaf4a6ac4b2c0582f7b4b51"
server_key_iv: "39b27346fe451a8dccdb0a8cf937e70b"
server_key_version: "encryptionkey@0"
I20260808 02:30:34.917569 25226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:30:34.937389 25226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:30:34.941938 25226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:30:34.942258 25226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:30:34.943401 25226 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:30:34.945246 25226 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:30:34.945371 25226 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:34.945549 25226 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:30:34.945626 25226 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:34.986502 25226 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:44673
I20260808 02:30:34.986600 25419 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:44673 every 8 connection(s)
I20260808 02:30:34.987924 25226 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:30:34.989775 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 25226
I20260808 02:30:34.990080 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:30:34.990914 25043 external_mini_cluster.cc:1428] Setting key 978e84c074856040ee98ea720551617b
Aug 08 02:30:35 dist-test-slave-45dx krb5kdc[25055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156234, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.116.194@KRBTEST.COM; defaulting to no policy
I20260808 02:30:35.013160 25422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:34.991079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:37437 (local address 127.24.116.254:37141)
0808 02:30:34.991755 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:34.991762 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:34.993473 (+ 1711us) server_negotiation.cc:407] Connection header received
0808 02:30:34.995402 (+ 1929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:34.995407 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:34.995494 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:34.995623 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:34.997486 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:34.998240 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:35.000447 (+ 2207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:35.000935 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:35.001060 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:35.005720 (+ 4660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:35.005725 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:35.005729 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:35.005763 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:35.009352 (+ 3589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:35.010246 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:35.010254 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:35.010258 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:35.010512 (+ 254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:35.010986 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:35.010993 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:35.010997 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:35.011480 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:35.011652 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:35.012421 (+ 769us) server_negotiation.cc:299] Negotiation successful
0808 02:30:35.012722 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":397,"threads_started":1}
I20260808 02:30:35.013978 25423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:34.991868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:37141 (local address 127.24.116.193:37437)
0808 02:30:34.993320 (+ 1452us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:34.993361 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:34.995117 (+ 1756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:34.995936 (+ 819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:34.995944 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:34.996652 (+ 708us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:30:34.997303 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:34.997322 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:34.998412 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:34.998418 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:35.000239 (+ 1821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:35.000258 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:35.001192 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:35.001202 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:35.001547 (+ 345us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:35.002478 (+ 931us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:30:35.002518 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:30:35.005478 (+ 2960us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:30:35.009519 (+ 4041us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:35.009527 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:35.009541 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:35.010091 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:35.010646 (+ 555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:35.010649 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:35.010651 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:35.010841 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:35.011601 (+ 760us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:30:35.011608 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:30:35.011950 (+ 342us) client_negotiation.cc:769] Sending connection context
0808 02:30:35.012195 (+ 245us) client_negotiation.cc:240] Negotiation successful
0808 02:30:35.012728 (+ 533us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1181,"thread_start_us":918,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.194@KRBTEST.COM" created.
I20260808 02:30:35.015843 25420 heartbeater.cc:347] Connected to a master server at 127.24.116.254:37141
I20260808 02:30:35.016278 25420 heartbeater.cc:464] Registering TS with master...
I20260808 02:30:35.017302 25420 heartbeater.cc:511] Master 127.24.116.254:37141 requested a full tablet report, sending...
I20260808 02:30:35.019706 25125 ts_manager.cc:194] Registered new tserver with Master: 8fd0b27ecead407ab044d94346b95f4c (127.24.116.193:44673)
I20260808 02:30:35.021421 25125 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.193@KRBTEST.COM'} at 127.24.116.193:37437
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
I20260808 02:30:35.041880 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:37141
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:43061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:30:35.416671 25426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:30:35.416970 25426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:30:35.417147 25426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:30:35.425258 25426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:30:35.425406 25426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:30:35.425612 25426 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:30:35.435998 25426 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:43061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:37141
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:30:35.437433 25426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:30:35.439067 25426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:30:35.453552 25433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:35.453644 25432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:35.453604 25436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:30:35.454738 25426 server_base.cc:1034] running on GCE node
I20260808 02:30:35.455447 25426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:30:35.456539 25426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:30:35.457772 25426 hybrid_clock.cc:648] HybridClock initialized: now 1786156235457730 us; error 52 us; skew 500 ppm
I20260808 02:30:35.458093 25426 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:30:35 dist-test-slave-45dx krb5kdc[25055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156235, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:30:35.462061 25426 init.cc:377] Logged in from keytab as kudu/127.24.116.194@KRBTEST.COM (short username kudu)
I20260808 02:30:35.463668 25426 webserver.cc:460] Webserver started at http://127.24.116.194:36589/ using document root <none> and password file <none>
I20260808 02:30:35.464540 25426 fs_manager.cc:359] Metadata directory not provided
I20260808 02:30:35.464695 25426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:30:35.465032 25426 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:30:35.468359 25426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "1b9264af0b4142638f961ca2aa34be5b"
format_stamp: "Formatted at 2026-08-08 02:30:35 on dist-test-slave-45dx"
server_key: "958b8f65e23744c890a8cc65375e00de"
server_key_iv: "61172cae5d8aff8d1caabf55d976eeb5"
server_key_version: "encryptionkey@0"
I20260808 02:30:35.469287 25426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "1b9264af0b4142638f961ca2aa34be5b"
format_stamp: "Formatted at 2026-08-08 02:30:35 on dist-test-slave-45dx"
server_key: "958b8f65e23744c890a8cc65375e00de"
server_key_iv: "61172cae5d8aff8d1caabf55d976eeb5"
server_key_version: "encryptionkey@0"
I20260808 02:30:35.474978 25426 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 02:30:35.478997 25446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:35.480880 25426 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:30:35.481122 25426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "1b9264af0b4142638f961ca2aa34be5b"
format_stamp: "Formatted at 2026-08-08 02:30:35 on dist-test-slave-45dx"
server_key: "958b8f65e23744c890a8cc65375e00de"
server_key_iv: "61172cae5d8aff8d1caabf55d976eeb5"
server_key_version: "encryptionkey@0"
I20260808 02:30:35.481413 25426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:30:35.507298 25426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:30:35.512321 25426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:30:35.512625 25426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:30:35.513690 25426 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:30:35.515272 25426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:30:35.515411 25426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:35.515518 25426 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:30:35.515573 25426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:35.554663 25426 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:40769
I20260808 02:30:35.554711 25617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:40769 every 8 connection(s)
I20260808 02:30:35.556025 25426 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:30:35.563335 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 25426
I20260808 02:30:35.563549 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:30:35.563979 25043 external_mini_cluster.cc:1428] Setting key bfa1a54fc81d6ee2ba82e64f1d742af4
Aug 08 02:30:35 dist-test-slave-45dx krb5kdc[25055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156235, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:30:35.578945 25620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:35.558725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:46861 (local address 127.24.116.254:37141)
0808 02:30:35.559249 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:35.559255 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:35.560392 (+ 1137us) server_negotiation.cc:407] Connection header received
0808 02:30:35.562833 (+ 2441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:35.562839 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:35.562931 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:35.563056 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:35.564838 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:35.565833 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:35.567471 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:35.567962 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:35.568091 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:35.571829 (+ 3738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:35.571834 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:35.571837 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:35.571868 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:35.575219 (+ 3351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:35.576235 (+ 1016us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:35.576240 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:35.576242 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:35.576472 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:35.576986 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:35.576990 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:35.576992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:35.577287 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:35.577407 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:35.578444 (+ 1037us) server_negotiation.cc:299] Negotiation successful
0808 02:30:35.578663 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":293,"threads_started":1}
I20260808 02:30:35.580606 25621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:35.559360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:37141 (local address 127.24.116.194:46861)
0808 02:30:35.560192 (+ 832us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:35.560231 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:35.562553 (+ 2322us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:35.563291 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:35.563299 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:35.563914 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:30:35.564663 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:35.564682 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:35.565995 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:35.565999 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:35.567318 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:35.567330 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:35.568180 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:35.568187 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:35.568466 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:35.569236 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:30:35.569258 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:30:35.571608 (+ 2350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:30:35.575361 (+ 3753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:35.575373 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:35.575395 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:35.576081 (+ 686us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:35.576586 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:35.576594 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:35.576601 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:35.576862 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:35.577424 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:30:35.577435 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:30:35.577920 (+ 485us) client_negotiation.cc:769] Sending connection context
0808 02:30:35.578269 (+ 349us) client_negotiation.cc:240] Negotiation successful
0808 02:30:35.578916 (+ 647us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":379,"threads_started":1}
I20260808 02:30:35.582415 25618 heartbeater.cc:347] Connected to a master server at 127.24.116.254:37141
I20260808 02:30:35.582888 25618 heartbeater.cc:464] Registering TS with master...
I20260808 02:30:35.584214 25618 heartbeater.cc:511] Master 127.24.116.254:37141 requested a full tablet report, sending...
I20260808 02:30:35.586126 25125 ts_manager.cc:194] Registered new tserver with Master: 1b9264af0b4142638f961ca2aa34be5b (127.24.116.194:40769)
I20260808 02:30:35.587718 25125 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.194@KRBTEST.COM'} at 127.24.116.194:46861
WARNING: no policy specified for kudu/127.24.116.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
I20260808 02:30:35.616370 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:37141
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:43061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:30:35.997740 25624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:30:35.998040 25624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:30:35.998153 25624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:30:36.005654 25624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:30:36.005779 25624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:30:36.005898 25624 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:30:36.016278 25624 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:43061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:37141
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:30:36.017638 25624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:30:36.019011 25624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 02:30:36.024765 25420 heartbeater.cc:503] Master 127.24.116.254:37141 was elected leader, sending a full tablet report...
W20260808 02:30:36.034904 25632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:36.035081 25630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:36.035404 25635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:30:36.036469 25624 server_base.cc:1034] running on GCE node
I20260808 02:30:36.037140 25624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:30:36.038153 25624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:30:36.039384 25624 hybrid_clock.cc:648] HybridClock initialized: now 1786156236039326 us; error 50 us; skew 500 ppm
I20260808 02:30:36.039717 25624 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:30:36 dist-test-slave-45dx krb5kdc[25055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156236, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:30:36.043677 25624 init.cc:377] Logged in from keytab as kudu/127.24.116.195@KRBTEST.COM (short username kudu)
I20260808 02:30:36.045607 25624 webserver.cc:460] Webserver started at http://127.24.116.195:45419/ using document root <none> and password file <none>
I20260808 02:30:36.046502 25624 fs_manager.cc:359] Metadata directory not provided
I20260808 02:30:36.046658 25624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:30:36.047000 25624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:30:36.050299 25624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "c605e90392614c6c9a7ba1d70bb6a7b3"
format_stamp: "Formatted at 2026-08-08 02:30:36 on dist-test-slave-45dx"
server_key: "dd323db08a2b9a2818a21373f671839d"
server_key_iv: "6a9168dbea3f7a413c6cb20fa7ece940"
server_key_version: "encryptionkey@0"
I20260808 02:30:36.051208 25624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "c605e90392614c6c9a7ba1d70bb6a7b3"
format_stamp: "Formatted at 2026-08-08 02:30:36 on dist-test-slave-45dx"
server_key: "dd323db08a2b9a2818a21373f671839d"
server_key_iv: "6a9168dbea3f7a413c6cb20fa7ece940"
server_key_version: "encryptionkey@0"
I20260808 02:30:36.057283 25624 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 02:30:36.061478 25644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:36.062990 25624 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260808 02:30:36.063196 25624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "c605e90392614c6c9a7ba1d70bb6a7b3"
format_stamp: "Formatted at 2026-08-08 02:30:36 on dist-test-slave-45dx"
server_key: "dd323db08a2b9a2818a21373f671839d"
server_key_iv: "6a9168dbea3f7a413c6cb20fa7ece940"
server_key_version: "encryptionkey@0"
I20260808 02:30:36.063431 25624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:30:36.089426 25624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:30:36.093739 25624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:30:36.094051 25624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:30:36.095074 25624 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:30:36.096567 25624 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:30:36.096688 25624 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:36.096832 25624 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:30:36.096905 25624 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:36.141431 25624 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:46547
I20260808 02:30:36.141534 25800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:46547 every 8 connection(s)
I20260808 02:30:36.142944 25624 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:30:36.146385 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 25624
I20260808 02:30:36.146610 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:30:36.147265 25043 external_mini_cluster.cc:1428] Setting key f718179aa001b00232883959dc5ba9b7
Aug 08 02:30:36 dist-test-slave-45dx krb5kdc[25055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156236, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:30:36.166630 25808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:36.146007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:51755 (local address 127.24.116.254:37141)
0808 02:30:36.146713 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:36.146723 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:36.147846 (+ 1123us) server_negotiation.cc:407] Connection header received
0808 02:30:36.150275 (+ 2429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:36.150281 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:36.150384 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:36.150514 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:36.152225 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:36.153163 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:36.155119 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:36.155603 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:36.155756 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:36.159879 (+ 4123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:36.159884 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:36.159888 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:36.159924 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:36.163465 (+ 3541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:36.164341 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:36.164348 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:36.164352 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:36.164509 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:36.164912 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:36.164916 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:36.164918 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:36.165202 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:36.165326 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:36.166029 (+ 703us) server_negotiation.cc:299] Negotiation successful
0808 02:30:36.166283 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":301,"threads_started":1}
I20260808 02:30:36.167682 25809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:36.146624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:37141 (local address 127.24.116.195:51755)
0808 02:30:36.147617 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:36.147663 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:36.149993 (+ 2330us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:36.150790 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:36.150799 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:36.151411 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:30:36.152029 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:36.152052 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:36.153350 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:36.153355 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:36.154881 (+ 1526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:36.154895 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:36.155864 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:36.155872 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:36.156142 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:36.156922 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:30:36.156948 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:30:36.159647 (+ 2699us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:30:36.163686 (+ 4039us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:36.163696 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:36.163715 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:36.164185 (+ 470us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:36.164623 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:36.164626 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:36.164628 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:36.164809 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:36.165326 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:30:36.165332 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:30:36.165663 (+ 331us) client_negotiation.cc:769] Sending connection context
0808 02:30:36.165905 (+ 242us) client_negotiation.cc:240] Negotiation successful
0808 02:30:36.166299 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":718,"thread_start_us":406,"threads_started":1}
I20260808 02:30:36.169224 25805 heartbeater.cc:347] Connected to a master server at 127.24.116.254:37141
I20260808 02:30:36.169538 25805 heartbeater.cc:464] Registering TS with master...
I20260808 02:30:36.170262 25805 heartbeater.cc:511] Master 127.24.116.254:37141 requested a full tablet report, sending...
I20260808 02:30:36.171759 25125 ts_manager.cc:194] Registered new tserver with Master: c605e90392614c6c9a7ba1d70bb6a7b3 (127.24.116.195:46547)
I20260808 02:30:36.172637 25125 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.195@KRBTEST.COM'} at 127.24.116.195:51755
I20260808 02:30:36.176005 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 02:30:36 dist-test-slave-45dx krb5kdc[25055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156236, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 02:30:36 dist-test-slave-45dx krb5kdc[25055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156236, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.116.193@KRBTEST.COM
I20260808 02:30:36.230155 25817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:36.212513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36298 (local address 127.24.116.193:44673)
0808 02:30:36.213254 (+ 741us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:36.213266 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:36.213356 (+ 90us) server_negotiation.cc:407] Connection header received
0808 02:30:36.213579 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:36.213587 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:36.213811 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:36.214005 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:36.215772 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:36.216970 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:36.218316 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:36.218990 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:36.219131 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:36.223575 (+ 4444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:36.223586 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:36.223601 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:36.223645 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:36.226608 (+ 2963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:36.227284 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:36.227292 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:36.227295 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:36.227423 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:36.228220 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:36.228226 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:36.228230 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:36.228690 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:36.229065 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:36.229429 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 02:30:36.229753 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":331,"threads_started":1}
W20260808 02:30:36.231575 25294 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36298
Aug 08 02:30:36 dist-test-slave-45dx krb5kdc[25055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156236, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 02:30:36 dist-test-slave-45dx krb5kdc[25055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156236, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.193@KRBTEST.COM
I20260808 02:30:36.289762 25817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:36.273880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36310 (local address 127.24.116.193:44673)
0808 02:30:36.274121 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:36.274127 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:36.274325 (+ 198us) server_negotiation.cc:407] Connection header received
0808 02:30:36.274481 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:36.274485 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:36.274586 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:36.274677 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:36.276053 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:36.276977 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:36.278319 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:36.278753 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:36.278901 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:36.283543 (+ 4642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:36.283548 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:36.283551 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:36.283588 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:36.286731 (+ 3143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:36.287436 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:36.287440 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:36.287443 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:36.287603 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:36.288033 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:36.288036 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:36.288039 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:36.288448 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:36.288710 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:36.289057 (+ 347us) server_negotiation.cc:299] Negotiation successful
0808 02:30:36.289298 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 02:30:36.291417 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 25226
I20260808 02:30:36.305084 25817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:36.292524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36324 (local address 127.24.116.193:44673)
0808 02:30:36.292679 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:36.292683 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:36.293164 (+ 481us) server_negotiation.cc:407] Connection header received
0808 02:30:36.293305 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:36.293308 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:36.293368 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:36.293448 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:36.294757 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:36.295541 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:36.297024 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:36.297437 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:36.297532 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:36.299806 (+ 2274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:36.299811 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:36.299814 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:36.299843 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:36.302753 (+ 2910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:36.303406 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:36.303409 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:36.303412 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:36.303560 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:36.303892 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:36.303895 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:36.303897 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:36.304145 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:36.304397 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:36.304628 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 02:30:36.304790 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 02:30:36.305907 25414 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:30:36.390267 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 25226
I20260808 02:30:36.417608 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 25426
Aug 08 02:30:36 dist-test-slave-45dx krb5kdc[25055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156236, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.194@KRBTEST.COM
I20260808 02:30:36.434736 25829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:36.418534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39408 (local address 127.24.116.194:40769)
0808 02:30:36.419264 (+ 730us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:36.419271 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:36.419296 (+ 25us) server_negotiation.cc:407] Connection header received
0808 02:30:36.419356 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:36.419362 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:36.419577 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:36.419705 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:36.421497 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:36.422607 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:36.423818 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:36.424533 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:36.424649 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:36.428782 (+ 4133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:36.428794 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:36.428809 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:36.428846 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:36.431768 (+ 2922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:36.432530 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:36.432538 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:36.432540 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:36.432669 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:36.433101 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:36.433105 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:36.433107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:36.433460 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:36.433784 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:36.434081 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 02:30:36.434364 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":278,"threads_started":1}
I20260808 02:30:36.436059 25610 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:30:36.524868 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 25426
I20260808 02:30:36.551038 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 25624
Aug 08 02:30:36 dist-test-slave-45dx krb5kdc[25055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156236, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.195@KRBTEST.COM
I20260808 02:30:36.568377 25832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:36.552099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52202 (local address 127.24.116.195:46547)
0808 02:30:36.552795 (+ 696us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:36.552802 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:36.552831 (+ 29us) server_negotiation.cc:407] Connection header received
0808 02:30:36.552892 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:36.552898 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:36.553133 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:36.553258 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:36.554632 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:36.555801 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:36.557155 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:36.557711 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:36.557812 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:36.562219 (+ 4407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:36.562231 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:36.562246 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:36.562287 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:36.565329 (+ 3042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:36.566046 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:36.566054 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:36.566057 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:36.566186 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:36.566547 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:36.566550 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:36.566552 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:36.566967 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:36.567257 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:36.567585 (+ 328us) server_negotiation.cc:299] Negotiation successful
0808 02:30:36.567956 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":375,"threads_started":1}
I20260808 02:30:36.569741 25795 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:30:36.659000 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 25624
I20260808 02:30:36.685436 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 25075
I20260808 02:30:36.686640 25177 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:30:36.791313 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 25075
2026-08-08T02:30:36Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4706 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:30:36 dist-test-slave-45dx krb5kdc[25839](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:30:36 dist-test-slave-45dx krb5kdc[25839](info): set up 2 sockets
Aug 08 02:30:36 dist-test-slave-45dx krb5kdc[25839](info): commencing operation
krb5kdc: starting...
W20260808 02:30:38.109758 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.266s user 0.000s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:30:38 dist-test-slave-45dx krb5kdc[25839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156238, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:30:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:30:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:30:38.319384 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:43477
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:45289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:43477
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:30:38.653831 25859 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:30:38.654146 25859 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:30:38.654240 25859 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:30:38.661419 25859 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:30:38.661528 25859 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:30:38.661583 25859 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:30:38.661643 25859 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:30:38.661686 25859 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:30:38.671569 25859 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:45289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:43477
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:43477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:30:38.672889 25859 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:30:38.674156 25859 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:30:38.685911 25873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:38.685967 25866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:38.686002 25865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:30:38.686882 25859 server_base.cc:1034] running on GCE node
I20260808 02:30:38.687894 25859 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:30:38.689402 25859 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:30:38.690675 25859 hybrid_clock.cc:648] HybridClock initialized: now 1786156238690632 us; error 44 us; skew 500 ppm
I20260808 02:30:38.691066 25859 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:30:38 dist-test-slave-45dx krb5kdc[25839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156238, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:30:38.694322 25859 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:30:38.695719 25859 webserver.cc:460] Webserver started at http://127.24.116.254:34559/ using document root <none> and password file <none>
I20260808 02:30:38.696448 25859 fs_manager.cc:359] Metadata directory not provided
I20260808 02:30:38.696559 25859 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:30:38.696832 25859 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:30:38.699782 25859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "8668202cb1ad4e92abd63f501270f338"
format_stamp: "Formatted at 2026-08-08 02:30:38 on dist-test-slave-45dx"
server_key: "635b0493c4cdbddd910dc3415f148666"
server_key_iv: "b0d123e0728c9188281edee13120720b"
server_key_version: "encryptionkey@0"
I20260808 02:30:38.700580 25859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "8668202cb1ad4e92abd63f501270f338"
format_stamp: "Formatted at 2026-08-08 02:30:38 on dist-test-slave-45dx"
server_key: "635b0493c4cdbddd910dc3415f148666"
server_key_iv: "b0d123e0728c9188281edee13120720b"
server_key_version: "encryptionkey@0"
I20260808 02:30:38.705919 25859 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260808 02:30:38.709435 25885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:38.710801 25859 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 02:30:38.711009 25859 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "8668202cb1ad4e92abd63f501270f338"
format_stamp: "Formatted at 2026-08-08 02:30:38 on dist-test-slave-45dx"
server_key: "635b0493c4cdbddd910dc3415f148666"
server_key_iv: "b0d123e0728c9188281edee13120720b"
server_key_version: "encryptionkey@0"
I20260808 02:30:38.711223 25859 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:30:38.730916 25859 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:30:38.735373 25859 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:30:38.735718 25859 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:30:38.754626 25859 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:43477
I20260808 02:30:38.754643 25964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:43477 every 8 connection(s)
I20260808 02:30:38.756100 25859 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:30:38.759217 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 25859
I20260808 02:30:38.759469 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:30:38.760138 25043 external_mini_cluster.cc:1428] Setting key 49712eb9eee797f7bb27e96b753eac4c
I20260808 02:30:38.760178 25966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:38.775089 25966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8668202cb1ad4e92abd63f501270f338: Bootstrap starting.
Aug 08 02:30:38 dist-test-slave-45dx krb5kdc[25839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156238, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:30:38.778596 25966 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8668202cb1ad4e92abd63f501270f338: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:38.779703 25966 log.cc:824] T 00000000000000000000000000000000 P 8668202cb1ad4e92abd63f501270f338: Log is configured to *not* fsync() on all Append() calls
I20260808 02:30:38.782558 25966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8668202cb1ad4e92abd63f501270f338: No bootstrap required, opened a new log
I20260808 02:30:38.784032 25974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:38.762204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33538 (local address 127.24.116.254:43477)
0808 02:30:38.763062 (+ 858us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:38.763074 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:38.763122 (+ 48us) server_negotiation.cc:407] Connection header received
0808 02:30:38.764999 (+ 1877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:38.765022 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:38.765401 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:38.765760 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:38.767683 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:38.769080 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:38.770826 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:38.771532 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:38.771678 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:38.776603 (+ 4925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:38.776614 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:38.776627 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:38.776670 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:38.779770 (+ 3100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:38.780635 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:38.780642 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:38.780648 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:38.780829 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:38.781244 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:38.781249 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:38.781254 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:38.781809 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:38.782128 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:38.782670 (+ 542us) server_negotiation.cc:299] Negotiation successful
0808 02:30:38.783079 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":629,"thread_start_us":404,"threads_started":1}
I20260808 02:30:38.791219 25966 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8668202cb1ad4e92abd63f501270f338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8668202cb1ad4e92abd63f501270f338" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 43477 } }
I20260808 02:30:38.791718 25966 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8668202cb1ad4e92abd63f501270f338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:38.791828 25966 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8668202cb1ad4e92abd63f501270f338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668202cb1ad4e92abd63f501270f338, State: Initialized, Role: FOLLOWER
I20260808 02:30:38.792430 25966 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8668202cb1ad4e92abd63f501270f338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8668202cb1ad4e92abd63f501270f338" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 43477 } }
I20260808 02:30:38.792654 25966 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8668202cb1ad4e92abd63f501270f338 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:30:38.792754 25966 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8668202cb1ad4e92abd63f501270f338 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:30:38.792879 25966 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8668202cb1ad4e92abd63f501270f338 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:38.795056 25966 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8668202cb1ad4e92abd63f501270f338 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8668202cb1ad4e92abd63f501270f338" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 43477 } }
I20260808 02:30:38.795527 25966 leader_election.cc:302] T 00000000000000000000000000000000 P 8668202cb1ad4e92abd63f501270f338 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8668202cb1ad4e92abd63f501270f338; no voters:
I20260808 02:30:38.796057 25966 leader_election.cc:288] T 00000000000000000000000000000000 P 8668202cb1ad4e92abd63f501270f338 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:30:38.796211 25978 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8668202cb1ad4e92abd63f501270f338 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:30:38.796984 25978 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8668202cb1ad4e92abd63f501270f338 [term 1 LEADER]: Becoming Leader. State: Replica: 8668202cb1ad4e92abd63f501270f338, State: Running, Role: LEADER
I20260808 02:30:38.797564 25978 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8668202cb1ad4e92abd63f501270f338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8668202cb1ad4e92abd63f501270f338" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 43477 } }
I20260808 02:30:38.798292 25966 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8668202cb1ad4e92abd63f501270f338 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:30:38.800540 25980 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8668202cb1ad4e92abd63f501270f338 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8668202cb1ad4e92abd63f501270f338. Latest consensus state: current_term: 1 leader_uuid: "8668202cb1ad4e92abd63f501270f338" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8668202cb1ad4e92abd63f501270f338" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 43477 } } }
I20260808 02:30:38.800571 25979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8668202cb1ad4e92abd63f501270f338 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8668202cb1ad4e92abd63f501270f338" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8668202cb1ad4e92abd63f501270f338" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 43477 } } }
I20260808 02:30:38.801062 25979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8668202cb1ad4e92abd63f501270f338 [sys.catalog]: This master's current role is: LEADER
I20260808 02:30:38.801016 25980 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8668202cb1ad4e92abd63f501270f338 [sys.catalog]: This master's current role is: LEADER
I20260808 02:30:38.802771 25985 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:30:38.808771 25985 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:30:38.818125 25985 catalog_manager.cc:1347] Generated new cluster ID: 475cadc362dd442bb094bf38b906a970
I20260808 02:30:38.818287 25985 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:30:38.830447 25985 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:30:38.831802 25985 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:30:38.838843 25985 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8668202cb1ad4e92abd63f501270f338: Generated new TSK 0
I20260808 02:30:38.839711 25985 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.116.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
I20260808 02:30:38.907770 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:43477
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:45289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:30:39.277011 26007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:30:39.277330 26007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:30:39.277432 26007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:30:39.285089 26007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:30:39.285204 26007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:30:39.285324 26007 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:30:39.295653 26007 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:45289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:43477
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:30:39.297073 26007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:30:39.298506 26007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:30:39.312182 26017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:39.312198 26020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:39.312696 26022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:30:39.313876 26007 server_base.cc:1034] running on GCE node
I20260808 02:30:39.314658 26007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:30:39.315801 26007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:30:39.317039 26007 hybrid_clock.cc:648] HybridClock initialized: now 1786156239316987 us; error 84 us; skew 500 ppm
I20260808 02:30:39.317384 26007 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:30:39 dist-test-slave-45dx krb5kdc[25839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156239, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:30:39.320722 26007 init.cc:377] Logged in from keytab as kudu/127.24.116.193@KRBTEST.COM (short username kudu)
I20260808 02:30:39.322289 26007 webserver.cc:460] Webserver started at http://127.24.116.193:35317/ using document root <none> and password file <none>
I20260808 02:30:39.323028 26007 fs_manager.cc:359] Metadata directory not provided
I20260808 02:30:39.323174 26007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:30:39.323515 26007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:30:39.326550 26007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "d901ce8da0f54e97a490541ec65891e6"
format_stamp: "Formatted at 2026-08-08 02:30:39 on dist-test-slave-45dx"
server_key: "38717623961352b438b60d8fdcdfa4d1"
server_key_iv: "440cfe5e69d4a6b0381d6058e50281a2"
server_key_version: "encryptionkey@0"
I20260808 02:30:39.327368 26007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "d901ce8da0f54e97a490541ec65891e6"
format_stamp: "Formatted at 2026-08-08 02:30:39 on dist-test-slave-45dx"
server_key: "38717623961352b438b60d8fdcdfa4d1"
server_key_iv: "440cfe5e69d4a6b0381d6058e50281a2"
server_key_version: "encryptionkey@0"
I20260808 02:30:39.332733 26007 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 02:30:39.336288 26029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:39.337641 26007 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:30:39.337826 26007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "d901ce8da0f54e97a490541ec65891e6"
format_stamp: "Formatted at 2026-08-08 02:30:39 on dist-test-slave-45dx"
server_key: "38717623961352b438b60d8fdcdfa4d1"
server_key_iv: "440cfe5e69d4a6b0381d6058e50281a2"
server_key_version: "encryptionkey@0"
I20260808 02:30:39.338014 26007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:30:39.357062 26007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:30:39.361605 26007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:30:39.361941 26007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:30:39.362934 26007 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:30:39.364437 26007 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:30:39.364513 26007 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:39.364665 26007 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:30:39.364732 26007 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:39.397962 26007 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:43337
I20260808 02:30:39.398015 26196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:43337 every 8 connection(s)
I20260808 02:30:39.399417 26007 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:30:39.402025 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 26007
I20260808 02:30:39.402273 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:30:39.403010 25043 external_mini_cluster.cc:1428] Setting key 125b5c09bc39789e129c27a5f6f58efb
Aug 08 02:30:39 dist-test-slave-45dx krb5kdc[25839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156239, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:30:39.422403 26201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:39.402271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:46295 (local address 127.24.116.254:43477)
0808 02:30:39.402782 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:39.402790 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:39.403948 (+ 1158us) server_negotiation.cc:407] Connection header received
0808 02:30:39.406251 (+ 2303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:39.406260 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:39.406363 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:39.406483 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:39.408007 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:39.409172 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:39.410745 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:39.411470 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:39.411595 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:39.416127 (+ 4532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:39.416132 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:39.416135 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:39.416167 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:39.418838 (+ 2671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:39.419640 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:39.419649 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:39.419655 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:39.419844 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:39.420284 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:39.420292 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:39.420297 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:39.420745 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:39.420942 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:39.421635 (+ 693us) server_negotiation.cc:299] Negotiation successful
0808 02:30:39.421934 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":246,"threads_started":1}
I20260808 02:30:39.423081 26202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:39.402908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:43477 (local address 127.24.116.193:46295)
0808 02:30:39.403768 (+ 860us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:39.403824 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:39.405969 (+ 2145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:39.406704 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:39.406712 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:39.407250 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:30:39.407818 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:39.407836 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:39.409348 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:39.409352 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:39.410595 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:39.410607 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:39.411733 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:39.411741 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:39.412103 (+ 362us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:39.412922 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:30:39.412965 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:30:39.415872 (+ 2907us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:30:39.419004 (+ 3132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:39.419013 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:39.419031 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:39.419473 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:39.419972 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:39.419976 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:39.419978 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:39.420163 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:39.420889 (+ 726us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:30:39.420895 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:30:39.421225 (+ 330us) client_negotiation.cc:769] Sending connection context
0808 02:30:39.421472 (+ 247us) client_negotiation.cc:240] Negotiation successful
0808 02:30:39.421881 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":392,"threads_started":1}
WARNING: no policy specified for kudu/127.24.116.194@KRBTEST.COM; defaulting to no policy
I20260808 02:30:39.424767 26198 heartbeater.cc:347] Connected to a master server at 127.24.116.254:43477
I20260808 02:30:39.425060 26198 heartbeater.cc:464] Registering TS with master...
I20260808 02:30:39.425753 26198 heartbeater.cc:511] Master 127.24.116.254:43477 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.194@KRBTEST.COM" created.
I20260808 02:30:39.428104 25916 ts_manager.cc:194] Registered new tserver with Master: d901ce8da0f54e97a490541ec65891e6 (127.24.116.193:43337)
I20260808 02:30:39.429639 25916 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.193@KRBTEST.COM'} at 127.24.116.193:46295
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
I20260808 02:30:39.455691 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:43477
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:45289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:30:39.800148 26207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:30:39.800499 26207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:30:39.800606 26207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:30:39.807977 26207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:30:39.808089 26207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:30:39.808208 26207 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:30:39.818322 26207 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:45289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:43477
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:30:39.819583 26207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:30:39.820904 26207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:30:39.834338 26213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:39.834291 26221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:39.834372 26216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:30:39.835515 26207 server_base.cc:1034] running on GCE node
I20260808 02:30:39.836185 26207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:30:39.837263 26207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:30:39.838480 26207 hybrid_clock.cc:648] HybridClock initialized: now 1786156239838426 us; error 40 us; skew 500 ppm
I20260808 02:30:39.838761 26207 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:30:39 dist-test-slave-45dx krb5kdc[25839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156239, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:30:39.847131 26207 init.cc:377] Logged in from keytab as kudu/127.24.116.194@KRBTEST.COM (short username kudu)
I20260808 02:30:39.848809 26207 webserver.cc:460] Webserver started at http://127.24.116.194:34103/ using document root <none> and password file <none>
I20260808 02:30:39.849499 26207 fs_manager.cc:359] Metadata directory not provided
I20260808 02:30:39.849606 26207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:30:39.849869 26207 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:30:39.852878 26207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "bc7c10c8c3dd4c78b53833a7a60734dc"
format_stamp: "Formatted at 2026-08-08 02:30:39 on dist-test-slave-45dx"
server_key: "7e4a6190f74e4526a1a75bc8d0ccbc7a"
server_key_iv: "a2fa511e1bd1cfda5a355dd566627739"
server_key_version: "encryptionkey@0"
I20260808 02:30:39.853678 26207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "bc7c10c8c3dd4c78b53833a7a60734dc"
format_stamp: "Formatted at 2026-08-08 02:30:39 on dist-test-slave-45dx"
server_key: "7e4a6190f74e4526a1a75bc8d0ccbc7a"
server_key_iv: "a2fa511e1bd1cfda5a355dd566627739"
server_key_version: "encryptionkey@0"
I20260808 02:30:39.859042 26207 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 02:30:39.862673 26230 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:39.864034 26207 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 02:30:39.864173 26207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "bc7c10c8c3dd4c78b53833a7a60734dc"
format_stamp: "Formatted at 2026-08-08 02:30:39 on dist-test-slave-45dx"
server_key: "7e4a6190f74e4526a1a75bc8d0ccbc7a"
server_key_iv: "a2fa511e1bd1cfda5a355dd566627739"
server_key_version: "encryptionkey@0"
I20260808 02:30:39.864409 26207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:30:39.893795 26207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:30:39.898152 26207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:30:39.898409 26207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:30:39.899470 26207 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:30:39.900852 26207 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:30:39.900928 26207 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:39.901017 26207 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:30:39.901062 26207 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:39.938138 26207 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:35851
I20260808 02:30:39.938200 26397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:35851 every 8 connection(s)
I20260808 02:30:39.940109 26207 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:30:39.946969 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 26207
I20260808 02:30:39.947175 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:30:39.947745 25043 external_mini_cluster.cc:1428] Setting key 54604bbadd646f0c8b8d71e2fae69650
Aug 08 02:30:39 dist-test-slave-45dx krb5kdc[25839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156239, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:30:39.970543 26404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:39.943762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:43477 (local address 127.24.116.194:59873)
0808 02:30:39.945509 (+ 1747us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:39.945579 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:39.947856 (+ 2277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:39.948703 (+ 847us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:39.948715 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:39.949332 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:30:39.949997 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:39.950025 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:39.951464 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:39.951472 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:39.953294 (+ 1822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:39.953318 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:39.954598 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:39.954624 (+ 26us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:39.955010 (+ 386us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:39.955991 (+ 981us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:30:39.956025 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:30:39.959829 (+ 3804us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:30:39.964607 (+ 4778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:39.964621 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:39.964644 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:39.965441 (+ 797us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:39.965994 (+ 553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:39.966002 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:39.966008 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:39.966277 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:39.967178 (+ 901us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:30:39.967190 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:30:39.967840 (+ 650us) client_negotiation.cc:769] Sending connection context
0808 02:30:39.968192 (+ 352us) client_negotiation.cc:240] Negotiation successful
0808 02:30:39.968894 (+ 702us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1361,"thread_start_us":1108,"threads_started":1}
WARNING: no policy specified for kudu/127.24.116.195@KRBTEST.COM; defaulting to no policy
I20260808 02:30:39.972139 26403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:39.943279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:59873 (local address 127.24.116.254:43477)
0808 02:30:39.945887 (+ 2608us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:39.945893 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:39.945913 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:30:39.948172 (+ 2259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:39.948177 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:39.948248 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:39.948425 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:39.950184 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:39.951290 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:39.953471 (+ 2181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:39.954264 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:39.954404 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:39.960164 (+ 5760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:39.960173 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:39.960180 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:39.960228 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:39.964341 (+ 4113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:39.965621 (+ 1280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:39.965630 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:39.965636 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:39.965836 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:39.966454 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:39.966462 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:39.966469 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:39.966898 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:39.967073 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:39.971243 (+ 4170us) server_negotiation.cc:299] Negotiation successful
0808 02:30:39.971572 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2496,"thread_start_us":2386,"threads_started":1}
I20260808 02:30:39.973678 26401 heartbeater.cc:347] Connected to a master server at 127.24.116.254:43477
I20260808 02:30:39.974037 26401 heartbeater.cc:464] Registering TS with master...
I20260808 02:30:39.974812 26401 heartbeater.cc:511] Master 127.24.116.254:43477 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.195@KRBTEST.COM" created.
I20260808 02:30:39.977028 25916 ts_manager.cc:194] Registered new tserver with Master: bc7c10c8c3dd4c78b53833a7a60734dc (127.24.116.194:35851)
I20260808 02:30:39.977950 25916 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.194@KRBTEST.COM'} at 127.24.116.194:59873
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
I20260808 02:30:40.008932 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:43477
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:45289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:30:40.359027 26409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:30:40.359418 26409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:30:40.359601 26409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:30:40.367147 26409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:30:40.367322 26409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:30:40.367494 26409 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:30:40.378059 26409 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:45289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:43477
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:30:40.379482 26409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:30:40.380939 26409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:30:40.394729 26418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:40.394951 26414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:40.394910 26415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:30:40.395748 26409 server_base.cc:1034] running on GCE node
I20260808 02:30:40.396538 26409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:30:40.397789 26409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:30:40.399078 26409 hybrid_clock.cc:648] HybridClock initialized: now 1786156240398894 us; error 98 us; skew 500 ppm
I20260808 02:30:40.399510 26409 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:30:40 dist-test-slave-45dx krb5kdc[25839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156240, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:30:40.403702 26409 init.cc:377] Logged in from keytab as kudu/127.24.116.195@KRBTEST.COM (short username kudu)
I20260808 02:30:40.405469 26409 webserver.cc:460] Webserver started at http://127.24.116.195:39389/ using document root <none> and password file <none>
I20260808 02:30:40.406282 26409 fs_manager.cc:359] Metadata directory not provided
I20260808 02:30:40.406400 26409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:30:40.406673 26409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:30:40.409776 26409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "ed8201d3d7aa412082afcceb4e41a4e1"
format_stamp: "Formatted at 2026-08-08 02:30:40 on dist-test-slave-45dx"
server_key: "5877f0207bfb00f6f1668f47c06f3db3"
server_key_iv: "9dbc833987dfe04d520ff7e50aa60480"
server_key_version: "encryptionkey@0"
I20260808 02:30:40.410619 26409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "ed8201d3d7aa412082afcceb4e41a4e1"
format_stamp: "Formatted at 2026-08-08 02:30:40 on dist-test-slave-45dx"
server_key: "5877f0207bfb00f6f1668f47c06f3db3"
server_key_iv: "9dbc833987dfe04d520ff7e50aa60480"
server_key_version: "encryptionkey@0"
I20260808 02:30:40.416536 26409 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 02:30:40.420233 26428 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:40.421751 26409 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:30:40.421947 26409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "ed8201d3d7aa412082afcceb4e41a4e1"
format_stamp: "Formatted at 2026-08-08 02:30:40 on dist-test-slave-45dx"
server_key: "5877f0207bfb00f6f1668f47c06f3db3"
server_key_iv: "9dbc833987dfe04d520ff7e50aa60480"
server_key_version: "encryptionkey@0"
I20260808 02:30:40.422178 26409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:30:40.432745 26198 heartbeater.cc:503] Master 127.24.116.254:43477 was elected leader, sending a full tablet report...
I20260808 02:30:40.447113 26409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:30:40.451614 26409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:30:40.451936 26409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:30:40.453367 26409 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:30:40.455216 26409 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:30:40.455344 26409 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:40.455520 26409 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:30:40.455603 26409 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:40.501771 26409 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:39967
I20260808 02:30:40.501888 26610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:39967 every 8 connection(s)
I20260808 02:30:40.503196 26409 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:30:40.511246 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 26409
I20260808 02:30:40.511471 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:30:40.512001 25043 external_mini_cluster.cc:1428] Setting key 725dda0a51d12adcdb4ca56dea451799
Aug 08 02:30:40 dist-test-slave-45dx krb5kdc[25839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156240, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:30:40.527184 26617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:40.506241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:33095 (local address 127.24.116.254:43477)
0808 02:30:40.506782 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:40.506788 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:40.507772 (+ 984us) server_negotiation.cc:407] Connection header received
0808 02:30:40.510113 (+ 2341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:40.510119 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:40.510220 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:40.510357 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:40.512568 (+ 2211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.513664 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.516095 (+ 2431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.516562 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.516665 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:40.520690 (+ 4025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:40.520695 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:40.520698 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:40.520733 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:40.523374 (+ 2641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:40.524427 (+ 1053us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:40.524431 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:40.524433 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:40.524558 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:40.525031 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:40.525034 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:40.525036 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:40.525302 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:40.525424 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:40.526326 (+ 902us) server_negotiation.cc:299] Negotiation successful
0808 02:30:40.526581 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":283,"threads_started":1}
I20260808 02:30:40.528283 26618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:40.506758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:43477 (local address 127.24.116.195:33095)
0808 02:30:40.507579 (+ 821us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:40.507619 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:40.509816 (+ 2197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:40.510617 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:40.510625 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:40.511459 (+ 834us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:30:40.512357 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:40.512388 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.513889 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.513896 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:40.515967 (+ 2071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:40.515980 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.516774 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.516782 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:40.517027 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:40.517817 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:30:40.517843 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:30:40.520465 (+ 2622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:30:40.523628 (+ 3163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:40.523636 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:40.523651 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:40.524217 (+ 566us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:40.524691 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:40.524694 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:40.524697 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:40.524910 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:40.525421 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:30:40.525427 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:30:40.525817 (+ 390us) client_negotiation.cc:769] Sending connection context
0808 02:30:40.526179 (+ 362us) client_negotiation.cc:240] Negotiation successful
0808 02:30:40.526767 (+ 588us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":333,"threads_started":1}
I20260808 02:30:40.529740 26612 heartbeater.cc:347] Connected to a master server at 127.24.116.254:43477
I20260808 02:30:40.530021 26612 heartbeater.cc:464] Registering TS with master...
I20260808 02:30:40.530709 26612 heartbeater.cc:511] Master 127.24.116.254:43477 requested a full tablet report, sending...
I20260808 02:30:40.532166 25916 ts_manager.cc:194] Registered new tserver with Master: ed8201d3d7aa412082afcceb4e41a4e1 (127.24.116.195:39967)
I20260808 02:30:40.532998 25916 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.195@KRBTEST.COM'} at 127.24.116.195:33095
I20260808 02:30:40.540762 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:30:40.561589 26617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:40.547904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33554 (local address 127.24.116.254:43477)
0808 02:30:40.548114 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:40.548122 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:40.548742 (+ 620us) server_negotiation.cc:407] Connection header received
0808 02:30:40.548876 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:40.548881 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:40.548951 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:40.549036 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:40.550640 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.551618 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.552985 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.553452 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.553558 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:40.555836 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:40.555840 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:40.555844 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:40.555878 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:40.559034 (+ 3156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:40.559646 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:40.559650 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:40.559652 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:40.559824 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:40.560152 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:40.560155 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:40.560157 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:40.560543 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:40.560848 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:40.561003 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 02:30:40.561180 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 02:30:40.568642 25916 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33554:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:30:40.576472 25916 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:30:40.612954 26640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:40.590462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54212 (local address 127.24.116.194:35851)
0808 02:30:40.600149 (+ 9687us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:40.600163 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:40.604201 (+ 4038us) server_negotiation.cc:407] Connection header received
0808 02:30:40.604348 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:40.604357 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:40.604649 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:40.604845 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:30:40.605663 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.607249 (+ 1586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.610125 (+ 2876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.611695 (+ 1570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.611926 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:40.612126 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:40.612377 (+ 251us) server_negotiation.cc:299] Negotiation successful
0808 02:30:40.612584 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9421,"thread_start_us":9233,"threads_started":1}
I20260808 02:30:40.613269 26635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:40.589725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:35851 (local address 127.0.0.1:54212)
0808 02:30:40.603858 (+ 14133us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:40.603883 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:40.604041 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:40.604874 (+ 833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:40.604878 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:40.604903 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:30:40.605413 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:40.605430 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.607405 (+ 1975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.607413 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:40.609915 (+ 2502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:40.609933 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.611935 (+ 2002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.611940 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:40.612074 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:40.612111 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 02:30:40.612297 (+ 186us) client_negotiation.cc:240] Negotiation successful
0808 02:30:40.612544 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13965,"mutex_wait_us":259,"thread_start_us":14320,"threads_started":1}
I20260808 02:30:40.613938 26641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:40.590763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43442 (local address 127.24.116.193:43337)
0808 02:30:40.600733 (+ 9970us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:40.600742 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:40.604538 (+ 3796us) server_negotiation.cc:407] Connection header received
0808 02:30:40.604646 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:40.604654 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:40.604868 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:40.605085 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:30:40.605988 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.607356 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.610573 (+ 3217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.612097 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.612368 (+ 271us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:40.612534 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:40.613464 (+ 930us) server_negotiation.cc:299] Negotiation successful
0808 02:30:40.613664 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9786,"thread_start_us":9615,"threads_started":1}
I20260808 02:30:40.613312 26636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:40.590151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:43337 (local address 127.0.0.1:43442)
0808 02:30:40.604339 (+ 14188us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:40.604357 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:40.604487 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:40.605220 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:40.605225 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:40.605255 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:30:40.605785 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:40.605797 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.607480 (+ 1683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.607485 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:40.610394 (+ 2909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:40.610410 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.612369 (+ 1959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.612384 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:40.612552 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:40.612582 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 02:30:40.612673 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 02:30:40.612820 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14039,"mutex_wait_us":7,"thread_start_us":10835,"threads_started":1}
I20260808 02:30:40.616420 26639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:40.589910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55626 (local address 127.24.116.195:39967)
0808 02:30:40.603449 (+ 13539us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:40.603476 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:40.603517 (+ 41us) server_negotiation.cc:407] Connection header received
0808 02:30:40.603636 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:40.603647 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:40.603935 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:40.604149 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:30:40.605145 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.607290 (+ 2145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.612637 (+ 5347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.615052 (+ 2415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.615261 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:40.615436 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:40.615844 (+ 408us) server_negotiation.cc:299] Negotiation successful
0808 02:30:40.616036 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13342,"thread_start_us":13171,"threads_started":1}
I20260808 02:30:40.616441 26642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:40.589598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:39967 (local address 127.0.0.1:55626)
0808 02:30:40.601429 (+ 11831us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:40.601472 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:40.601762 (+ 290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:40.604359 (+ 2597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:40.604368 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:40.604410 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:30:40.604888 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:40.604898 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.607480 (+ 2582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.607485 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:40.610411 (+ 2926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:40.610421 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.615271 (+ 4850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.615278 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:40.615605 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:40.615650 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 02:30:40.615748 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 02:30:40.616004 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11560,"mutex_wait_us":116,"thread_start_us":13928,"threads_started":1}
I20260808 02:30:40.617970 26295 tablet_service.cc:1467] Processing CreateTablet for tablet 13dc6dd0f2d5483ab7407d8edbf0fe2c (DEFAULT_TABLE table=test-table [id=70a4c34e37c14fafae3e4134ed503723]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:30:40.618292 26098 tablet_service.cc:1467] Processing CreateTablet for tablet 13dc6dd0f2d5483ab7407d8edbf0fe2c (DEFAULT_TABLE table=test-table [id=70a4c34e37c14fafae3e4134ed503723]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:30:40.619452 26295 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13dc6dd0f2d5483ab7407d8edbf0fe2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:40.619989 26098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13dc6dd0f2d5483ab7407d8edbf0fe2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:40.620218 26505 tablet_service.cc:1467] Processing CreateTablet for tablet 13dc6dd0f2d5483ab7407d8edbf0fe2c (DEFAULT_TABLE table=test-table [id=70a4c34e37c14fafae3e4134ed503723]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:30:40.621762 26505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13dc6dd0f2d5483ab7407d8edbf0fe2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:40.632063 26643 tablet_bootstrap.cc:492] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P bc7c10c8c3dd4c78b53833a7a60734dc: Bootstrap starting.
I20260808 02:30:40.635614 26648 tablet_bootstrap.cc:492] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6: Bootstrap starting.
I20260808 02:30:40.637209 26649 tablet_bootstrap.cc:492] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P ed8201d3d7aa412082afcceb4e41a4e1: Bootstrap starting.
I20260808 02:30:40.637935 26643 tablet_bootstrap.cc:654] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P bc7c10c8c3dd4c78b53833a7a60734dc: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:40.639392 26643 log.cc:824] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P bc7c10c8c3dd4c78b53833a7a60734dc: Log is configured to *not* fsync() on all Append() calls
I20260808 02:30:40.639487 26648 tablet_bootstrap.cc:654] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:40.640264 26649 tablet_bootstrap.cc:654] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P ed8201d3d7aa412082afcceb4e41a4e1: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:40.640841 26648 log.cc:824] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6: Log is configured to *not* fsync() on all Append() calls
I20260808 02:30:40.643217 26649 log.cc:824] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P ed8201d3d7aa412082afcceb4e41a4e1: Log is configured to *not* fsync() on all Append() calls
I20260808 02:30:40.643510 26643 tablet_bootstrap.cc:492] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P bc7c10c8c3dd4c78b53833a7a60734dc: No bootstrap required, opened a new log
I20260808 02:30:40.643863 26643 ts_tablet_manager.cc:1397] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P bc7c10c8c3dd4c78b53833a7a60734dc: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260808 02:30:40.646797 26648 tablet_bootstrap.cc:492] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6: No bootstrap required, opened a new log
I20260808 02:30:40.647087 26649 tablet_bootstrap.cc:492] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P ed8201d3d7aa412082afcceb4e41a4e1: No bootstrap required, opened a new log
I20260808 02:30:40.647109 26648 ts_tablet_manager.cc:1397] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260808 02:30:40.647360 26649 ts_tablet_manager.cc:1397] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P ed8201d3d7aa412082afcceb4e41a4e1: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260808 02:30:40.655694 26648 raft_consensus.cc:348] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed8201d3d7aa412082afcceb4e41a4e1" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39967 } } peers { permanent_uuid: "bc7c10c8c3dd4c78b53833a7a60734dc" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35851 } } peers { permanent_uuid: "d901ce8da0f54e97a490541ec65891e6" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43337 } }
I20260808 02:30:40.655609 26643 raft_consensus.cc:348] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P bc7c10c8c3dd4c78b53833a7a60734dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed8201d3d7aa412082afcceb4e41a4e1" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39967 } } peers { permanent_uuid: "bc7c10c8c3dd4c78b53833a7a60734dc" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35851 } } peers { permanent_uuid: "d901ce8da0f54e97a490541ec65891e6" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43337 } }
I20260808 02:30:40.656085 26648 raft_consensus.cc:374] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:40.656086 26643 raft_consensus.cc:374] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P bc7c10c8c3dd4c78b53833a7a60734dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:40.656177 26648 raft_consensus.cc:729] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d901ce8da0f54e97a490541ec65891e6, State: Initialized, Role: FOLLOWER
I20260808 02:30:40.656184 26643 raft_consensus.cc:729] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P bc7c10c8c3dd4c78b53833a7a60734dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc7c10c8c3dd4c78b53833a7a60734dc, State: Initialized, Role: FOLLOWER
I20260808 02:30:40.656788 26648 consensus_queue.cc:260] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed8201d3d7aa412082afcceb4e41a4e1" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39967 } } peers { permanent_uuid: "bc7c10c8c3dd4c78b53833a7a60734dc" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35851 } } peers { permanent_uuid: "d901ce8da0f54e97a490541ec65891e6" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43337 } }
I20260808 02:30:40.656927 26643 consensus_queue.cc:260] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P bc7c10c8c3dd4c78b53833a7a60734dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed8201d3d7aa412082afcceb4e41a4e1" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39967 } } peers { permanent_uuid: "bc7c10c8c3dd4c78b53833a7a60734dc" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35851 } } peers { permanent_uuid: "d901ce8da0f54e97a490541ec65891e6" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43337 } }
I20260808 02:30:40.658739 26648 ts_tablet_manager.cc:1428] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260808 02:30:40.659106 26649 raft_consensus.cc:348] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P ed8201d3d7aa412082afcceb4e41a4e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed8201d3d7aa412082afcceb4e41a4e1" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39967 } } peers { permanent_uuid: "bc7c10c8c3dd4c78b53833a7a60734dc" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35851 } } peers { permanent_uuid: "d901ce8da0f54e97a490541ec65891e6" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43337 } }
I20260808 02:30:40.659672 26649 raft_consensus.cc:374] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P ed8201d3d7aa412082afcceb4e41a4e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:40.660136 26401 heartbeater.cc:503] Master 127.24.116.254:43477 was elected leader, sending a full tablet report...
I20260808 02:30:40.660756 26643 ts_tablet_manager.cc:1428] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P bc7c10c8c3dd4c78b53833a7a60734dc: Time spent starting tablet: real 0.017s user 0.006s sys 0.010s
I20260808 02:30:40.659870 26649 raft_consensus.cc:729] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P ed8201d3d7aa412082afcceb4e41a4e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed8201d3d7aa412082afcceb4e41a4e1, State: Initialized, Role: FOLLOWER
I20260808 02:30:40.661535 26649 consensus_queue.cc:260] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P ed8201d3d7aa412082afcceb4e41a4e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed8201d3d7aa412082afcceb4e41a4e1" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39967 } } peers { permanent_uuid: "bc7c10c8c3dd4c78b53833a7a60734dc" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35851 } } peers { permanent_uuid: "d901ce8da0f54e97a490541ec65891e6" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43337 } }
I20260808 02:30:40.664930 26612 heartbeater.cc:503] Master 127.24.116.254:43477 was elected leader, sending a full tablet report...
I20260808 02:30:40.665524 26649 ts_tablet_manager.cc:1428] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P ed8201d3d7aa412082afcceb4e41a4e1: Time spent starting tablet: real 0.018s user 0.017s sys 0.000s
W20260808 02:30:40.692520 26402 tablet.cc:2369] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P bc7c10c8c3dd4c78b53833a7a60734dc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:30:40.755106 26616 tablet.cc:2369] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P ed8201d3d7aa412082afcceb4e41a4e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:30:40.814505 26653 raft_consensus.cc:482] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:30:40.814863 26653 raft_consensus.cc:504] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed8201d3d7aa412082afcceb4e41a4e1" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39967 } } peers { permanent_uuid: "bc7c10c8c3dd4c78b53833a7a60734dc" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35851 } } peers { permanent_uuid: "d901ce8da0f54e97a490541ec65891e6" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43337 } }
I20260808 02:30:40.816942 26653 leader_election.cc:288] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed8201d3d7aa412082afcceb4e41a4e1 (127.24.116.195:39967), bc7c10c8c3dd4c78b53833a7a60734dc (127.24.116.194:35851)
I20260808 02:30:40.824163 26639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:40.817419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:55927 (local address 127.24.116.195:39967)
0808 02:30:40.817678 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:40.817687 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:40.818545 (+ 858us) server_negotiation.cc:407] Connection header received
0808 02:30:40.818728 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:40.818732 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:40.818791 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:40.818899 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:30:40.819445 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.820204 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.822422 (+ 2218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.823205 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.823401 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:40.823482 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:40.823772 (+ 290us) server_negotiation.cc:299] Negotiation successful
0808 02:30:40.823906 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 02:30:40.824326 26657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:40.817171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:39967 (local address 127.24.116.193:55927)
0808 02:30:40.818413 (+ 1242us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:40.818429 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:40.818563 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:40.818910 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:40.818914 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:40.818938 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:30:40.819289 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:40.819298 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.820360 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.820365 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:40.822264 (+ 1899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:40.822277 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.823426 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.823433 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:40.823589 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:40.823614 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 02:30:40.823744 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 02:30:40.823880 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1115,"mutex_wait_us":2,"thread_start_us":978,"threads_started":1}
I20260808 02:30:40.824528 26640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:40.817445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:58163 (local address 127.24.116.194:35851)
0808 02:30:40.817677 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:40.817685 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:40.818634 (+ 949us) server_negotiation.cc:407] Connection header received
0808 02:30:40.818848 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:40.818852 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:40.818913 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:40.819014 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:30:40.819662 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.820519 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.822716 (+ 2197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.823500 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.823682 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:40.823758 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:40.824074 (+ 316us) server_negotiation.cc:299] Negotiation successful
0808 02:30:40.824203 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 02:30:40.824815 26656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:40.817442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:35851 (local address 127.24.116.193:58163)
0808 02:30:40.818519 (+ 1077us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:40.818540 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:40.818684 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:40.819039 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:40.819043 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:40.819078 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:30:40.819495 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:40.819504 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.820661 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.820667 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:40.822564 (+ 1897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:40.822577 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.823724 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.823731 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:40.823894 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:40.823916 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 02:30:40.824046 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 02:30:40.824185 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":935,"mutex_wait_us":28,"thread_start_us":538,"threads_started":1}
I20260808 02:30:40.825781 26539 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13dc6dd0f2d5483ab7407d8edbf0fe2c" candidate_uuid: "d901ce8da0f54e97a490541ec65891e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed8201d3d7aa412082afcceb4e41a4e1" is_pre_election: true
I20260808 02:30:40.825963 26332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13dc6dd0f2d5483ab7407d8edbf0fe2c" candidate_uuid: "d901ce8da0f54e97a490541ec65891e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc7c10c8c3dd4c78b53833a7a60734dc" is_pre_election: true
I20260808 02:30:40.826447 26539 raft_consensus.cc:2454] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P ed8201d3d7aa412082afcceb4e41a4e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d901ce8da0f54e97a490541ec65891e6 in term 0.
I20260808 02:30:40.826576 26332 raft_consensus.cc:2454] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P bc7c10c8c3dd4c78b53833a7a60734dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d901ce8da0f54e97a490541ec65891e6 in term 0.
I20260808 02:30:40.827358 26031 leader_election.cc:302] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d901ce8da0f54e97a490541ec65891e6, ed8201d3d7aa412082afcceb4e41a4e1; no voters:
I20260808 02:30:40.827745 26653 raft_consensus.cc:2781] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:30:40.827911 26653 raft_consensus.cc:482] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:30:40.828020 26653 raft_consensus.cc:3037] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:40.830502 26653 raft_consensus.cc:504] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed8201d3d7aa412082afcceb4e41a4e1" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39967 } } peers { permanent_uuid: "bc7c10c8c3dd4c78b53833a7a60734dc" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35851 } } peers { permanent_uuid: "d901ce8da0f54e97a490541ec65891e6" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43337 } }
I20260808 02:30:40.831190 26653 leader_election.cc:288] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6 [CANDIDATE]: Term 1 election: Requested vote from peers ed8201d3d7aa412082afcceb4e41a4e1 (127.24.116.195:39967), bc7c10c8c3dd4c78b53833a7a60734dc (127.24.116.194:35851)
I20260808 02:30:40.831677 26539 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13dc6dd0f2d5483ab7407d8edbf0fe2c" candidate_uuid: "d901ce8da0f54e97a490541ec65891e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed8201d3d7aa412082afcceb4e41a4e1"
I20260808 02:30:40.831719 26332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13dc6dd0f2d5483ab7407d8edbf0fe2c" candidate_uuid: "d901ce8da0f54e97a490541ec65891e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc7c10c8c3dd4c78b53833a7a60734dc"
I20260808 02:30:40.831935 26332 raft_consensus.cc:3037] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P bc7c10c8c3dd4c78b53833a7a60734dc [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:40.831921 26539 raft_consensus.cc:3037] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P ed8201d3d7aa412082afcceb4e41a4e1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:40.835457 26332 raft_consensus.cc:2454] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P bc7c10c8c3dd4c78b53833a7a60734dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d901ce8da0f54e97a490541ec65891e6 in term 1.
I20260808 02:30:40.835457 26539 raft_consensus.cc:2454] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P ed8201d3d7aa412082afcceb4e41a4e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d901ce8da0f54e97a490541ec65891e6 in term 1.
I20260808 02:30:40.835912 26031 leader_election.cc:302] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d901ce8da0f54e97a490541ec65891e6, ed8201d3d7aa412082afcceb4e41a4e1; no voters:
I20260808 02:30:40.836283 26653 raft_consensus.cc:2781] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:30:40.836808 26653 raft_consensus.cc:686] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6 [term 1 LEADER]: Becoming Leader. State: Replica: d901ce8da0f54e97a490541ec65891e6, State: Running, Role: LEADER
I20260808 02:30:40.837288 26653 consensus_queue.cc:237] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed8201d3d7aa412082afcceb4e41a4e1" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39967 } } peers { permanent_uuid: "bc7c10c8c3dd4c78b53833a7a60734dc" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35851 } } peers { permanent_uuid: "d901ce8da0f54e97a490541ec65891e6" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43337 } }
I20260808 02:30:40.842242 25916 catalog_manager.cc:5495] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d901ce8da0f54e97a490541ec65891e6 (127.24.116.193). New cstate: current_term: 1 leader_uuid: "d901ce8da0f54e97a490541ec65891e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed8201d3d7aa412082afcceb4e41a4e1" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc7c10c8c3dd4c78b53833a7a60734dc" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d901ce8da0f54e97a490541ec65891e6" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43337 } health_report { overall_health: HEALTHY } } }
W20260808 02:30:40.902114 26200 tablet.cc:2369] T 13dc6dd0f2d5483ab7407d8edbf0fe2c P d901ce8da0f54e97a490541ec65891e6: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 02:30:40 dist-test-slave-45dx krb5kdc[25839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156238, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.193@KRBTEST.COM
I20260808 02:30:40.918335 26641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:40.900666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43452 (local address 127.24.116.193:43337)
0808 02:30:40.900971 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:40.900981 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:40.901607 (+ 626us) server_negotiation.cc:407] Connection header received
0808 02:30:40.901756 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:40.901762 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:40.901872 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:40.902011 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:40.903927 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.904832 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.906277 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.906726 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.906874 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:40.911607 (+ 4733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:40.911623 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:40.911641 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:40.911678 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:40.914956 (+ 3278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:40.915858 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:40.915866 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:40.915869 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:40.916074 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:40.916637 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:40.916644 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:40.916647 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:40.917020 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:40.917369 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:40.917675 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 02:30:40.917978 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
Aug 08 02:30:40 dist-test-slave-45dx krb5kdc[25839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156240, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 02:30:40 dist-test-slave-45dx krb5kdc[25839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156240, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.116.193@KRBTEST.COM
I20260808 02:30:40.974426 26641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:40.959268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43456 (local address 127.24.116.193:43337)
0808 02:30:40.959544 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:40.959551 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:40.959807 (+ 256us) server_negotiation.cc:407] Connection header received
0808 02:30:40.959964 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:40.959968 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:40.960035 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:40.960125 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:40.961864 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.962637 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.963888 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:40.964375 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:40.964474 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:40.969213 (+ 4739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:40.969218 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:40.969222 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:40.969279 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:40.971898 (+ 2619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:40.972621 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:40.972625 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:40.972628 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:40.972752 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:40.973170 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:40.973173 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:40.973175 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:40.973476 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:40.973701 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:40.973886 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 02:30:40.974060 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
Aug 08 02:30:41 dist-test-slave-45dx krb5kdc[25839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156241, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 02:30:41 dist-test-slave-45dx krb5kdc[25839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156241, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.193@KRBTEST.COM
I20260808 02:30:41.028553 26641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:41.014173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43470 (local address 127.24.116.193:43337)
0808 02:30:41.014408 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:41.014414 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:41.014620 (+ 206us) server_negotiation.cc:407] Connection header received
0808 02:30:41.014766 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:41.014770 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:41.014877 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:41.014984 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:41.016558 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:41.017317 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:41.018520 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:41.018909 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:41.019005 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:41.023373 (+ 4368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:41.023379 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:41.023382 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:41.023417 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:41.026091 (+ 2674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:41.026725 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:41.026728 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:41.026731 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:41.026896 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:41.027224 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:41.027228 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:41.027230 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:41.027510 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:41.027703 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:41.027979 (+ 276us) server_negotiation.cc:299] Negotiation successful
0808 02:30:41.028139 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
W20260808 02:30:41.030488 26067 tablet_service.cc:2908] Rejecting scan request for tablet 13dc6dd0f2d5483ab7407d8edbf0fe2c: Uninitialized: clean time has not yet been initialized
I20260808 02:30:41.033842 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 26007
I20260808 02:30:41.046911 26641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:41.034809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43476 (local address 127.24.116.193:43337)
0808 02:30:41.034970 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:41.034974 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:41.035383 (+ 409us) server_negotiation.cc:407] Connection header received
0808 02:30:41.035512 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:41.035515 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:41.035570 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:41.035648 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:41.036850 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:41.037554 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:41.038689 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:41.039075 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:41.039165 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:41.041797 (+ 2632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:41.041802 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:41.041805 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:41.041833 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:41.044742 (+ 2909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:41.045331 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:41.045335 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:41.045337 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:41.045459 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:41.045764 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:41.045767 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:41.045768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:41.046018 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:41.046200 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:41.046470 (+ 270us) server_negotiation.cc:299] Negotiation successful
0808 02:30:41.046656 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 02:30:41.047662 26191 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:30:41.139971 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 26007
I20260808 02:30:41.166451 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 26207
Aug 08 02:30:41 dist-test-slave-45dx krb5kdc[25839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156241, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.194@KRBTEST.COM
I20260808 02:30:41.181593 26640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:41.167231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54216 (local address 127.24.116.194:35851)
0808 02:30:41.167410 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:41.167416 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:41.167466 (+ 50us) server_negotiation.cc:407] Connection header received
0808 02:30:41.167699 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:41.167703 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:41.167768 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:41.167893 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:41.169212 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:41.169961 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:41.171283 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:41.171676 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:41.171819 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:41.175906 (+ 4087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:41.175921 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:41.175938 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:41.175979 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:41.178940 (+ 2961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:41.179786 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:41.179794 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:41.179796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:41.179953 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:41.180272 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:41.180275 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:41.180277 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:41.180691 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:41.180931 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:41.181164 (+ 233us) server_negotiation.cc:299] Negotiation successful
0808 02:30:41.181326 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 02:30:41.182331 26393 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:30:41.272806 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 26207
I20260808 02:30:41.296736 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 26409
Aug 08 02:30:41 dist-test-slave-45dx krb5kdc[25839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156241, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.195@KRBTEST.COM
I20260808 02:30:41.311652 26639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:41.297545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55642 (local address 127.24.116.195:39967)
0808 02:30:41.297774 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:41.297778 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:41.297798 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:30:41.297896 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:41.297900 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:41.297975 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:41.298062 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:41.299459 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:41.300172 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:41.301540 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:41.301956 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:41.302102 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:41.306489 (+ 4387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:41.306504 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:41.306521 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:41.306555 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:41.309236 (+ 2681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:41.309839 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:41.309846 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:41.309848 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:41.309972 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:41.310286 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:41.310289 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:41.310291 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:41.310648 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:41.310864 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:41.311104 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 02:30:41.311270 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 02:30:41.312399 26598 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:30:41.400911 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 26409
I20260808 02:30:41.430138 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 25859
I20260808 02:30:41.431375 25960 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:30:41.544239 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 25859
2026-08-08T02:30:41Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4778 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:30:41 dist-test-slave-45dx krb5kdc[26686](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:30:41 dist-test-slave-45dx krb5kdc[26686](info): set up 2 sockets
Aug 08 02:30:41 dist-test-slave-45dx krb5kdc[26686](info): commencing operation
krb5kdc: starting...
W20260808 02:30:42.918617 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.295s user 0.006s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:30:43 dist-test-slave-45dx krb5kdc[26686](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156243, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:30:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:30:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:30:43.144486 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:40339
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:40867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:40339
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:30:43.479830 26705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:30:43.480168 26705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:30:43.480366 26705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:30:43.488210 26705 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:30:43.488426 26705 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 02:30:43.488515 26705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:30:43.488621 26705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:30:43.488698 26705 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:30:43.488818 26705 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:30:43.499274 26705 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:40867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:40339
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:40339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:30:43.500713 26705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:30:43.502140 26705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:30:43.515566 26710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:43.515621 26722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:43.515666 26715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:30:43.516973 26705 server_base.cc:1034] running on GCE node
I20260808 02:30:43.517838 26705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:30:43.519284 26705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:30:43.520538 26705 hybrid_clock.cc:648] HybridClock initialized: now 1786156243520480 us; error 55 us; skew 500 ppm
I20260808 02:30:43.520890 26705 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:30:43 dist-test-slave-45dx krb5kdc[26686](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156243, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:30:43.524279 26705 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:30:43.525916 26705 webserver.cc:460] Webserver started at http://127.24.116.254:38247/ using document root <none> and password file <none>
I20260808 02:30:43.526656 26705 fs_manager.cc:359] Metadata directory not provided
I20260808 02:30:43.526793 26705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:30:43.527135 26705 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:30:43.530284 26705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "a49b0ed628a94992a998839986ff736c"
format_stamp: "Formatted at 2026-08-08 02:30:43 on dist-test-slave-45dx"
server_key: "256039a4571c4bfc474d6fd27f2edf0f"
server_key_iv: "249c0a35ce5ed6c4d9e990b61dd09914"
server_key_version: "encryptionkey@0"
I20260808 02:30:43.531103 26705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "a49b0ed628a94992a998839986ff736c"
format_stamp: "Formatted at 2026-08-08 02:30:43 on dist-test-slave-45dx"
server_key: "256039a4571c4bfc474d6fd27f2edf0f"
server_key_iv: "249c0a35ce5ed6c4d9e990b61dd09914"
server_key_version: "encryptionkey@0"
I20260808 02:30:43.536504 26705 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 02:30:43.539953 26738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:43.541363 26705 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:30:43.541555 26705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "a49b0ed628a94992a998839986ff736c"
format_stamp: "Formatted at 2026-08-08 02:30:43 on dist-test-slave-45dx"
server_key: "256039a4571c4bfc474d6fd27f2edf0f"
server_key_iv: "249c0a35ce5ed6c4d9e990b61dd09914"
server_key_version: "encryptionkey@0"
I20260808 02:30:43.541811 26705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:30:43.559195 26705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:30:43.563386 26705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:30:43.563701 26705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:30:43.585937 26705 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:40339
I20260808 02:30:43.585978 26829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:40339 every 8 connection(s)
I20260808 02:30:43.587476 26705 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:30:43.591682 26833 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:43.596822 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 26705
I20260808 02:30:43.597087 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:30:43.597862 25043 external_mini_cluster.cc:1428] Setting key 0f4a138e7d3661d66d6745f85504f525
I20260808 02:30:43.605834 26833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c: Bootstrap starting.
I20260808 02:30:43.610000 26833 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:43.611480 26833 log.cc:824] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c: Log is configured to *not* fsync() on all Append() calls
I20260808 02:30:43.614452 26833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c: No bootstrap required, opened a new log
Aug 08 02:30:43 dist-test-slave-45dx krb5kdc[26686](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156243, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:30:43.623487 26839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:43.600009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32776 (local address 127.24.116.254:40339)
0808 02:30:43.600944 (+ 935us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:43.600960 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:43.601018 (+ 58us) server_negotiation.cc:407] Connection header received
0808 02:30:43.603858 (+ 2840us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:43.603890 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:43.604446 (+ 556us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:43.604914 (+ 468us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:43.606327 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:43.608625 (+ 2298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:43.609882 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:43.611082 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:43.611315 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:43.615877 (+ 4562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:43.615890 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:43.615906 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:43.615954 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:43.619226 (+ 3272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:43.620084 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:43.620094 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:43.620101 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:43.620266 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:43.620778 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:43.620781 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:43.620783 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:43.621337 (+ 554us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:43.621581 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:43.622087 (+ 506us) server_negotiation.cc:299] Negotiation successful
0808 02:30:43.622470 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":391,"threads_started":1}
I20260808 02:30:43.623644 26833 raft_consensus.cc:348] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a49b0ed628a94992a998839986ff736c" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40339 } }
I20260808 02:30:43.624109 26833 raft_consensus.cc:374] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:43.624231 26833 raft_consensus.cc:729] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a49b0ed628a94992a998839986ff736c, State: Initialized, Role: FOLLOWER
I20260808 02:30:43.624925 26833 consensus_queue.cc:260] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a49b0ed628a94992a998839986ff736c" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40339 } }
I20260808 02:30:43.625201 26833 raft_consensus.cc:388] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:30:43.625370 26833 raft_consensus.cc:482] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:30:43.625555 26833 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:43.627980 26833 raft_consensus.cc:504] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a49b0ed628a94992a998839986ff736c" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40339 } }
I20260808 02:30:43.628526 26833 leader_election.cc:302] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a49b0ed628a94992a998839986ff736c; no voters:
I20260808 02:30:43.629127 26833 leader_election.cc:288] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:30:43.629281 26841 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:30:43.630439 26841 raft_consensus.cc:686] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c [term 1 LEADER]: Becoming Leader. State: Replica: a49b0ed628a94992a998839986ff736c, State: Running, Role: LEADER
I20260808 02:30:43.630939 26841 consensus_queue.cc:237] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a49b0ed628a94992a998839986ff736c" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40339 } }
I20260808 02:30:43.631300 26833 sys_catalog.cc:564] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:30:43.633592 26843 sys_catalog.cc:455] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a49b0ed628a94992a998839986ff736c. Latest consensus state: current_term: 1 leader_uuid: "a49b0ed628a94992a998839986ff736c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a49b0ed628a94992a998839986ff736c" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40339 } } }
I20260808 02:30:43.633807 26842 sys_catalog.cc:455] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a49b0ed628a94992a998839986ff736c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a49b0ed628a94992a998839986ff736c" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40339 } } }
I20260808 02:30:43.634301 26843 sys_catalog.cc:458] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c [sys.catalog]: This master's current role is: LEADER
I20260808 02:30:43.634318 26842 sys_catalog.cc:458] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c [sys.catalog]: This master's current role is: LEADER
I20260808 02:30:43.635389 26848 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:30:43.641167 26848 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:30:43.649830 26848 catalog_manager.cc:1347] Generated new cluster ID: 2465c6491af143c5b263906f701ef38d
I20260808 02:30:43.649955 26848 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:30:43.666690 26848 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:30:43.668629 26848 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:30:43.678943 26848 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c: Generated new TSK 0
I20260808 02:30:43.680009 26848 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.116.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
I20260808 02:30:43.738672 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:40339
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:40867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:30:44.093859 26864 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:30:44.094157 26864 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:30:44.094255 26864 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:30:44.101449 26864 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:30:44.101567 26864 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:30:44.101711 26864 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 02:30:44.101857 26864 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:30:44.111931 26864 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:40867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.116.254:40339
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:30:44.113377 26864 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:30:44.114775 26864 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:30:44.128228 26874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:44.128186 26875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:44.128705 26879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:30:44.129251 26864 server_base.cc:1034] running on GCE node
I20260808 02:30:44.129824 26864 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:30:44.130731 26864 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:30:44.131968 26864 hybrid_clock.cc:648] HybridClock initialized: now 1786156244131898 us; error 45 us; skew 500 ppm
I20260808 02:30:44.132294 26864 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:30:44 dist-test-slave-45dx krb5kdc[26686](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156244, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:30:44.135609 26864 init.cc:377] Logged in from keytab as kudu/127.24.116.193@KRBTEST.COM (short username kudu)
I20260808 02:30:44.137221 26864 webserver.cc:460] Webserver started at http://127.24.116.193:33213/ using document root <none> and password file <none>
I20260808 02:30:44.137938 26864 fs_manager.cc:359] Metadata directory not provided
I20260808 02:30:44.138058 26864 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:30:44.138401 26864 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:30:44.141397 26864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "93a191165b50424eb16b91dfdbf50e6b"
format_stamp: "Formatted at 2026-08-08 02:30:44 on dist-test-slave-45dx"
server_key: "fbe24de4926dc9c08487185a566984c5"
server_key_iv: "144032605a749b43afd73d0cc38318ed"
server_key_version: "encryptionkey@0"
I20260808 02:30:44.142246 26864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "93a191165b50424eb16b91dfdbf50e6b"
format_stamp: "Formatted at 2026-08-08 02:30:44 on dist-test-slave-45dx"
server_key: "fbe24de4926dc9c08487185a566984c5"
server_key_iv: "144032605a749b43afd73d0cc38318ed"
server_key_version: "encryptionkey@0"
I20260808 02:30:44.147550 26864 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 02:30:44.151041 26889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:44.152390 26864 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:30:44.152572 26864 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "93a191165b50424eb16b91dfdbf50e6b"
format_stamp: "Formatted at 2026-08-08 02:30:44 on dist-test-slave-45dx"
server_key: "fbe24de4926dc9c08487185a566984c5"
server_key_iv: "144032605a749b43afd73d0cc38318ed"
server_key_version: "encryptionkey@0"
I20260808 02:30:44.152788 26864 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:30:44.173362 26864 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:30:44.178082 26864 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:30:44.178382 26864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:30:44.181458 26864 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:30:44.181571 26864 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:44.181800 26864 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:30:44.181919 26864 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 02:30:44 dist-test-slave-45dx krb5kdc[26686](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156244, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:30:44.206996 26901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:44.181976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:36297 (local address 127.24.116.254:40339)
0808 02:30:44.182502 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:44.182511 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:44.183767 (+ 1256us) server_negotiation.cc:407] Connection header received
0808 02:30:44.185933 (+ 2166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:44.185948 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:44.186043 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:44.186167 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:44.188558 (+ 2391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:44.189620 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:44.192433 (+ 2813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:44.193086 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:44.193236 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:44.198773 (+ 5537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:44.198781 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:44.198788 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:44.198836 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:44.202600 (+ 3764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:44.203856 (+ 1256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:44.203860 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:44.203863 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:44.204068 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:44.204897 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:44.204905 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:44.204911 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:44.205282 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:44.205474 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:44.206334 (+ 860us) server_negotiation.cc:299] Negotiation successful
0808 02:30:44.206600 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":278,"threads_started":1}
I20260808 02:30:44.208227 26905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:44.182769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40339 (local address 127.24.116.193:36297)
0808 02:30:44.183597 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:44.183649 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:44.185666 (+ 2017us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:44.186408 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:44.186416 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:44.187235 (+ 819us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:30:44.188278 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:44.188328 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:44.189824 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:44.189828 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:44.192229 (+ 2401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:44.192255 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:44.193351 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:44.193361 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:44.193593 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:44.194507 (+ 914us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:30:44.194536 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:30:44.198444 (+ 3908us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:30:44.202842 (+ 4398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:44.202858 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:44.202886 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:44.203626 (+ 740us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:44.204248 (+ 622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:44.204257 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:44.204264 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:44.204697 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:44.205455 (+ 758us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:30:44.205465 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:30:44.205902 (+ 437us) client_negotiation.cc:769] Sending connection context
0808 02:30:44.206204 (+ 302us) client_negotiation.cc:240] Negotiation successful
0808 02:30:44.206811 (+ 607us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":345,"threads_started":1}
I20260808 02:30:44.231362 26901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:44.214968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:46101 (local address 127.24.116.254:40339)
0808 02:30:44.215216 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:44.215225 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:44.215842 (+ 617us) server_negotiation.cc:407] Connection header received
0808 02:30:44.216040 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:44.216044 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:44.216112 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:44.216201 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:44.218040 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:44.218987 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:44.221786 (+ 2799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:44.222368 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:44.222516 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:44.225313 (+ 2797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:44.225318 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:44.225321 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:44.225353 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:44.227999 (+ 2646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:44.229060 (+ 1061us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:44.229065 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:44.229069 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:44.229206 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:44.229752 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:44.229756 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:44.229758 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:44.230074 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:44.230263 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:44.230822 (+ 559us) server_negotiation.cc:299] Negotiation successful
0808 02:30:44.231069 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 02:30:44.231877 27014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:44.214916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40339 (local address 127.24.116.193:46101)
0808 02:30:44.215676 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:44.215703 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:44.215894 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:44.216273 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:44.216281 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:44.217209 (+ 928us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:30:44.217832 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:44.217858 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:44.219161 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:44.219170 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:44.221593 (+ 2423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:44.221622 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:44.222585 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:44.222592 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:44.222768 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:44.223495 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:30:44.223525 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:30:44.225108 (+ 1583us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:30:44.228140 (+ 3032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:44.228148 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:44.228155 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:44.228905 (+ 750us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:44.229338 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:44.229343 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:44.229346 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:44.229575 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:44.230227 (+ 652us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:30:44.230235 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:30:44.230521 (+ 286us) client_negotiation.cc:769] Sending connection context
0808 02:30:44.230719 (+ 198us) client_negotiation.cc:240] Negotiation successful
0808 02:30:44.231185 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":375,"threads_started":1}
I20260808 02:30:44.237406 26864 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:43489
I20260808 02:30:44.237432 27071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:43489 every 8 connection(s)
I20260808 02:30:44.238636 26864 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:30:44.240640 27072 heartbeater.cc:347] Connected to a master server at 127.24.116.254:40339
I20260808 02:30:44.240880 27072 heartbeater.cc:464] Registering TS with master...
I20260808 02:30:44.241498 27072 heartbeater.cc:511] Master 127.24.116.254:40339 requested a full tablet report, sending...
I20260808 02:30:44.243466 26761 ts_manager.cc:194] Registered new tserver with Master: 93a191165b50424eb16b91dfdbf50e6b (127.24.116.193:43489)
I20260808 02:30:44.245038 26761 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.193@KRBTEST.COM'} at 127.24.116.193:36297
I20260808 02:30:44.245764 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 26864
I20260808 02:30:44.246035 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:30:44.246749 25043 external_mini_cluster.cc:1428] Setting key d1c867ceb847e3eaaead32707c43aeef
WARNING: no policy specified for kudu/127.24.116.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
I20260808 02:30:44.295837 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:40339
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:40867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:30:44.642138 27086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:30:44.642515 27086 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:30:44.642699 27086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:30:44.650328 27086 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:30:44.650492 27086 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:30:44.650651 27086 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 02:30:44.650790 27086 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:30:44.661072 27086 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:40867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.116.254:40339
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:30:44.662519 27086 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:30:44.663980 27086 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:30:44.677773 27095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:44.677775 27096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:44.677721 27098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:30:44.678871 27086 server_base.cc:1034] running on GCE node
I20260808 02:30:44.679638 27086 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:30:44.680667 27086 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:30:44.681932 27086 hybrid_clock.cc:648] HybridClock initialized: now 1786156244681859 us; error 45 us; skew 500 ppm
I20260808 02:30:44.682255 27086 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:30:44 dist-test-slave-45dx krb5kdc[26686](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156244, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:30:44.685582 27086 init.cc:377] Logged in from keytab as kudu/127.24.116.194@KRBTEST.COM (short username kudu)
I20260808 02:30:44.687258 27086 webserver.cc:460] Webserver started at http://127.24.116.194:40257/ using document root <none> and password file <none>
I20260808 02:30:44.688014 27086 fs_manager.cc:359] Metadata directory not provided
I20260808 02:30:44.688151 27086 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:30:44.688570 27086 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:30:44.691511 27086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "48fc7673d663463aadadcb904fde9587"
format_stamp: "Formatted at 2026-08-08 02:30:44 on dist-test-slave-45dx"
server_key: "71c1320f62f273af895ecfd4f6e92cdb"
server_key_iv: "2085b5329a3fb8e668bc08e8735e92a9"
server_key_version: "encryptionkey@0"
I20260808 02:30:44.692436 27086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "48fc7673d663463aadadcb904fde9587"
format_stamp: "Formatted at 2026-08-08 02:30:44 on dist-test-slave-45dx"
server_key: "71c1320f62f273af895ecfd4f6e92cdb"
server_key_iv: "2085b5329a3fb8e668bc08e8735e92a9"
server_key_version: "encryptionkey@0"
I20260808 02:30:44.697788 27086 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 02:30:44.701462 27107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:44.702847 27086 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 02:30:44.703037 27086 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "48fc7673d663463aadadcb904fde9587"
format_stamp: "Formatted at 2026-08-08 02:30:44 on dist-test-slave-45dx"
server_key: "71c1320f62f273af895ecfd4f6e92cdb"
server_key_iv: "2085b5329a3fb8e668bc08e8735e92a9"
server_key_version: "encryptionkey@0"
I20260808 02:30:44.703267 27086 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:30:44.716918 27086 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:30:44.721118 27086 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:30:44.721411 27086 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:30:44.724404 27086 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:30:44.724545 27086 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260808 02:30:44.724682 27086 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:30:44.724738 27086 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 02:30:44 dist-test-slave-45dx krb5kdc[26686](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156244, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:30:44.750362 26901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:44.724634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:46865 (local address 127.24.116.254:40339)
0808 02:30:44.724838 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:44.724844 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:44.726482 (+ 1638us) server_negotiation.cc:407] Connection header received
0808 02:30:44.728820 (+ 2338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:44.728826 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:44.728936 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:44.729049 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:44.731411 (+ 2362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:44.732752 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:44.735414 (+ 2662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:44.735883 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:44.736028 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:44.742187 (+ 6159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:44.742192 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:44.742195 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:44.742231 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:44.746455 (+ 4224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:44.747342 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:44.747351 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:44.747358 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:44.747548 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:44.748020 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:44.748028 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:44.748034 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:44.748523 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:44.748705 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:44.749754 (+ 1049us) server_negotiation.cc:299] Negotiation successful
0808 02:30:44.749992 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 02:30:44.751499 27122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:44.725354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40339 (local address 127.24.116.194:46865)
0808 02:30:44.726276 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:44.726329 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:44.728532 (+ 2203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:44.729321 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:44.729335 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:44.730202 (+ 867us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:30:44.731170 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:44.731200 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:44.732962 (+ 1762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:44.732971 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:44.735239 (+ 2268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:44.735260 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:44.736158 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:44.736166 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:44.736619 (+ 453us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:44.737605 (+ 986us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:30:44.737650 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:30:44.741898 (+ 4248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:30:44.746620 (+ 4722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:44.746628 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:44.746642 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:44.747213 (+ 571us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:44.747685 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:44.747688 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:44.747690 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:44.747906 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:44.748687 (+ 781us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:30:44.748697 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:30:44.749229 (+ 532us) client_negotiation.cc:769] Sending connection context
0808 02:30:44.749651 (+ 422us) client_negotiation.cc:240] Negotiation successful
0808 02:30:44.750253 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"thread_start_us":408,"threads_started":1}
I20260808 02:30:44.773948 27086 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:35803
I20260808 02:30:44.773962 27279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:35803 every 8 connection(s)
I20260808 02:30:44.775523 27086 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:30:44.776502 26901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:44.758171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:36939 (local address 127.24.116.254:40339)
0808 02:30:44.758387 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:44.758393 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:44.759195 (+ 802us) server_negotiation.cc:407] Connection header received
0808 02:30:44.759406 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:44.759413 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:44.759526 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:44.759637 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:44.761438 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:44.762701 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:44.765333 (+ 2632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:44.765801 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:44.765907 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:44.769222 (+ 3315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:44.769232 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:44.769239 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:44.769282 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:44.773304 (+ 4022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:44.774328 (+ 1024us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:44.774332 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:44.774335 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:44.774488 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:44.774889 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:44.774893 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:44.774895 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:44.775216 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:44.775330 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:44.775861 (+ 531us) server_negotiation.cc:299] Negotiation successful
0808 02:30:44.776033 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 02:30:44.776901 27219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:44.758263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40339 (local address 127.24.116.194:36939)
0808 02:30:44.759074 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:44.759107 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:44.759266 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:44.759716 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:44.759725 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:44.760678 (+ 953us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:30:44.761236 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:44.761257 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:44.762884 (+ 1627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:44.762892 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:44.765190 (+ 2298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:44.765205 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:44.766013 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:44.766023 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:44.766267 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:44.767216 (+ 949us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:30:44.767250 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:30:44.768930 (+ 1680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:30:44.773493 (+ 4563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:44.773499 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:44.773504 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:44.774193 (+ 689us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:44.774607 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:44.774612 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:44.774615 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:44.774778 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:44.775341 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:30:44.775346 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:30:44.775592 (+ 246us) client_negotiation.cc:769] Sending connection context
0808 02:30:44.775758 (+ 166us) client_negotiation.cc:240] Negotiation successful
0808 02:30:44.776169 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":418,"threads_started":1}
I20260808 02:30:44.778224 27281 heartbeater.cc:347] Connected to a master server at 127.24.116.254:40339
I20260808 02:30:44.778509 27281 heartbeater.cc:464] Registering TS with master...
I20260808 02:30:44.778970 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 27086
I20260808 02:30:44.779181 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:30:44.779394 27281 heartbeater.cc:511] Master 127.24.116.254:40339 requested a full tablet report, sending...
I20260808 02:30:44.779748 25043 external_mini_cluster.cc:1428] Setting key 5beb182548d85985a374e5fedcc306f1
I20260808 02:30:44.780973 26761 ts_manager.cc:194] Registered new tserver with Master: 48fc7673d663463aadadcb904fde9587 (127.24.116.194:35803)
I20260808 02:30:44.782162 26761 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.194@KRBTEST.COM'} at 127.24.116.194:46865
WARNING: no policy specified for kudu/127.24.116.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
I20260808 02:30:44.828083 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:40339
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:40867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:30:45.174747 27287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:30:45.175108 27287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:30:45.175287 27287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:30:45.182957 27287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:30:45.183151 27287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:30:45.183310 27287 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 02:30:45.183454 27287 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:30:45.194541 27287 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:40867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.116.254:40339
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:30:45.195957 27287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:30:45.197427 27287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:30:45.211634 27297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:45.211800 27294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:45.211786 27299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:30:45.212855 27287 server_base.cc:1034] running on GCE node
I20260808 02:30:45.213630 27287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:30:45.214658 27287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:30:45.215942 27287 hybrid_clock.cc:648] HybridClock initialized: now 1786156245215862 us; error 57 us; skew 500 ppm
I20260808 02:30:45.216265 27287 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:30:45 dist-test-slave-45dx krb5kdc[26686](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156245, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:30:45.225485 27287 init.cc:377] Logged in from keytab as kudu/127.24.116.195@KRBTEST.COM (short username kudu)
I20260808 02:30:45.227011 27287 webserver.cc:460] Webserver started at http://127.24.116.195:37725/ using document root <none> and password file <none>
I20260808 02:30:45.227727 27287 fs_manager.cc:359] Metadata directory not provided
I20260808 02:30:45.227818 27287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:30:45.228106 27287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:30:45.231174 27287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "ec79b9b87a96405083d8c317d502267d"
format_stamp: "Formatted at 2026-08-08 02:30:45 on dist-test-slave-45dx"
server_key: "56df57e73496ab31b0862cb9b3987b5d"
server_key_iv: "86def12cb7df35152ee5726ff4b676d1"
server_key_version: "encryptionkey@0"
I20260808 02:30:45.232023 27287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "ec79b9b87a96405083d8c317d502267d"
format_stamp: "Formatted at 2026-08-08 02:30:45 on dist-test-slave-45dx"
server_key: "56df57e73496ab31b0862cb9b3987b5d"
server_key_iv: "86def12cb7df35152ee5726ff4b676d1"
server_key_version: "encryptionkey@0"
I20260808 02:30:45.237870 27287 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 02:30:45.242520 27313 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:45.243997 27287 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 02:30:45.244182 27287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "ec79b9b87a96405083d8c317d502267d"
format_stamp: "Formatted at 2026-08-08 02:30:45 on dist-test-slave-45dx"
server_key: "56df57e73496ab31b0862cb9b3987b5d"
server_key_iv: "86def12cb7df35152ee5726ff4b676d1"
server_key_version: "encryptionkey@0"
I20260808 02:30:45.244480 27287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:30:45.247954 27072 heartbeater.cc:503] Master 127.24.116.254:40339 was elected leader, sending a full tablet report...
I20260808 02:30:45.275417 27287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:30:45.279902 27287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:30:45.280200 27287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:30:45.283051 27287 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:30:45.283167 27287 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:45.283341 27287 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:30:45.283425 27287 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 02:30:45 dist-test-slave-45dx krb5kdc[26686](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156245, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:30:45.308923 27329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:45.283725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:34511 (local address 127.24.116.254:40339)
0808 02:30:45.285161 (+ 1436us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:45.285169 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:45.285843 (+ 674us) server_negotiation.cc:407] Connection header received
0808 02:30:45.287969 (+ 2126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:45.287975 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:45.288067 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:45.288203 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:45.290643 (+ 2440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.291785 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.294549 (+ 2764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.295144 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.295289 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:45.301006 (+ 5717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:45.301016 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:45.301023 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:45.301077 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:45.304989 (+ 3912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:45.306146 (+ 1157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:45.306154 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:45.306160 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:45.306327 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:45.306837 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:45.306842 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:45.306845 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:45.307156 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:45.307338 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:45.308229 (+ 891us) server_negotiation.cc:299] Negotiation successful
0808 02:30:45.308513 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1308,"thread_start_us":1200,"threads_started":1}
I20260808 02:30:45.310222 27330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:45.284515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40339 (local address 127.24.116.195:34511)
0808 02:30:45.285660 (+ 1145us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:45.285709 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:45.287664 (+ 1955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:45.288501 (+ 837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:45.288510 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:45.289309 (+ 799us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:30:45.290370 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:45.290417 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.291965 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.291972 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:45.294344 (+ 2372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:45.294387 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.295439 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.295454 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:45.295816 (+ 362us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:45.296885 (+ 1069us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:30:45.296910 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:30:45.300682 (+ 3772us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:30:45.305157 (+ 4475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:45.305167 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:45.305188 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:45.305935 (+ 747us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:45.306460 (+ 525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:45.306465 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:45.306469 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:45.306703 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:45.307338 (+ 635us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:30:45.307348 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:30:45.307809 (+ 461us) client_negotiation.cc:769] Sending connection context
0808 02:30:45.308106 (+ 297us) client_negotiation.cc:240] Negotiation successful
0808 02:30:45.308752 (+ 646us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":823,"thread_start_us":532,"threads_started":1}
I20260808 02:30:45.339910 27287 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:36909
I20260808 02:30:45.339949 27499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:36909 every 8 connection(s)
I20260808 02:30:45.341492 27287 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:30:45.344192 27500 heartbeater.cc:347] Connected to a master server at 127.24.116.254:40339
I20260808 02:30:45.344529 27500 heartbeater.cc:464] Registering TS with master...
I20260808 02:30:45.345446 27500 heartbeater.cc:511] Master 127.24.116.254:40339 requested a full tablet report, sending...
I20260808 02:30:45.346980 26761 ts_manager.cc:194] Registered new tserver with Master: ec79b9b87a96405083d8c317d502267d (127.24.116.195:36909)
I20260808 02:30:45.347267 27329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:45.330251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:33069 (local address 127.24.116.254:40339)
0808 02:30:45.330609 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:45.330614 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:45.331231 (+ 617us) server_negotiation.cc:407] Connection header received
0808 02:30:45.331531 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:45.331539 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:45.331622 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:45.331711 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:45.333362 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.334114 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.336786 (+ 2672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.337428 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.337540 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:45.340457 (+ 2917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:45.340463 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:45.340467 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:45.340505 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:45.344038 (+ 3533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:45.344934 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:45.344942 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:45.344948 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:45.345131 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:45.345650 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:45.345654 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:45.345656 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:45.345978 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:45.346149 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:45.346584 (+ 435us) server_negotiation.cc:299] Negotiation successful
0808 02:30:45.346841 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241}
I20260808 02:30:45.347316 27490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:45.330230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40339 (local address 127.24.116.195:33069)
0808 02:30:45.331082 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:45.331111 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:45.331323 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:45.331785 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:45.331792 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:45.332623 (+ 831us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:30:45.333159 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:45.333178 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.334314 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.334323 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:45.336485 (+ 2162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:45.336513 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.337645 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.337652 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:45.337847 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:45.338639 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:30:45.338668 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:30:45.340132 (+ 1464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:30:45.344231 (+ 4099us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:45.344235 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:45.344238 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:45.344792 (+ 554us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:45.345257 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:45.345261 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:45.345263 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:45.345476 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:45.346131 (+ 655us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:30:45.346136 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:30:45.346327 (+ 191us) client_negotiation.cc:769] Sending connection context
0808 02:30:45.346470 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 02:30:45.346846 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":387,"threads_started":1}
I20260808 02:30:45.348093 26761 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.195@KRBTEST.COM'} at 127.24.116.195:34511
I20260808 02:30:45.351084 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 27287
I20260808 02:30:45.351354 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:30:45.351868 25043 external_mini_cluster.cc:1428] Setting key 7cf57dcd1ebc811b9aac069399b25177
I20260808 02:30:45.354972 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 02:30:45 dist-test-slave-45dx krb5kdc[26686](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156245, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 02:30:45 dist-test-slave-45dx krb5kdc[26686](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156245, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:30:45.411230 27329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:45.395107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32788 (local address 127.24.116.254:40339)
0808 02:30:45.395310 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:45.395315 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:45.395820 (+ 505us) server_negotiation.cc:407] Connection header received
0808 02:30:45.396015 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:45.396021 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:45.396092 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:45.396193 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:45.397871 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.398656 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.400254 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.400761 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.400866 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:45.405345 (+ 4479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:45.405350 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:45.405353 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:45.405395 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:45.408223 (+ 2828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:45.408967 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:45.408973 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:45.408977 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:45.409132 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:45.409561 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:45.409564 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:45.409567 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:45.409858 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:45.410158 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:45.410565 (+ 407us) server_negotiation.cc:299] Negotiation successful
0808 02:30:45.410807 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 02:30:45.416476 26759 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:32788:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:30:45.424618 26759 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:30:45.450716 27522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:45.438722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49548 (local address 127.24.116.193:43489)
0808 02:30:45.439323 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:45.439330 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:45.440028 (+ 698us) server_negotiation.cc:407] Connection header received
0808 02:30:45.440380 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:45.440395 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:45.440723 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:45.440956 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:30:45.442000 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.443655 (+ 1655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.447671 (+ 4016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.449190 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.449374 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:45.449580 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:45.450239 (+ 659us) server_negotiation.cc:299] Negotiation successful
0808 02:30:45.450427 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":293,"threads_started":1}
I20260808 02:30:45.451771 27525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:45.440901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34932 (local address 127.24.116.195:36909)
0808 02:30:45.443089 (+ 2188us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:45.443098 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:45.443133 (+ 35us) server_negotiation.cc:407] Connection header received
0808 02:30:45.443226 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:45.443234 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:45.443482 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:45.443703 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:30:45.444827 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.446662 (+ 1835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.449005 (+ 2343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.450581 (+ 1576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.450784 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:45.451130 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:45.451220 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 02:30:45.451399 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2006,"thread_start_us":1815,"threads_started":1}
I20260808 02:30:45.451807 27524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:45.440424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:36909 (local address 127.0.0.1:34932)
0808 02:30:45.441015 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:45.441037 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:45.441153 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:45.443717 (+ 2564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:45.443724 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:45.443764 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:30:45.444581 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:45.444597 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.446792 (+ 2195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.446801 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:45.448826 (+ 2025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:45.448842 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.450800 (+ 1958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.450807 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:45.450992 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:45.451027 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 02:30:45.451103 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 02:30:45.451361 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"mutex_wait_us":112,"thread_start_us":310,"threads_started":1}
I20260808 02:30:45.452425 27528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:45.441860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:35803 (local address 127.0.0.1:38464)
0808 02:30:45.444467 (+ 2607us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:45.444491 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:45.444643 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:45.445523 (+ 880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:45.445529 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:45.445553 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:30:45.446058 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:45.446071 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.447794 (+ 1723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.447801 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:45.449668 (+ 1867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:45.449683 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.451536 (+ 1853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.451542 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:45.451714 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:45.451760 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 02:30:45.451903 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 02:30:45.452034 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2408,"thread_start_us":2233,"threads_started":1}
I20260808 02:30:45.452708 27527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:45.441436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38464 (local address 127.24.116.194:35803)
0808 02:30:45.444452 (+ 3016us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:45.444460 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:45.444600 (+ 140us) server_negotiation.cc:407] Connection header received
0808 02:30:45.444861 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:45.444869 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:45.445101 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:45.445288 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:30:45.446260 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.447655 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.449851 (+ 2196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.451339 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.451505 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:45.451659 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:45.452230 (+ 571us) server_negotiation.cc:299] Negotiation successful
0808 02:30:45.452439 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2816,"thread_start_us":2828,"threads_started":1}
I20260808 02:30:45.453426 27520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:45.438535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:43489 (local address 127.0.0.1:49548)
0808 02:30:45.439857 (+ 1322us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:45.439907 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:45.440108 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:45.441236 (+ 1128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:45.441243 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:45.441270 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:30:45.441753 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:45.441769 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.443825 (+ 2056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.443832 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:45.447483 (+ 3651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:45.447497 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.449724 (+ 2227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.449731 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:45.449956 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:45.450012 (+ 56us) client_negotiation.cc:769] Sending connection context
0808 02:30:45.451056 (+ 1044us) client_negotiation.cc:240] Negotiation successful
0808 02:30:45.451355 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1075,"mutex_wait_us":680,"thread_start_us":917,"threads_started":1}
I20260808 02:30:45.456229 27186 tablet_service.cc:1467] Processing CreateTablet for tablet 3a616433d44f457bacead4621144d598 (DEFAULT_TABLE table=test-table [id=c3c3abe362974c4991dce32b49c568ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:30:45.456292 27396 tablet_service.cc:1467] Processing CreateTablet for tablet 3a616433d44f457bacead4621144d598 (DEFAULT_TABLE table=test-table [id=c3c3abe362974c4991dce32b49c568ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:30:45.456914 26971 tablet_service.cc:1467] Processing CreateTablet for tablet 3a616433d44f457bacead4621144d598 (DEFAULT_TABLE table=test-table [id=c3c3abe362974c4991dce32b49c568ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:30:45.457744 27186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a616433d44f457bacead4621144d598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:45.457844 27396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a616433d44f457bacead4621144d598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:45.458204 26971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a616433d44f457bacead4621144d598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:45.470342 27529 tablet_bootstrap.cc:492] T 3a616433d44f457bacead4621144d598 P 48fc7673d663463aadadcb904fde9587: Bootstrap starting.
I20260808 02:30:45.474782 27529 tablet_bootstrap.cc:654] T 3a616433d44f457bacead4621144d598 P 48fc7673d663463aadadcb904fde9587: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:45.474882 27531 tablet_bootstrap.cc:492] T 3a616433d44f457bacead4621144d598 P ec79b9b87a96405083d8c317d502267d: Bootstrap starting.
I20260808 02:30:45.476348 27529 log.cc:824] T 3a616433d44f457bacead4621144d598 P 48fc7673d663463aadadcb904fde9587: Log is configured to *not* fsync() on all Append() calls
I20260808 02:30:45.477072 27530 tablet_bootstrap.cc:492] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b: Bootstrap starting.
I20260808 02:30:45.478814 27531 tablet_bootstrap.cc:654] T 3a616433d44f457bacead4621144d598 P ec79b9b87a96405083d8c317d502267d: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:45.480041 27531 log.cc:824] T 3a616433d44f457bacead4621144d598 P ec79b9b87a96405083d8c317d502267d: Log is configured to *not* fsync() on all Append() calls
I20260808 02:30:45.480587 27530 tablet_bootstrap.cc:654] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:45.481525 27529 tablet_bootstrap.cc:492] T 3a616433d44f457bacead4621144d598 P 48fc7673d663463aadadcb904fde9587: No bootstrap required, opened a new log
I20260808 02:30:45.481868 27529 ts_tablet_manager.cc:1397] T 3a616433d44f457bacead4621144d598 P 48fc7673d663463aadadcb904fde9587: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.007s
I20260808 02:30:45.482154 27530 log.cc:824] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b: Log is configured to *not* fsync() on all Append() calls
I20260808 02:30:45.483675 27531 tablet_bootstrap.cc:492] T 3a616433d44f457bacead4621144d598 P ec79b9b87a96405083d8c317d502267d: No bootstrap required, opened a new log
I20260808 02:30:45.483978 27531 ts_tablet_manager.cc:1397] T 3a616433d44f457bacead4621144d598 P ec79b9b87a96405083d8c317d502267d: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 02:30:45.484804 27530 tablet_bootstrap.cc:492] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b: No bootstrap required, opened a new log
I20260808 02:30:45.485066 27530 ts_tablet_manager.cc:1397] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260808 02:30:45.493568 27530 raft_consensus.cc:348] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } }
I20260808 02:30:45.494002 27530 raft_consensus.cc:374] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:45.494110 27530 raft_consensus.cc:729] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a191165b50424eb16b91dfdbf50e6b, State: Initialized, Role: FOLLOWER
I20260808 02:30:45.493983 27529 raft_consensus.cc:348] T 3a616433d44f457bacead4621144d598 P 48fc7673d663463aadadcb904fde9587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } }
I20260808 02:30:45.494449 27529 raft_consensus.cc:374] T 3a616433d44f457bacead4621144d598 P 48fc7673d663463aadadcb904fde9587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:45.494561 27529 raft_consensus.cc:729] T 3a616433d44f457bacead4621144d598 P 48fc7673d663463aadadcb904fde9587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48fc7673d663463aadadcb904fde9587, State: Initialized, Role: FOLLOWER
I20260808 02:30:45.494999 27530 consensus_queue.cc:260] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } }
I20260808 02:30:45.495172 27529 consensus_queue.cc:260] T 3a616433d44f457bacead4621144d598 P 48fc7673d663463aadadcb904fde9587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } }
I20260808 02:30:45.496150 27531 raft_consensus.cc:348] T 3a616433d44f457bacead4621144d598 P ec79b9b87a96405083d8c317d502267d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } }
I20260808 02:30:45.496603 27531 raft_consensus.cc:374] T 3a616433d44f457bacead4621144d598 P ec79b9b87a96405083d8c317d502267d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:45.496754 27531 raft_consensus.cc:729] T 3a616433d44f457bacead4621144d598 P ec79b9b87a96405083d8c317d502267d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec79b9b87a96405083d8c317d502267d, State: Initialized, Role: FOLLOWER
I20260808 02:30:45.496899 27281 heartbeater.cc:503] Master 127.24.116.254:40339 was elected leader, sending a full tablet report...
I20260808 02:30:45.497452 27529 ts_tablet_manager.cc:1428] T 3a616433d44f457bacead4621144d598 P 48fc7673d663463aadadcb904fde9587: Time spent starting tablet: real 0.015s user 0.007s sys 0.009s
I20260808 02:30:45.497481 27531 consensus_queue.cc:260] T 3a616433d44f457bacead4621144d598 P ec79b9b87a96405083d8c317d502267d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } }
I20260808 02:30:45.498624 27500 heartbeater.cc:503] Master 127.24.116.254:40339 was elected leader, sending a full tablet report...
I20260808 02:30:45.499912 27531 ts_tablet_manager.cc:1428] T 3a616433d44f457bacead4621144d598 P ec79b9b87a96405083d8c317d502267d: Time spent starting tablet: real 0.016s user 0.005s sys 0.012s
I20260808 02:30:45.501237 27530 ts_tablet_manager.cc:1428] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b: Time spent starting tablet: real 0.016s user 0.010s sys 0.004s
W20260808 02:30:45.529484 27282 tablet.cc:2369] T 3a616433d44f457bacead4621144d598 P 48fc7673d663463aadadcb904fde9587: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:30:45.593493 27501 tablet.cc:2369] T 3a616433d44f457bacead4621144d598 P ec79b9b87a96405083d8c317d502267d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:30:45.701713 27537 raft_consensus.cc:482] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:30:45.702126 27537 raft_consensus.cc:504] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } }
I20260808 02:30:45.704037 27537 leader_election.cc:288] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec79b9b87a96405083d8c317d502267d (127.24.116.195:36909), 48fc7673d663463aadadcb904fde9587 (127.24.116.194:35803)
I20260808 02:30:45.712045 27525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:45.704507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:50445 (local address 127.24.116.195:36909)
0808 02:30:45.704701 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:45.704705 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:45.705370 (+ 665us) server_negotiation.cc:407] Connection header received
0808 02:30:45.705628 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:45.705634 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:45.705719 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:45.705829 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:30:45.706809 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.707817 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.709980 (+ 2163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.710880 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.711144 (+ 264us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:45.711231 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:45.711541 (+ 310us) server_negotiation.cc:299] Negotiation successful
0808 02:30:45.711684 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 02:30:45.712237 27541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:45.704405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:36909 (local address 127.24.116.193:50445)
0808 02:30:45.705244 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:45.705267 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:45.705430 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:45.705980 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:45.705989 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:45.706020 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:30:45.706545 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:45.706560 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.707947 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.707954 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:45.709807 (+ 1853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:45.709820 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.711153 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.711160 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:45.711353 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:45.711381 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 02:30:45.711499 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 02:30:45.711660 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":682,"mutex_wait_us":25,"thread_start_us":473,"threads_started":1}
I20260808 02:30:45.712625 27527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:45.705635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:32789 (local address 127.24.116.194:35803)
0808 02:30:45.705846 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:45.705852 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:45.706395 (+ 543us) server_negotiation.cc:407] Connection header received
0808 02:30:45.706575 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:45.706580 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:45.706670 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:45.706763 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:30:45.707440 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.708236 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.710132 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.711093 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.711271 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:45.711362 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:45.711941 (+ 579us) server_negotiation.cc:299] Negotiation successful
0808 02:30:45.712134 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 02:30:45.712823 27542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:45.705375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:35803 (local address 127.24.116.193:32789)
0808 02:30:45.706271 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:45.706287 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:45.706399 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:45.706808 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:45.706815 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:45.706838 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:30:45.707255 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:45.707270 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.708400 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.708407 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:45.709969 (+ 1562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:45.709982 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.711611 (+ 1629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.711616 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:45.711744 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:45.711769 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 02:30:45.711911 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 02:30:45.712043 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":744,"mutex_wait_us":38,"thread_start_us":533,"threads_started":1}
I20260808 02:30:45.713518 27426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a616433d44f457bacead4621144d598" candidate_uuid: "93a191165b50424eb16b91dfdbf50e6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec79b9b87a96405083d8c317d502267d" is_pre_election: true
I20260808 02:30:45.713989 27218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a616433d44f457bacead4621144d598" candidate_uuid: "93a191165b50424eb16b91dfdbf50e6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fc7673d663463aadadcb904fde9587" is_pre_election: true
I20260808 02:30:45.714170 27426 raft_consensus.cc:2454] T 3a616433d44f457bacead4621144d598 P ec79b9b87a96405083d8c317d502267d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93a191165b50424eb16b91dfdbf50e6b in term 0.
I20260808 02:30:45.714494 27218 raft_consensus.cc:2454] T 3a616433d44f457bacead4621144d598 P 48fc7673d663463aadadcb904fde9587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93a191165b50424eb16b91dfdbf50e6b in term 0.
I20260808 02:30:45.714983 26895 leader_election.cc:302] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a191165b50424eb16b91dfdbf50e6b, ec79b9b87a96405083d8c317d502267d; no voters:
I20260808 02:30:45.715497 27537 raft_consensus.cc:2781] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:30:45.715713 27537 raft_consensus.cc:482] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:30:45.715847 27537 raft_consensus.cc:3037] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:45.718308 27537 raft_consensus.cc:504] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } }
I20260808 02:30:45.718941 27537 leader_election.cc:288] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b [CANDIDATE]: Term 1 election: Requested vote from peers ec79b9b87a96405083d8c317d502267d (127.24.116.195:36909), 48fc7673d663463aadadcb904fde9587 (127.24.116.194:35803)
I20260808 02:30:45.719476 27426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a616433d44f457bacead4621144d598" candidate_uuid: "93a191165b50424eb16b91dfdbf50e6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec79b9b87a96405083d8c317d502267d"
I20260808 02:30:45.719671 27218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a616433d44f457bacead4621144d598" candidate_uuid: "93a191165b50424eb16b91dfdbf50e6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fc7673d663463aadadcb904fde9587"
I20260808 02:30:45.719761 27426 raft_consensus.cc:3037] T 3a616433d44f457bacead4621144d598 P ec79b9b87a96405083d8c317d502267d [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:45.719915 27218 raft_consensus.cc:3037] T 3a616433d44f457bacead4621144d598 P 48fc7673d663463aadadcb904fde9587 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:45.723441 27218 raft_consensus.cc:2454] T 3a616433d44f457bacead4621144d598 P 48fc7673d663463aadadcb904fde9587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a191165b50424eb16b91dfdbf50e6b in term 1.
I20260808 02:30:45.723440 27426 raft_consensus.cc:2454] T 3a616433d44f457bacead4621144d598 P ec79b9b87a96405083d8c317d502267d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a191165b50424eb16b91dfdbf50e6b in term 1.
I20260808 02:30:45.723966 26895 leader_election.cc:302] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a191165b50424eb16b91dfdbf50e6b, ec79b9b87a96405083d8c317d502267d; no voters:
I20260808 02:30:45.724278 27537 raft_consensus.cc:2781] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:30:45.724997 27537 raft_consensus.cc:686] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b [term 1 LEADER]: Becoming Leader. State: Replica: 93a191165b50424eb16b91dfdbf50e6b, State: Running, Role: LEADER
I20260808 02:30:45.725554 27537 consensus_queue.cc:237] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } }
I20260808 02:30:45.730628 26761 catalog_manager.cc:5495] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b reported cstate change: term changed from 0 to 1, leader changed from <none> to 93a191165b50424eb16b91dfdbf50e6b (127.24.116.193). New cstate: current_term: 1 leader_uuid: "93a191165b50424eb16b91dfdbf50e6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } health_report { overall_health: UNKNOWN } } }
W20260808 02:30:45.741370 27073 tablet.cc:2369] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:30:45.755822 27522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:45.749485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49550 (local address 127.24.116.193:43489)
0808 02:30:45.749697 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:45.749705 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:45.749725 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:30:45.750092 (+ 367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:45.750100 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:45.750207 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:45.750357 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:30:45.750735 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.751515 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.753561 (+ 2046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.753978 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.754115 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:45.754653 (+ 538us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:30:45.755182 (+ 529us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:30:45.755342 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:45.755451 (+ 109us) server_negotiation.cc:299] Negotiation successful
0808 02:30:45.755539 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 02:30:45.765169 27218 raft_consensus.cc:1261] T 3a616433d44f457bacead4621144d598 P 48fc7673d663463aadadcb904fde9587 [term 1 FOLLOWER]: Refusing update from remote peer 93a191165b50424eb16b91dfdbf50e6b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:30:45.765169 27426 raft_consensus.cc:1261] T 3a616433d44f457bacead4621144d598 P ec79b9b87a96405083d8c317d502267d [term 1 FOLLOWER]: Refusing update from remote peer 93a191165b50424eb16b91dfdbf50e6b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:30:45.766278 27543 consensus_queue.cc:1035] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:30:45.766680 27537 consensus_queue.cc:1035] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:30:45.781950 27548 mvcc.cc:205] Tried to move back new op lower bound from 7316095982642216960 to 7316095982495780864. Current Snapshot: MvccSnapshot[applied={T|T < 7316095982642216960}]
I20260808 02:30:45.814941 26757 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:32788:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:30:45.815209 26757 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:32788:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:30:45.819531 26757 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c: Sending DeleteTablet for 3 replicas of tablet 3a616433d44f457bacead4621144d598
I20260808 02:30:45.820726 26971 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a616433d44f457bacead4621144d598 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:30:45 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:49548
I20260808 02:30:45.820994 27396 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a616433d44f457bacead4621144d598 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:30:45 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:34932
I20260808 02:30:45.822235 27186 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a616433d44f457bacead4621144d598 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:30:45 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:38464
I20260808 02:30:45.823346 26761 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:32788:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:30:45.824059 26761 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:30:45.830991 27569 tablet_replica.cc:330] T 3a616433d44f457bacead4621144d598 P 48fc7673d663463aadadcb904fde9587: stopping tablet replica
I20260808 02:30:45.831050 27567 tablet_replica.cc:330] T 3a616433d44f457bacead4621144d598 P ec79b9b87a96405083d8c317d502267d: stopping tablet replica
I20260808 02:30:45.831497 27567 raft_consensus.cc:2229] T 3a616433d44f457bacead4621144d598 P ec79b9b87a96405083d8c317d502267d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:30:45.831498 27569 raft_consensus.cc:2229] T 3a616433d44f457bacead4621144d598 P 48fc7673d663463aadadcb904fde9587 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:30:45.832166 27567 raft_consensus.cc:2258] T 3a616433d44f457bacead4621144d598 P ec79b9b87a96405083d8c317d502267d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:30:45.832269 27569 raft_consensus.cc:2258] T 3a616433d44f457bacead4621144d598 P 48fc7673d663463aadadcb904fde9587 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:30:45.833340 27186 tablet_service.cc:1467] Processing CreateTablet for tablet 3504bbd55b30485187d4866131847eac (DEFAULT_TABLE table=test-table [id=a5249a1358b3403db77773d52c06aa1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:30:45.834044 27186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3504bbd55b30485187d4866131847eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:45.834031 26970 tablet_service.cc:1467] Processing CreateTablet for tablet 3504bbd55b30485187d4866131847eac (DEFAULT_TABLE table=test-table [id=a5249a1358b3403db77773d52c06aa1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:30:45.834571 27396 tablet_service.cc:1467] Processing CreateTablet for tablet 3504bbd55b30485187d4866131847eac (DEFAULT_TABLE table=test-table [id=a5249a1358b3403db77773d52c06aa1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:30:45.834919 26970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3504bbd55b30485187d4866131847eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:45.835253 27396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3504bbd55b30485187d4866131847eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:45.841032 27564 tablet_replica.cc:330] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b: stopping tablet replica
I20260808 02:30:45.841537 27564 raft_consensus.cc:2229] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:30:45.842293 27569 ts_tablet_manager.cc:1905] T 3a616433d44f457bacead4621144d598 P 48fc7673d663463aadadcb904fde9587: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:30:45.842338 27564 raft_consensus.cc:2258] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:30:45.843832 27530 tablet_bootstrap.cc:492] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b: Bootstrap starting.
I20260808 02:30:45.845093 27531 tablet_bootstrap.cc:492] T 3504bbd55b30485187d4866131847eac P ec79b9b87a96405083d8c317d502267d: Bootstrap starting.
I20260808 02:30:45.846274 27530 tablet_bootstrap.cc:654] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:45.847268 27531 tablet_bootstrap.cc:654] T 3504bbd55b30485187d4866131847eac P ec79b9b87a96405083d8c317d502267d: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:45.849704 27567 ts_tablet_manager.cc:1905] T 3a616433d44f457bacead4621144d598 P ec79b9b87a96405083d8c317d502267d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:30:45.851155 27564 ts_tablet_manager.cc:1905] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:30:45.854216 27529 tablet_bootstrap.cc:492] T 3504bbd55b30485187d4866131847eac P 48fc7673d663463aadadcb904fde9587: Bootstrap starting.
I20260808 02:30:45.856719 27529 tablet_bootstrap.cc:654] T 3504bbd55b30485187d4866131847eac P 48fc7673d663463aadadcb904fde9587: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:45.861150 27530 tablet_bootstrap.cc:492] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b: No bootstrap required, opened a new log
I20260808 02:30:45.861347 27530 ts_tablet_manager.cc:1397] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.008s
I20260808 02:30:45.861524 27567 ts_tablet_manager.cc:1918] T 3a616433d44f457bacead4621144d598 P ec79b9b87a96405083d8c317d502267d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:30:45.861822 27567 log.cc:1196] T 3a616433d44f457bacead4621144d598 P ec79b9b87a96405083d8c317d502267d: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/3a616433d44f457bacead4621144d598
I20260808 02:30:45.862501 27567 ts_tablet_manager.cc:1939] T 3a616433d44f457bacead4621144d598 P ec79b9b87a96405083d8c317d502267d: Deleting consensus metadata
I20260808 02:30:45.862380 27530 raft_consensus.cc:348] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } }
I20260808 02:30:45.862654 27530 raft_consensus.cc:374] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:45.862780 27530 raft_consensus.cc:729] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a191165b50424eb16b91dfdbf50e6b, State: Initialized, Role: FOLLOWER
I20260808 02:30:45.863140 27530 consensus_queue.cc:260] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } }
I20260808 02:30:45.864837 27530 ts_tablet_manager.cc:1428] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260808 02:30:45.867262 26741 catalog_manager.cc:4841] TS ec79b9b87a96405083d8c317d502267d (127.24.116.195:36909): tablet 3a616433d44f457bacead4621144d598 (table test-table [id=c3c3abe362974c4991dce32b49c568ef]) successfully deleted
I20260808 02:30:45.868490 27569 ts_tablet_manager.cc:1918] T 3a616433d44f457bacead4621144d598 P 48fc7673d663463aadadcb904fde9587: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:30:45.868811 27569 log.cc:1196] T 3a616433d44f457bacead4621144d598 P 48fc7673d663463aadadcb904fde9587: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/3a616433d44f457bacead4621144d598
I20260808 02:30:45.869735 27569 ts_tablet_manager.cc:1939] T 3a616433d44f457bacead4621144d598 P 48fc7673d663463aadadcb904fde9587: Deleting consensus metadata
I20260808 02:30:45.871255 27531 tablet_bootstrap.cc:492] T 3504bbd55b30485187d4866131847eac P ec79b9b87a96405083d8c317d502267d: No bootstrap required, opened a new log
I20260808 02:30:45.871475 27531 ts_tablet_manager.cc:1397] T 3504bbd55b30485187d4866131847eac P ec79b9b87a96405083d8c317d502267d: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.005s
I20260808 02:30:45.872362 26741 catalog_manager.cc:4841] TS 48fc7673d663463aadadcb904fde9587 (127.24.116.194:35803): tablet 3a616433d44f457bacead4621144d598 (table test-table [id=c3c3abe362974c4991dce32b49c568ef]) successfully deleted
I20260808 02:30:45.873845 27531 raft_consensus.cc:348] T 3504bbd55b30485187d4866131847eac P ec79b9b87a96405083d8c317d502267d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } }
I20260808 02:30:45.874071 27529 tablet_bootstrap.cc:492] T 3504bbd55b30485187d4866131847eac P 48fc7673d663463aadadcb904fde9587: No bootstrap required, opened a new log
I20260808 02:30:45.874189 27531 raft_consensus.cc:374] T 3504bbd55b30485187d4866131847eac P ec79b9b87a96405083d8c317d502267d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:45.874228 27529 ts_tablet_manager.cc:1397] T 3504bbd55b30485187d4866131847eac P 48fc7673d663463aadadcb904fde9587: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.005s
I20260808 02:30:45.874430 27531 raft_consensus.cc:729] T 3504bbd55b30485187d4866131847eac P ec79b9b87a96405083d8c317d502267d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec79b9b87a96405083d8c317d502267d, State: Initialized, Role: FOLLOWER
I20260808 02:30:45.874835 27531 consensus_queue.cc:260] T 3504bbd55b30485187d4866131847eac P ec79b9b87a96405083d8c317d502267d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } }
I20260808 02:30:45.875116 27564 ts_tablet_manager.cc:1918] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:30:45.875105 27529 raft_consensus.cc:348] T 3504bbd55b30485187d4866131847eac P 48fc7673d663463aadadcb904fde9587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } }
I20260808 02:30:45.875319 27529 raft_consensus.cc:374] T 3504bbd55b30485187d4866131847eac P 48fc7673d663463aadadcb904fde9587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:45.875385 27564 log.cc:1196] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/3a616433d44f457bacead4621144d598
I20260808 02:30:45.875437 27529 raft_consensus.cc:729] T 3504bbd55b30485187d4866131847eac P 48fc7673d663463aadadcb904fde9587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48fc7673d663463aadadcb904fde9587, State: Initialized, Role: FOLLOWER
I20260808 02:30:45.875963 27531 ts_tablet_manager.cc:1428] T 3504bbd55b30485187d4866131847eac P ec79b9b87a96405083d8c317d502267d: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260808 02:30:45.875860 27529 consensus_queue.cc:260] T 3504bbd55b30485187d4866131847eac P 48fc7673d663463aadadcb904fde9587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } }
I20260808 02:30:45.876073 27564 ts_tablet_manager.cc:1939] T 3a616433d44f457bacead4621144d598 P 93a191165b50424eb16b91dfdbf50e6b: Deleting consensus metadata
I20260808 02:30:45.877064 27529 ts_tablet_manager.cc:1428] T 3504bbd55b30485187d4866131847eac P 48fc7673d663463aadadcb904fde9587: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260808 02:30:45.878307 26741 catalog_manager.cc:4841] TS 93a191165b50424eb16b91dfdbf50e6b (127.24.116.193:43489): tablet 3a616433d44f457bacead4621144d598 (table test-table [id=c3c3abe362974c4991dce32b49c568ef]) successfully deleted
I20260808 02:30:45.940485 27537 raft_consensus.cc:482] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:30:45.940742 27537 raft_consensus.cc:504] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } }
I20260808 02:30:45.941562 27537 leader_election.cc:288] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48fc7673d663463aadadcb904fde9587 (127.24.116.194:35803), ec79b9b87a96405083d8c317d502267d (127.24.116.195:36909)
I20260808 02:30:45.942195 27218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3504bbd55b30485187d4866131847eac" candidate_uuid: "93a191165b50424eb16b91dfdbf50e6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fc7673d663463aadadcb904fde9587" is_pre_election: true
I20260808 02:30:45.942492 27218 raft_consensus.cc:2454] T 3504bbd55b30485187d4866131847eac P 48fc7673d663463aadadcb904fde9587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93a191165b50424eb16b91dfdbf50e6b in term 0.
I20260808 02:30:45.942449 27426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3504bbd55b30485187d4866131847eac" candidate_uuid: "93a191165b50424eb16b91dfdbf50e6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec79b9b87a96405083d8c317d502267d" is_pre_election: true
I20260808 02:30:45.942715 27426 raft_consensus.cc:2454] T 3504bbd55b30485187d4866131847eac P ec79b9b87a96405083d8c317d502267d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93a191165b50424eb16b91dfdbf50e6b in term 0.
I20260808 02:30:45.943065 26895 leader_election.cc:302] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fc7673d663463aadadcb904fde9587, 93a191165b50424eb16b91dfdbf50e6b; no voters:
I20260808 02:30:45.943396 27537 raft_consensus.cc:2781] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:30:45.943535 27537 raft_consensus.cc:482] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:30:45.943643 27537 raft_consensus.cc:3037] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:45.946316 27537 raft_consensus.cc:504] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } }
I20260808 02:30:45.947000 27537 leader_election.cc:288] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b [CANDIDATE]: Term 1 election: Requested vote from peers 48fc7673d663463aadadcb904fde9587 (127.24.116.194:35803), ec79b9b87a96405083d8c317d502267d (127.24.116.195:36909)
I20260808 02:30:45.947515 27218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3504bbd55b30485187d4866131847eac" candidate_uuid: "93a191165b50424eb16b91dfdbf50e6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fc7673d663463aadadcb904fde9587"
I20260808 02:30:45.947772 27218 raft_consensus.cc:3037] T 3504bbd55b30485187d4866131847eac P 48fc7673d663463aadadcb904fde9587 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:45.947695 27426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3504bbd55b30485187d4866131847eac" candidate_uuid: "93a191165b50424eb16b91dfdbf50e6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec79b9b87a96405083d8c317d502267d"
I20260808 02:30:45.947932 27426 raft_consensus.cc:3037] T 3504bbd55b30485187d4866131847eac P ec79b9b87a96405083d8c317d502267d [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:45.950277 27218 raft_consensus.cc:2454] T 3504bbd55b30485187d4866131847eac P 48fc7673d663463aadadcb904fde9587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a191165b50424eb16b91dfdbf50e6b in term 1.
I20260808 02:30:45.950698 26895 leader_election.cc:302] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fc7673d663463aadadcb904fde9587, 93a191165b50424eb16b91dfdbf50e6b; no voters:
I20260808 02:30:45.951004 27537 raft_consensus.cc:2781] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:30:45.951169 27537 raft_consensus.cc:686] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b [term 1 LEADER]: Becoming Leader. State: Replica: 93a191165b50424eb16b91dfdbf50e6b, State: Running, Role: LEADER
I20260808 02:30:45.951355 27426 raft_consensus.cc:2454] T 3504bbd55b30485187d4866131847eac P ec79b9b87a96405083d8c317d502267d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a191165b50424eb16b91dfdbf50e6b in term 1.
I20260808 02:30:45.951463 27537 consensus_queue.cc:237] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } }
I20260808 02:30:45.954569 26757 catalog_manager.cc:5495] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b reported cstate change: term changed from 0 to 1, leader changed from <none> to 93a191165b50424eb16b91dfdbf50e6b (127.24.116.193). New cstate: current_term: 1 leader_uuid: "93a191165b50424eb16b91dfdbf50e6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } health_report { overall_health: UNKNOWN } } }
Aug 08 02:30:45 dist-test-slave-45dx krb5kdc[26686](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156243, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:30:46.007850 27587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:45.990928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40339 (local address 127.0.0.1:32790)
0808 02:30:45.992162 (+ 1234us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:45.992185 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:45.992435 (+ 250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:45.992916 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:45.992920 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:45.993659 (+ 739us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:30:45.993871 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:45.993890 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.995454 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.995458 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:45.996494 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:45.996507 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.997508 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.997513 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:45.997640 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:45.998393 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:30:45.998411 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:30:46.000685 (+ 2274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:30:46.004957 (+ 4272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:46.004970 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:46.004976 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:46.005409 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:46.005829 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:46.005832 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:46.005834 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:46.006005 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:46.006663 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:30:46.006673 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:30:46.006969 (+ 296us) client_negotiation.cc:769] Sending connection context
0808 02:30:46.007142 (+ 173us) client_negotiation.cc:240] Negotiation successful
0808 02:30:46.007350 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1042,"thread_start_us":872,"threads_started":1}
I20260808 02:30:46.007972 27585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:45.990949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32790 (local address 127.24.116.254:40339)
0808 02:30:45.991920 (+ 971us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:45.991930 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:45.992331 (+ 401us) server_negotiation.cc:407] Connection header received
0808 02:30:45.992582 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:45.992588 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:45.992697 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:45.992843 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:45.994070 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.995317 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.996637 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:45.997321 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:45.997458 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:46.000894 (+ 3436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:46.000901 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:46.000907 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:46.000946 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:46.004793 (+ 3847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:46.005545 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:46.005551 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:46.005555 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:46.005716 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:46.006126 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:46.006131 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:46.006135 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:46.006511 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:46.006691 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:46.007295 (+ 604us) server_negotiation.cc:299] Negotiation successful
0808 02:30:46.007536 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":785,"thread_start_us":474,"threads_started":1}
I20260808 02:30:46.014010 26757 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:32790:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 02:30:46.015115 26757 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:30:46.022235 26970 tablet_service.cc:1467] Processing CreateTablet for tablet f3455a36ae53478d9776faffde935993 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3ae6d526cb46417e965194a32b909e5e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 02:30:46.022434 27186 tablet_service.cc:1467] Processing CreateTablet for tablet f3455a36ae53478d9776faffde935993 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3ae6d526cb46417e965194a32b909e5e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 02:30:46.022889 26970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3455a36ae53478d9776faffde935993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:46.023025 27186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3455a36ae53478d9776faffde935993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:46.029142 27396 tablet_service.cc:1467] Processing CreateTablet for tablet f3455a36ae53478d9776faffde935993 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3ae6d526cb46417e965194a32b909e5e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 02:30:46.029640 27530 tablet_bootstrap.cc:492] T f3455a36ae53478d9776faffde935993 P 93a191165b50424eb16b91dfdbf50e6b: Bootstrap starting.
I20260808 02:30:46.029747 27396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3455a36ae53478d9776faffde935993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:46.032037 27530 tablet_bootstrap.cc:654] T f3455a36ae53478d9776faffde935993 P 93a191165b50424eb16b91dfdbf50e6b: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:46.033456 27529 tablet_bootstrap.cc:492] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587: Bootstrap starting.
I20260808 02:30:46.036136 27529 tablet_bootstrap.cc:654] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:46.037715 27531 tablet_bootstrap.cc:492] T f3455a36ae53478d9776faffde935993 P ec79b9b87a96405083d8c317d502267d: Bootstrap starting.
I20260808 02:30:46.039397 27531 tablet_bootstrap.cc:654] T f3455a36ae53478d9776faffde935993 P ec79b9b87a96405083d8c317d502267d: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:46.044077 27529 tablet_bootstrap.cc:492] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587: No bootstrap required, opened a new log
I20260808 02:30:46.044157 27531 tablet_bootstrap.cc:492] T f3455a36ae53478d9776faffde935993 P ec79b9b87a96405083d8c317d502267d: No bootstrap required, opened a new log
I20260808 02:30:46.044366 27531 ts_tablet_manager.cc:1397] T f3455a36ae53478d9776faffde935993 P ec79b9b87a96405083d8c317d502267d: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.001s
I20260808 02:30:46.044374 27529 ts_tablet_manager.cc:1397] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.005s
I20260808 02:30:46.045070 27530 tablet_bootstrap.cc:492] T f3455a36ae53478d9776faffde935993 P 93a191165b50424eb16b91dfdbf50e6b: No bootstrap required, opened a new log
I20260808 02:30:46.045342 27530 ts_tablet_manager.cc:1397] T f3455a36ae53478d9776faffde935993 P 93a191165b50424eb16b91dfdbf50e6b: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.005s
I20260808 02:30:46.045281 27531 raft_consensus.cc:348] T f3455a36ae53478d9776faffde935993 P ec79b9b87a96405083d8c317d502267d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } }
I20260808 02:30:46.045373 27529 raft_consensus.cc:348] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } }
I20260808 02:30:46.045547 27531 raft_consensus.cc:374] T f3455a36ae53478d9776faffde935993 P ec79b9b87a96405083d8c317d502267d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:46.045634 27531 raft_consensus.cc:729] T f3455a36ae53478d9776faffde935993 P ec79b9b87a96405083d8c317d502267d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec79b9b87a96405083d8c317d502267d, State: Initialized, Role: FOLLOWER
I20260808 02:30:46.045665 27529 raft_consensus.cc:374] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:46.045737 27529 raft_consensus.cc:729] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48fc7673d663463aadadcb904fde9587, State: Initialized, Role: FOLLOWER
I20260808 02:30:46.045928 27531 consensus_queue.cc:260] T f3455a36ae53478d9776faffde935993 P ec79b9b87a96405083d8c317d502267d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } }
I20260808 02:30:46.045984 27529 consensus_queue.cc:260] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } }
I20260808 02:30:46.046633 27538 tablet_replica.cc:439] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } } }
I20260808 02:30:46.047061 27538 tablet_replica.cc:442] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:30:46.047533 27529 ts_tablet_manager.cc:1428] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260808 02:30:46.047379 27540 tablet_replica.cc:439] T f3455a36ae53478d9776faffde935993 P ec79b9b87a96405083d8c317d502267d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } } }
I20260808 02:30:46.047722 27540 tablet_replica.cc:442] T f3455a36ae53478d9776faffde935993 P ec79b9b87a96405083d8c317d502267d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:30:46.048470 27530 raft_consensus.cc:348] T f3455a36ae53478d9776faffde935993 P 93a191165b50424eb16b91dfdbf50e6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } }
I20260808 02:30:46.048889 27530 raft_consensus.cc:374] T f3455a36ae53478d9776faffde935993 P 93a191165b50424eb16b91dfdbf50e6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:46.049021 27530 raft_consensus.cc:729] T f3455a36ae53478d9776faffde935993 P 93a191165b50424eb16b91dfdbf50e6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a191165b50424eb16b91dfdbf50e6b, State: Initialized, Role: FOLLOWER
I20260808 02:30:46.049333 27530 consensus_queue.cc:260] T f3455a36ae53478d9776faffde935993 P 93a191165b50424eb16b91dfdbf50e6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } }
I20260808 02:30:46.049817 27537 tablet_replica.cc:439] T f3455a36ae53478d9776faffde935993 P 93a191165b50424eb16b91dfdbf50e6b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } } }
I20260808 02:30:46.050158 27537 tablet_replica.cc:442] T f3455a36ae53478d9776faffde935993 P 93a191165b50424eb16b91dfdbf50e6b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:30:46.050199 27531 ts_tablet_manager.cc:1428] T f3455a36ae53478d9776faffde935993 P ec79b9b87a96405083d8c317d502267d: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260808 02:30:46.051462 27530 ts_tablet_manager.cc:1428] T f3455a36ae53478d9776faffde935993 P 93a191165b50424eb16b91dfdbf50e6b: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260808 02:30:46.060849 27538 raft_consensus.cc:482] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:30:46.061173 27538 raft_consensus.cc:504] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } }
I20260808 02:30:46.062738 27538 leader_election.cc:288] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93a191165b50424eb16b91dfdbf50e6b (127.24.116.193:43489), ec79b9b87a96405083d8c317d502267d (127.24.116.195:36909)
I20260808 02:30:46.071679 27525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:46.064474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:59817 (local address 127.24.116.195:36909)
0808 02:30:46.064663 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:46.064669 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:46.064689 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:30:46.064760 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:46.064787 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:46.064862 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:46.064952 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:30:46.065974 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.067115 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.069584 (+ 2469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.070528 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.070722 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:46.070822 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:46.071242 (+ 420us) server_negotiation.cc:299] Negotiation successful
0808 02:30:46.071390 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 02:30:46.071900 27522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:46.063493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:37647 (local address 127.24.116.193:43489)
0808 02:30:46.063738 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:46.063744 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:46.063922 (+ 178us) server_negotiation.cc:407] Connection header received
0808 02:30:46.064239 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:46.064246 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:46.064356 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:46.064435 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:30:46.065659 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.066562 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.069409 (+ 2847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.070693 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.070845 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:46.070911 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:46.071411 (+ 500us) server_negotiation.cc:299] Negotiation successful
0808 02:30:46.071572 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260808 02:30:46.072458 27594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:46.063852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:36909 (local address 127.24.116.194:59817)
0808 02:30:46.064494 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:46.064512 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:46.064622 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:46.065228 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:46.065234 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:46.065259 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:30:46.065730 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:46.065744 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.067250 (+ 1506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.067255 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:46.069439 (+ 2184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:46.069449 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.070815 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.070821 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:46.071059 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:46.071096 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 02:30:46.071206 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 02:30:46.071412 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"mutex_wait_us":3,"thread_start_us":1190,"threads_started":1}
I20260808 02:30:46.072613 27593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:46.063070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:43489 (local address 127.24.116.194:37647)
0808 02:30:46.063812 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:46.063829 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:46.064009 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:46.064661 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:46.064667 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:46.064696 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:30:46.065436 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:46.065453 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.066872 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.066877 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:46.069220 (+ 2343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:46.069235 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.071007 (+ 1772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.071012 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:46.071237 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:46.071267 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 02:30:46.071995 (+ 728us) client_negotiation.cc:240] Negotiation successful
0808 02:30:46.072132 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"mutex_wait_us":24,"thread_start_us":352,"threads_started":1}
I20260808 02:30:46.073223 27426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3455a36ae53478d9776faffde935993" candidate_uuid: "48fc7673d663463aadadcb904fde9587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec79b9b87a96405083d8c317d502267d" is_pre_election: true
I20260808 02:30:46.073500 27426 raft_consensus.cc:2454] T f3455a36ae53478d9776faffde935993 P ec79b9b87a96405083d8c317d502267d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48fc7673d663463aadadcb904fde9587 in term 0.
I20260808 02:30:46.073446 27003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3455a36ae53478d9776faffde935993" candidate_uuid: "48fc7673d663463aadadcb904fde9587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a191165b50424eb16b91dfdbf50e6b" is_pre_election: true
I20260808 02:30:46.073899 27003 raft_consensus.cc:2454] T f3455a36ae53478d9776faffde935993 P 93a191165b50424eb16b91dfdbf50e6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48fc7673d663463aadadcb904fde9587 in term 0.
I20260808 02:30:46.074061 27110 leader_election.cc:302] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fc7673d663463aadadcb904fde9587, ec79b9b87a96405083d8c317d502267d; no voters:
I20260808 02:30:46.074527 27538 raft_consensus.cc:2781] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:30:46.074652 27538 raft_consensus.cc:482] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:30:46.075162 27538 raft_consensus.cc:3037] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:46.077656 27538 raft_consensus.cc:504] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } }
I20260808 02:30:46.078285 27538 leader_election.cc:288] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587 [CANDIDATE]: Term 1 election: Requested vote from peers 93a191165b50424eb16b91dfdbf50e6b (127.24.116.193:43489), ec79b9b87a96405083d8c317d502267d (127.24.116.195:36909)
I20260808 02:30:46.078773 27003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3455a36ae53478d9776faffde935993" candidate_uuid: "48fc7673d663463aadadcb904fde9587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a191165b50424eb16b91dfdbf50e6b"
I20260808 02:30:46.078971 27003 raft_consensus.cc:3037] T f3455a36ae53478d9776faffde935993 P 93a191165b50424eb16b91dfdbf50e6b [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:46.078903 27426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3455a36ae53478d9776faffde935993" candidate_uuid: "48fc7673d663463aadadcb904fde9587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec79b9b87a96405083d8c317d502267d"
I20260808 02:30:46.079200 27426 raft_consensus.cc:3037] T f3455a36ae53478d9776faffde935993 P ec79b9b87a96405083d8c317d502267d [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:46.081631 27003 raft_consensus.cc:2454] T f3455a36ae53478d9776faffde935993 P 93a191165b50424eb16b91dfdbf50e6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fc7673d663463aadadcb904fde9587 in term 1.
I20260808 02:30:46.082134 27110 leader_election.cc:302] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fc7673d663463aadadcb904fde9587, 93a191165b50424eb16b91dfdbf50e6b; no voters:
I20260808 02:30:46.082453 27538 raft_consensus.cc:2781] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:30:46.082506 27426 raft_consensus.cc:2454] T f3455a36ae53478d9776faffde935993 P ec79b9b87a96405083d8c317d502267d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fc7673d663463aadadcb904fde9587 in term 1.
I20260808 02:30:46.088562 27538 raft_consensus.cc:686] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587 [term 1 LEADER]: Becoming Leader. State: Replica: 48fc7673d663463aadadcb904fde9587, State: Running, Role: LEADER
I20260808 02:30:46.089039 27538 consensus_queue.cc:237] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } }
I20260808 02:30:46.091805 27596 tablet_replica.cc:439] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587: TxnStatusTablet state changed. Reason: New leader 48fc7673d663463aadadcb904fde9587. Latest consensus state: current_term: 1 leader_uuid: "48fc7673d663463aadadcb904fde9587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } } }
I20260808 02:30:46.092274 27596 tablet_replica.cc:442] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587: This TxnStatusTablet replica's current role is: LEADER
I20260808 02:30:46.093256 27604 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 02:30:46.093590 27604 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 02:30:46.093415 26758 catalog_manager.cc:5495] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48fc7673d663463aadadcb904fde9587 (127.24.116.194). New cstate: current_term: 1 leader_uuid: "48fc7673d663463aadadcb904fde9587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } health_report { overall_health: UNKNOWN } } }
I20260808 02:30:46.117467 27527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:46.110766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38474 (local address 127.24.116.194:35803)
0808 02:30:46.111336 (+ 570us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:46.111342 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:46.111356 (+ 14us) server_negotiation.cc:407] Connection header received
0808 02:30:46.111494 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:46.111498 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:46.111630 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:46.111789 (+ 159us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:30:46.112263 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.113364 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.115063 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.115510 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.115668 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:46.116131 (+ 463us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:30:46.116739 (+ 608us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:30:46.116909 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:46.117011 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 02:30:46.117097 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460}
I20260808 02:30:46.117461 27587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:46.110685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:35803 (local address 127.0.0.1:38474)
0808 02:30:46.110909 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:46.110928 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:46.111058 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:46.111816 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:46.111821 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:46.111835 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:30:46.112042 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:46.112057 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.113508 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.113513 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:46.114915 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:46.114928 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.115669 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.115676 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:46.115851 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:46.115910 (+ 59us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:30:46.116859 (+ 949us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:30:46.116884 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 02:30:46.116979 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 02:30:46.117132 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 02:30:46.122098 27426 raft_consensus.cc:1261] T f3455a36ae53478d9776faffde935993 P ec79b9b87a96405083d8c317d502267d [term 1 FOLLOWER]: Refusing update from remote peer 48fc7673d663463aadadcb904fde9587: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:30:46.122749 27003 raft_consensus.cc:1261] T f3455a36ae53478d9776faffde935993 P 93a191165b50424eb16b91dfdbf50e6b [term 1 FOLLOWER]: Refusing update from remote peer 48fc7673d663463aadadcb904fde9587: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:30:46.123636 27538 consensus_queue.cc:1035] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:30:46.124372 27596 consensus_queue.cc:1035] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:30:46.128904 27540 tablet_replica.cc:439] T f3455a36ae53478d9776faffde935993 P ec79b9b87a96405083d8c317d502267d: TxnStatusTablet state changed. Reason: New leader 48fc7673d663463aadadcb904fde9587. Latest consensus state: current_term: 1 leader_uuid: "48fc7673d663463aadadcb904fde9587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } } }
I20260808 02:30:46.129248 27540 tablet_replica.cc:442] T f3455a36ae53478d9776faffde935993 P ec79b9b87a96405083d8c317d502267d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:30:46.131232 27596 tablet_replica.cc:439] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "48fc7673d663463aadadcb904fde9587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } } }
I20260808 02:30:46.131480 27596 tablet_replica.cc:442] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587: This TxnStatusTablet replica's current role is: LEADER
I20260808 02:30:46.135495 27555 mvcc.cc:205] Tried to move back new op lower bound from 7316095984107778048 to 7316095983985037312. Current Snapshot: MvccSnapshot[applied={T|T < 7316095984107778048 or (T in {7316095984107778048})}]
I20260808 02:30:46.139859 27549 mvcc.cc:205] Tried to move back new op lower bound from 7316095984107778048 to 7316095983985037312. Current Snapshot: MvccSnapshot[applied={T|T < 7316095984107778048}]
I20260808 02:30:46.140810 27540 tablet_replica.cc:439] T f3455a36ae53478d9776faffde935993 P ec79b9b87a96405083d8c317d502267d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "48fc7673d663463aadadcb904fde9587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } } }
I20260808 02:30:46.141054 27540 tablet_replica.cc:442] T f3455a36ae53478d9776faffde935993 P ec79b9b87a96405083d8c317d502267d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:30:46.153852 27537 tablet_replica.cc:439] T f3455a36ae53478d9776faffde935993 P 93a191165b50424eb16b91dfdbf50e6b: TxnStatusTablet state changed. Reason: New leader 48fc7673d663463aadadcb904fde9587. Latest consensus state: current_term: 1 leader_uuid: "48fc7673d663463aadadcb904fde9587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } } }
I20260808 02:30:46.154343 27537 tablet_replica.cc:442] T f3455a36ae53478d9776faffde935993 P 93a191165b50424eb16b91dfdbf50e6b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:30:46.159374 27538 tablet_replica.cc:439] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "48fc7673d663463aadadcb904fde9587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } } }
I20260808 02:30:46.159721 27538 tablet_replica.cc:442] T f3455a36ae53478d9776faffde935993 P 48fc7673d663463aadadcb904fde9587: This TxnStatusTablet replica's current role is: LEADER
I20260808 02:30:46.161758 27537 tablet_replica.cc:439] T f3455a36ae53478d9776faffde935993 P 93a191165b50424eb16b91dfdbf50e6b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "48fc7673d663463aadadcb904fde9587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a191165b50424eb16b91dfdbf50e6b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43489 } } peers { permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 } } peers { permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 } } }
I20260808 02:30:46.162052 27537 tablet_replica.cc:442] T f3455a36ae53478d9776faffde935993 P 93a191165b50424eb16b91dfdbf50e6b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:30:46.177242 27527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:46.167756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:55185 (local address 127.24.116.194:35803)
0808 02:30:46.167961 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:46.167971 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:46.168978 (+ 1007us) server_negotiation.cc:407] Connection header received
0808 02:30:46.169380 (+ 402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:46.169388 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:46.169503 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:46.169582 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:30:46.170626 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.172139 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.174725 (+ 2586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.175566 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.175715 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:46.176359 (+ 644us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:30:46.176505 (+ 146us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:30:46.176640 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:46.176829 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 02:30:46.176941 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 02:30:46.177382 27618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:46.167689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:35803 (local address 127.24.116.193:55185)
0808 02:30:46.168832 (+ 1143us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:46.168866 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:46.169137 (+ 271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:46.169834 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:46.169842 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:46.169860 (+ 18us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:30:46.170357 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:46.170375 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.172388 (+ 2013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.172394 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:46.174536 (+ 2142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:46.174555 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.175787 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.175794 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:46.176009 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:46.176091 (+ 82us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:30:46.176672 (+ 581us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:30:46.176685 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 02:30:46.176779 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 02:30:46.176931 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":925,"thread_start_us":886,"threads_started":1}
I20260808 02:30:46.192304 27426 raft_consensus.cc:1261] T 3504bbd55b30485187d4866131847eac P ec79b9b87a96405083d8c317d502267d [term 1 FOLLOWER]: Refusing update from remote peer 93a191165b50424eb16b91dfdbf50e6b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:30:46.192507 27218 raft_consensus.cc:1261] T 3504bbd55b30485187d4866131847eac P 48fc7673d663463aadadcb904fde9587 [term 1 FOLLOWER]: Refusing update from remote peer 93a191165b50424eb16b91dfdbf50e6b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:30:46.193199 27543 consensus_queue.cc:1035] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec79b9b87a96405083d8c317d502267d" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:30:46.193728 27543 consensus_queue.cc:1035] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48fc7673d663463aadadcb904fde9587" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:30:46.283933 27522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:46.257087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:43237 (local address 127.24.116.193:43489)
0808 02:30:46.257317 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:46.257323 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:46.260726 (+ 3403us) server_negotiation.cc:407] Connection header received
0808 02:30:46.267045 (+ 6319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:46.267063 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:46.267672 (+ 609us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:46.267982 (+ 310us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:30:46.271588 (+ 3606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.273155 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.278273 (+ 5118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.279101 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.279205 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:46.282964 (+ 3759us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:30:46.283162 (+ 198us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:30:46.283233 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:46.283462 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 02:30:46.283557 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 02:30:46.285041 27626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:46.257341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:43489 (local address 127.24.116.194:43237)
0808 02:30:46.260621 (+ 3280us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:46.260643 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:46.260881 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:46.270894 (+ 10013us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:46.270900 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:46.270915 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:30:46.271350 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:46.271362 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.276105 (+ 4743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.276111 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:46.278090 (+ 1979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:46.278109 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.282443 (+ 4334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.282449 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:46.282645 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:46.282729 (+ 84us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:30:46.283312 (+ 583us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:30:46.283322 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 02:30:46.284430 (+ 1108us) client_negotiation.cc:240] Negotiation successful
0808 02:30:46.284600 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3021,"thread_start_us":2745,"threads_started":1}
I20260808 02:30:46.335677 26759 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:32788:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:30:46.336006 26759 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:32788:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:30:46.339907 26759 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a49b0ed628a94992a998839986ff736c: Sending DeleteTablet for 3 replicas of tablet 3504bbd55b30485187d4866131847eac
I20260808 02:30:46.341225 27396 tablet_service.cc:1514] Processing DeleteTablet for tablet 3504bbd55b30485187d4866131847eac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:30:46 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:34932
I20260808 02:30:46.341609 27567 tablet_replica.cc:330] T 3504bbd55b30485187d4866131847eac P ec79b9b87a96405083d8c317d502267d: stopping tablet replica
I20260808 02:30:46.341945 27567 raft_consensus.cc:2229] T 3504bbd55b30485187d4866131847eac P ec79b9b87a96405083d8c317d502267d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:30:46.342298 27567 raft_consensus.cc:2258] T 3504bbd55b30485187d4866131847eac P ec79b9b87a96405083d8c317d502267d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:30:46.342559 26970 tablet_service.cc:1514] Processing DeleteTablet for tablet 3504bbd55b30485187d4866131847eac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:30:46 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:49548
I20260808 02:30:46.342893 27564 tablet_replica.cc:330] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b: stopping tablet replica
I20260808 02:30:46.343194 27564 raft_consensus.cc:2229] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:30:46.343370 27186 tablet_service.cc:1514] Processing DeleteTablet for tablet 3504bbd55b30485187d4866131847eac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:30:46 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:38464
I20260808 02:30:46.343596 27564 raft_consensus.cc:2258] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:30:46.343672 27569 tablet_replica.cc:330] T 3504bbd55b30485187d4866131847eac P 48fc7673d663463aadadcb904fde9587: stopping tablet replica
I20260808 02:30:46.343894 27569 raft_consensus.cc:2229] T 3504bbd55b30485187d4866131847eac P 48fc7673d663463aadadcb904fde9587 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:30:46.344146 27569 raft_consensus.cc:2258] T 3504bbd55b30485187d4866131847eac P 48fc7673d663463aadadcb904fde9587 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:30:46.345378 27564 ts_tablet_manager.cc:1905] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:30:46.345644 27567 ts_tablet_manager.cc:1905] T 3504bbd55b30485187d4866131847eac P ec79b9b87a96405083d8c317d502267d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:30:46.349452 27569 ts_tablet_manager.cc:1905] T 3504bbd55b30485187d4866131847eac P 48fc7673d663463aadadcb904fde9587: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:30:46.354296 27564 ts_tablet_manager.cc:1918] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:30:46.354526 27564 log.cc:1196] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/3504bbd55b30485187d4866131847eac
I20260808 02:30:46.355131 27564 ts_tablet_manager.cc:1939] T 3504bbd55b30485187d4866131847eac P 93a191165b50424eb16b91dfdbf50e6b: Deleting consensus metadata
I20260808 02:30:46.356518 26741 catalog_manager.cc:4841] TS 93a191165b50424eb16b91dfdbf50e6b (127.24.116.193:43489): tablet 3504bbd55b30485187d4866131847eac (table test-table [id=a5249a1358b3403db77773d52c06aa1d]) successfully deleted
I20260808 02:30:46.359714 27569 ts_tablet_manager.cc:1918] T 3504bbd55b30485187d4866131847eac P 48fc7673d663463aadadcb904fde9587: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:30:46.359906 27569 log.cc:1196] T 3504bbd55b30485187d4866131847eac P 48fc7673d663463aadadcb904fde9587: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/3504bbd55b30485187d4866131847eac
I20260808 02:30:46.365584 27567 ts_tablet_manager.cc:1918] T 3504bbd55b30485187d4866131847eac P ec79b9b87a96405083d8c317d502267d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:30:46.365872 27569 ts_tablet_manager.cc:1939] T 3504bbd55b30485187d4866131847eac P 48fc7673d663463aadadcb904fde9587: Deleting consensus metadata
I20260808 02:30:46.367596 26741 catalog_manager.cc:4841] TS 48fc7673d663463aadadcb904fde9587 (127.24.116.194:35803): tablet 3504bbd55b30485187d4866131847eac (table test-table [id=a5249a1358b3403db77773d52c06aa1d]) successfully deleted
I20260808 02:30:46.368046 27567 log.cc:1196] T 3504bbd55b30485187d4866131847eac P ec79b9b87a96405083d8c317d502267d: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/3504bbd55b30485187d4866131847eac
I20260808 02:30:46.368682 27567 ts_tablet_manager.cc:1939] T 3504bbd55b30485187d4866131847eac P ec79b9b87a96405083d8c317d502267d: Deleting consensus metadata
I20260808 02:30:46.370136 26741 catalog_manager.cc:4841] TS ec79b9b87a96405083d8c317d502267d (127.24.116.195:36909): tablet 3504bbd55b30485187d4866131847eac (table test-table [id=a5249a1358b3403db77773d52c06aa1d]) successfully deleted
Aug 08 02:30:46 dist-test-slave-45dx krb5kdc[26686](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156245, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.116.193@KRBTEST.COM
I20260808 02:30:46.406392 27522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:46.373644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49564 (local address 127.24.116.193:43489)
0808 02:30:46.373849 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:46.373855 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:46.385002 (+ 11147us) server_negotiation.cc:407] Connection header received
0808 02:30:46.385219 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:46.385226 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:46.385311 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:46.385410 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:46.387704 (+ 2294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.389000 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.390926 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.391589 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.391699 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:46.397702 (+ 6003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:46.397718 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:46.397737 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:46.397792 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:46.402507 (+ 4715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:46.403528 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:46.403539 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:46.403543 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:46.403701 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:46.404152 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:46.404159 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:46.404162 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:46.404701 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:46.405125 (+ 424us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:46.405732 (+ 607us) server_negotiation.cc:299] Negotiation successful
0808 02:30:46.406004 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260808 02:30:46.408668 27066 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49564
I20260808 02:30:46.427071 27585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:46.412830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32792 (local address 127.24.116.254:40339)
0808 02:30:46.413060 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:46.413068 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:46.413685 (+ 617us) server_negotiation.cc:407] Connection header received
0808 02:30:46.413943 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:46.413948 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:46.414044 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:46.414151 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:46.415454 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.416198 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.417526 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.418061 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.418208 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:46.421054 (+ 2846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:46.421065 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:46.421069 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:46.421104 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:46.424183 (+ 3079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:46.424919 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:46.424925 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:46.424928 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:46.425113 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:46.425525 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:46.425529 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:46.425531 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:46.425847 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:46.426126 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:46.426475 (+ 349us) server_negotiation.cc:299] Negotiation successful
0808 02:30:46.426727 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
W20260808 02:30:46.427768 26759 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:32792
I20260808 02:30:46.429925 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 26864
I20260808 02:30:46.450492 27522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:46.431194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49570 (local address 127.24.116.193:43489)
0808 02:30:46.431421 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:46.431428 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:46.436836 (+ 5408us) server_negotiation.cc:407] Connection header received
0808 02:30:46.437027 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:46.437035 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:46.437110 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:46.437222 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:46.438488 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.439224 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.440544 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.440982 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.441126 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:46.443497 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:46.443508 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:46.443511 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:46.443546 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:46.446901 (+ 3355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:46.447668 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:46.447674 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:46.447680 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:46.447832 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:46.448326 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:46.448331 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:46.448334 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:46.448806 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:46.449062 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:46.450054 (+ 992us) server_negotiation.cc:299] Negotiation successful
0808 02:30:46.450249 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260808 02:30:46.451198 27066 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49570
W20260808 02:30:46.451826 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 26864: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:30:46.452057 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 26864
I20260808 02:30:46.486394 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 27086
Aug 08 02:30:46 dist-test-slave-45dx krb5kdc[26686](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156245, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.116.194@KRBTEST.COM
I20260808 02:30:46.504964 27527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:46.487255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38480 (local address 127.24.116.194:35803)
0808 02:30:46.487460 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:46.487464 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:46.487517 (+ 53us) server_negotiation.cc:407] Connection header received
0808 02:30:46.487743 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:46.487747 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:46.487816 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:46.487932 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:46.489738 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.490586 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.492630 (+ 2044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.493150 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.493249 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:46.498472 (+ 5223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:46.498484 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:46.498499 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:46.498537 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:46.501842 (+ 3305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:46.502587 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:46.502594 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:46.502597 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:46.502755 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:46.503193 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:46.503197 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:46.503199 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:46.503610 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:46.503994 (+ 384us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:46.504278 (+ 284us) server_negotiation.cc:299] Negotiation successful
0808 02:30:46.504618 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
W20260808 02:30:46.505716 27275 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38480
W20260808 02:30:46.506510 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 27086: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:30:46.506703 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 27086
I20260808 02:30:46.540712 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 27287
Aug 08 02:30:46 dist-test-slave-45dx krb5kdc[26686](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156245, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.116.195@KRBTEST.COM
I20260808 02:30:46.557286 27525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:46.541608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34944 (local address 127.24.116.195:36909)
0808 02:30:46.541831 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:46.541835 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:46.541854 (+ 19us) server_negotiation.cc:407] Connection header received
0808 02:30:46.542032 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:46.542036 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:46.542116 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:46.542203 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:46.543456 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.544182 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.545451 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:46.545985 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:46.546082 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:46.551427 (+ 5345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:46.551445 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:46.551463 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:46.551499 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:46.554627 (+ 3128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:46.555305 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:46.555313 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:46.555316 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:46.555449 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:46.555806 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:46.555809 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:46.555811 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:46.556167 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:46.556588 (+ 421us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:46.556727 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 02:30:46.556915 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260808 02:30:46.557955 27493 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34944
W20260808 02:30:46.558650 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 27287: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:30:46.558840 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 27287
I20260808 02:30:46.588557 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 26705
I20260808 02:30:46.589792 26825 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:30:46.712626 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 26705
2026-08-08T02:30:46Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5143 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:30:46 dist-test-slave-45dx krb5kdc[27639](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:30:46 dist-test-slave-45dx krb5kdc[27639](info): set up 2 sockets
Aug 08 02:30:46 dist-test-slave-45dx krb5kdc[27639](info): commencing operation
krb5kdc: starting...
W20260808 02:30:48.055531 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.289s user 0.000s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:30:48 dist-test-slave-45dx krb5kdc[27639](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:30:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:30:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:30:48.283901 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:34851
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:36969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:34851
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:30:48.614638 27658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:30:48.614924 27658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:30:48.615015 27658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:30:48.622403 27658 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:30:48.622537 27658 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 02:30:48.622614 27658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:30:48.622699 27658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:30:48.622750 27658 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:30:48.622817 27658 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:30:48.632494 27658 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:36969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:34851
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:34851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:30:48.633852 27658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:30:48.635457 27658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:30:48.647416 27666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:48.647341 27667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:48.647392 27669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:30:48.648913 27658 server_base.cc:1034] running on GCE node
I20260808 02:30:48.649739 27658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:30:48.651176 27658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:30:48.652421 27658 hybrid_clock.cc:648] HybridClock initialized: now 1786156248652359 us; error 38 us; skew 500 ppm
I20260808 02:30:48.652755 27658 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:30:48 dist-test-slave-45dx krb5kdc[27639](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156248, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:30:48.656008 27658 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:30:48.657611 27658 webserver.cc:460] Webserver started at http://127.24.116.254:39665/ using document root <none> and password file <none>
I20260808 02:30:48.658332 27658 fs_manager.cc:359] Metadata directory not provided
I20260808 02:30:48.658468 27658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:30:48.658813 27658 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:30:48.661901 27658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "216f22d34def4c6c878b71a43cd19747"
format_stamp: "Formatted at 2026-08-08 02:30:48 on dist-test-slave-45dx"
server_key: "a4f2cbea521f9dd25ca111a3047c0508"
server_key_iv: "ff5b98ce9c1f98b91b662ccc57ed1096"
server_key_version: "encryptionkey@0"
I20260808 02:30:48.662674 27658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "216f22d34def4c6c878b71a43cd19747"
format_stamp: "Formatted at 2026-08-08 02:30:48 on dist-test-slave-45dx"
server_key: "a4f2cbea521f9dd25ca111a3047c0508"
server_key_iv: "ff5b98ce9c1f98b91b662ccc57ed1096"
server_key_version: "encryptionkey@0"
I20260808 02:30:48.668074 27658 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260808 02:30:48.671625 27680 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:48.673038 27658 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:30:48.673233 27658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "216f22d34def4c6c878b71a43cd19747"
format_stamp: "Formatted at 2026-08-08 02:30:48 on dist-test-slave-45dx"
server_key: "a4f2cbea521f9dd25ca111a3047c0508"
server_key_iv: "ff5b98ce9c1f98b91b662ccc57ed1096"
server_key_version: "encryptionkey@0"
I20260808 02:30:48.673462 27658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:30:48.699126 27658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:30:48.703909 27658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:30:48.704200 27658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:30:48.726613 27658 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:34851
I20260808 02:30:48.726655 27773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:34851 every 8 connection(s)
I20260808 02:30:48.728003 27658 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:30:48.731724 27775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:48.734962 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 27658
I20260808 02:30:48.735170 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:30:48.736004 25043 external_mini_cluster.cc:1428] Setting key 8ed8e1c07835b7f8768b3b892e562f22
I20260808 02:30:48.744902 27775 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747: Bootstrap starting.
I20260808 02:30:48.748907 27775 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:48.750314 27775 log.cc:824] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747: Log is configured to *not* fsync() on all Append() calls
Aug 08 02:30:48 dist-test-slave-45dx krb5kdc[27639](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:30:48.753785 27775 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747: No bootstrap required, opened a new log
I20260808 02:30:48.760591 27783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:48.738150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45616 (local address 127.24.116.254:34851)
0808 02:30:48.738930 (+ 780us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:48.738941 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:48.738982 (+ 41us) server_negotiation.cc:407] Connection header received
0808 02:30:48.740712 (+ 1730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:48.740739 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:48.741122 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:48.741463 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:48.743241 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:48.744576 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:48.746347 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:48.747026 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:48.747161 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:48.752061 (+ 4900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:48.752072 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:48.752091 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:48.752142 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:48.756240 (+ 4098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:48.757082 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:48.757090 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:48.757097 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:48.757280 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:48.757691 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:48.757707 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:48.757710 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:48.758249 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:48.758596 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:48.759065 (+ 469us) server_negotiation.cc:299] Negotiation successful
0808 02:30:48.759512 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":373,"threads_started":1}
I20260808 02:30:48.762492 27775 raft_consensus.cc:348] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "216f22d34def4c6c878b71a43cd19747" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34851 } }
I20260808 02:30:48.762862 27775 raft_consensus.cc:374] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:48.762988 27775 raft_consensus.cc:729] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216f22d34def4c6c878b71a43cd19747, State: Initialized, Role: FOLLOWER
I20260808 02:30:48.763679 27775 consensus_queue.cc:260] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "216f22d34def4c6c878b71a43cd19747" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34851 } }
I20260808 02:30:48.763947 27775 raft_consensus.cc:388] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:30:48.764086 27775 raft_consensus.cc:482] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:30:48.764271 27775 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:48.766513 27775 raft_consensus.cc:504] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "216f22d34def4c6c878b71a43cd19747" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34851 } }
I20260808 02:30:48.767026 27775 leader_election.cc:302] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 216f22d34def4c6c878b71a43cd19747; no voters:
I20260808 02:30:48.767740 27775 leader_election.cc:288] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:30:48.767874 27786 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:30:48.768586 27786 raft_consensus.cc:686] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747 [term 1 LEADER]: Becoming Leader. State: Replica: 216f22d34def4c6c878b71a43cd19747, State: Running, Role: LEADER
I20260808 02:30:48.769166 27786 consensus_queue.cc:237] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "216f22d34def4c6c878b71a43cd19747" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34851 } }
I20260808 02:30:48.770102 27775 sys_catalog.cc:564] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:30:48.774240 27788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 216f22d34def4c6c878b71a43cd19747. Latest consensus state: current_term: 1 leader_uuid: "216f22d34def4c6c878b71a43cd19747" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "216f22d34def4c6c878b71a43cd19747" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34851 } } }
I20260808 02:30:48.774250 27787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "216f22d34def4c6c878b71a43cd19747" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "216f22d34def4c6c878b71a43cd19747" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34851 } } }
I20260808 02:30:48.774694 27787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747 [sys.catalog]: This master's current role is: LEADER
I20260808 02:30:48.774694 27788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747 [sys.catalog]: This master's current role is: LEADER
I20260808 02:30:48.776293 27797 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:30:48.780864 27797 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:30:48.789304 27797 catalog_manager.cc:1347] Generated new cluster ID: 099c43ea20b84560ab1f0ab1f82cb983
I20260808 02:30:48.789425 27797 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:30:48.810395 27797 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:30:48.812438 27797 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:30:48.826928 27797 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747: Generated new TSK 0
I20260808 02:30:48.827984 27797 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.116.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
I20260808 02:30:48.888120 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:34851
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:36969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:30:49.231997 27810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:30:49.232333 27810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:30:49.232481 27810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:30:49.239682 27810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:30:49.239804 27810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:30:49.239925 27810 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 02:30:49.240031 27810 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 02:30:49.240144 27810 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:30:49.250360 27810 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:36969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.116.254:34851
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:30:49.251959 27810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:30:49.253396 27810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:30:49.267365 27822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:49.267465 27818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:49.267441 27819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:30:49.268600 27810 server_base.cc:1034] running on GCE node
I20260808 02:30:49.269248 27810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:30:49.270255 27810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:30:49.271482 27810 hybrid_clock.cc:648] HybridClock initialized: now 1786156249271432 us; error 44 us; skew 500 ppm
I20260808 02:30:49.271826 27810 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:30:49 dist-test-slave-45dx krb5kdc[27639](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156249, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:30:49.275264 27810 init.cc:377] Logged in from keytab as kudu/127.24.116.193@KRBTEST.COM (short username kudu)
I20260808 02:30:49.276897 27810 webserver.cc:460] Webserver started at http://127.24.116.193:36523/ using document root <none> and password file <none>
I20260808 02:30:49.277601 27810 fs_manager.cc:359] Metadata directory not provided
I20260808 02:30:49.277745 27810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:30:49.278074 27810 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:30:49.281190 27810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "b2f25891bfc740d58c8572ed05539bdc"
format_stamp: "Formatted at 2026-08-08 02:30:49 on dist-test-slave-45dx"
server_key: "e62fbeeb27bd871ea62d79bac6429aea"
server_key_iv: "936a92fcd326b41cf179cdc4239d1614"
server_key_version: "encryptionkey@0"
I20260808 02:30:49.281993 27810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "b2f25891bfc740d58c8572ed05539bdc"
format_stamp: "Formatted at 2026-08-08 02:30:49 on dist-test-slave-45dx"
server_key: "e62fbeeb27bd871ea62d79bac6429aea"
server_key_iv: "936a92fcd326b41cf179cdc4239d1614"
server_key_version: "encryptionkey@0"
I20260808 02:30:49.287199 27810 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 02:30:49.290792 27832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:49.292119 27810 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 02:30:49.292287 27810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "b2f25891bfc740d58c8572ed05539bdc"
format_stamp: "Formatted at 2026-08-08 02:30:49 on dist-test-slave-45dx"
server_key: "e62fbeeb27bd871ea62d79bac6429aea"
server_key_iv: "936a92fcd326b41cf179cdc4239d1614"
server_key_version: "encryptionkey@0"
I20260808 02:30:49.292522 27810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:30:49.308195 27810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:30:49.312776 27810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:30:49.313076 27810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:30:49.315680 27810 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:30:49.315804 27810 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:49.315940 27810 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:30:49.316030 27810 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 02:30:49 dist-test-slave-45dx krb5kdc[27639](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156249, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:30:49.340152 27845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:49.316397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:42087 (local address 127.24.116.254:34851)
0808 02:30:49.318911 (+ 2514us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:49.318918 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:49.318943 (+ 25us) server_negotiation.cc:407] Connection header received
0808 02:30:49.320618 (+ 1675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:49.320628 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:49.320743 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:49.320868 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:49.323106 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:49.324212 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:49.326863 (+ 2651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:49.327529 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:49.327676 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:49.333093 (+ 5417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:49.333101 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:49.333109 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:49.333166 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:49.336893 (+ 3727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:49.337706 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:49.337711 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:49.337713 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:49.337831 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:49.338325 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:49.338329 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:49.338331 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:49.338610 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:49.338772 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:49.339545 (+ 773us) server_negotiation.cc:299] Negotiation successful
0808 02:30:49.339779 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2366,"thread_start_us":2254,"threads_started":1}
I20260808 02:30:49.341272 27847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:49.317088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:34851 (local address 127.24.116.193:42087)
0808 02:30:49.318160 (+ 1072us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:49.318221 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:49.320267 (+ 2046us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:49.321134 (+ 867us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:49.321147 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:49.321959 (+ 812us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:30:49.322856 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:49.322886 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:49.324418 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:49.324423 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:49.326706 (+ 2283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:49.326718 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:49.327799 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:49.327811 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:49.328191 (+ 380us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:49.329134 (+ 943us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:30:49.329159 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:30:49.332796 (+ 3637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:30:49.337060 (+ 4264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:49.337070 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:49.337089 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:49.337559 (+ 470us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:49.337953 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:49.337959 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:49.337963 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:49.338189 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:49.338745 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:30:49.338754 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:30:49.339170 (+ 416us) client_negotiation.cc:769] Sending connection context
0808 02:30:49.339444 (+ 274us) client_negotiation.cc:240] Negotiation successful
0808 02:30:49.340007 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":709,"thread_start_us":424,"threads_started":1}
I20260808 02:30:49.360586 27845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:49.347605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:33977 (local address 127.24.116.254:34851)
0808 02:30:49.347776 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:49.347780 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:49.348549 (+ 769us) server_negotiation.cc:407] Connection header received
0808 02:30:49.348817 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:49.348822 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:49.348901 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:49.349008 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:49.349933 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:49.350631 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:49.351892 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:49.352271 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:49.352428 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:49.354557 (+ 2129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:49.354566 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:49.354572 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:49.354618 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:49.357909 (+ 3291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:49.358602 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:49.358609 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:49.358613 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:49.358747 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:49.359112 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:49.359117 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:49.359121 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:49.359388 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:49.359546 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:49.359970 (+ 424us) server_negotiation.cc:299] Negotiation successful
0808 02:30:49.360193 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 02:30:49.360713 27941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:49.347697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:34851 (local address 127.24.116.193:33977)
0808 02:30:49.348415 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:49.348441 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:49.348612 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:49.349038 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:49.349042 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:49.349499 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:30:49.349783 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:49.349792 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:49.350778 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:49.350788 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:49.351740 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:49.351751 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:49.352509 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:49.352517 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:49.352807 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:49.353594 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:30:49.353612 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:30:49.354357 (+ 745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:30:49.358078 (+ 3721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:49.358084 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:49.358088 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:49.358485 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:49.358862 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:49.358867 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:49.358870 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:49.359002 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:49.359509 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:30:49.359513 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:30:49.359699 (+ 186us) client_negotiation.cc:769] Sending connection context
0808 02:30:49.359859 (+ 160us) client_negotiation.cc:240] Negotiation successful
0808 02:30:49.360194 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":380,"threads_started":1}
I20260808 02:30:49.376818 27810 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:34459
I20260808 02:30:49.376906 28031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:34459 every 8 connection(s)
I20260808 02:30:49.378121 27810 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:30:49.380227 28032 heartbeater.cc:347] Connected to a master server at 127.24.116.254:34851
I20260808 02:30:49.380496 28032 heartbeater.cc:464] Registering TS with master...
I20260808 02:30:49.381067 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 27810
I20260808 02:30:49.381245 28032 heartbeater.cc:511] Master 127.24.116.254:34851 requested a full tablet report, sending...
I20260808 02:30:49.381299 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:30:49.382014 25043 external_mini_cluster.cc:1428] Setting key cc0594c10d97ad348c075390ec68b0c0
I20260808 02:30:49.383545 27703 ts_manager.cc:194] Registered new tserver with Master: b2f25891bfc740d58c8572ed05539bdc (127.24.116.193:34459)
I20260808 02:30:49.385146 27703 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.193@KRBTEST.COM'} at 127.24.116.193:42087
WARNING: no policy specified for kudu/127.24.116.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
I20260808 02:30:49.432606 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:34851
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:36969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:30:49.782232 28037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:30:49.782569 28037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:30:49.782755 28037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:30:49.790228 28037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:30:49.790402 28037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:30:49.790546 28037 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 02:30:49.790644 28037 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 02:30:49.790759 28037 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:30:49.800782 28037 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:36969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.116.254:34851
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:30:49.802137 28037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:30:49.803637 28037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:30:49.816951 28044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:49.817018 28047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:49.816992 28043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:30:49.818078 28037 server_base.cc:1034] running on GCE node
I20260808 02:30:49.818711 28037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:30:49.819732 28037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:30:49.820984 28037 hybrid_clock.cc:648] HybridClock initialized: now 1786156249820938 us; error 51 us; skew 500 ppm
I20260808 02:30:49.821317 28037 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:30:49 dist-test-slave-45dx krb5kdc[27639](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156249, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:30:49.824918 28037 init.cc:377] Logged in from keytab as kudu/127.24.116.194@KRBTEST.COM (short username kudu)
I20260808 02:30:49.826435 28037 webserver.cc:460] Webserver started at http://127.24.116.194:37803/ using document root <none> and password file <none>
I20260808 02:30:49.827172 28037 fs_manager.cc:359] Metadata directory not provided
I20260808 02:30:49.827328 28037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:30:49.827656 28037 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:30:49.830689 28037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "199593e26c834084b7d52e7a01623f37"
format_stamp: "Formatted at 2026-08-08 02:30:49 on dist-test-slave-45dx"
server_key: "b7b9813a93b329bb4eaacee201e8d54e"
server_key_iv: "c8cbe2cc4992f77ade23d62df2e4c18b"
server_key_version: "encryptionkey@0"
I20260808 02:30:49.831471 28037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "199593e26c834084b7d52e7a01623f37"
format_stamp: "Formatted at 2026-08-08 02:30:49 on dist-test-slave-45dx"
server_key: "b7b9813a93b329bb4eaacee201e8d54e"
server_key_iv: "c8cbe2cc4992f77ade23d62df2e4c18b"
server_key_version: "encryptionkey@0"
I20260808 02:30:49.837205 28037 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260808 02:30:49.840888 28060 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:49.842334 28037 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 02:30:49.842514 28037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "199593e26c834084b7d52e7a01623f37"
format_stamp: "Formatted at 2026-08-08 02:30:49 on dist-test-slave-45dx"
server_key: "b7b9813a93b329bb4eaacee201e8d54e"
server_key_iv: "c8cbe2cc4992f77ade23d62df2e4c18b"
server_key_version: "encryptionkey@0"
I20260808 02:30:49.842721 28037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:30:49.857026 28037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:30:49.860960 28037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:30:49.861275 28037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:30:49.864078 28037 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:30:49.864223 28037 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:49.864363 28037 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:30:49.864459 28037 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 02:30:49 dist-test-slave-45dx krb5kdc[27639](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156249, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:30:49.888928 28078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:49.864409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:50267 (local address 127.24.116.254:34851)
0808 02:30:49.864899 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:49.864906 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:49.866160 (+ 1254us) server_negotiation.cc:407] Connection header received
0808 02:30:49.869221 (+ 3061us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:49.869226 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:49.869294 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:49.869399 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:49.872117 (+ 2718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:49.873171 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:49.875404 (+ 2233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:49.875953 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:49.876123 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:49.881970 (+ 5847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:49.881975 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:49.881979 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:49.882012 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:49.885408 (+ 3396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:49.886450 (+ 1042us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:49.886458 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:49.886461 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:49.886600 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:49.887063 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:49.887070 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:49.887075 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:49.887348 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:49.887520 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:49.888249 (+ 729us) server_negotiation.cc:299] Negotiation successful
0808 02:30:49.888516 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":238,"threads_started":1}
I20260808 02:30:49.890015 28080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:49.865042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:34851 (local address 127.24.116.194:50267)
0808 02:30:49.865967 (+ 925us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:49.866016 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:49.868863 (+ 2847us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:49.869713 (+ 850us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:49.869724 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:49.870756 (+ 1032us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:30:49.871846 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:49.871893 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:49.873330 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:49.873346 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:49.875251 (+ 1905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:49.875263 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:49.876248 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:49.876263 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:49.876721 (+ 458us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:49.877625 (+ 904us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:30:49.877664 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:30:49.881696 (+ 4032us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:30:49.885608 (+ 3912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:49.885618 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:49.885639 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:49.886314 (+ 675us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:49.886717 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:49.886722 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:49.886726 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:49.886946 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:49.887484 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:30:49.887493 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:30:49.887874 (+ 381us) client_negotiation.cc:769] Sending connection context
0808 02:30:49.888161 (+ 287us) client_negotiation.cc:240] Negotiation successful
0808 02:30:49.888779 (+ 618us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"thread_start_us":390,"threads_started":1}
I20260808 02:30:49.912609 28078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:49.896171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:39813 (local address 127.24.116.254:34851)
0808 02:30:49.896455 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:49.896464 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:49.897124 (+ 660us) server_negotiation.cc:407] Connection header received
0808 02:30:49.897317 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:49.897320 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:49.897440 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:49.897519 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:49.899005 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:49.899708 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:49.902239 (+ 2531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:49.902860 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:49.903024 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:49.905829 (+ 2805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:49.905837 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:49.905843 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:49.905889 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:49.909566 (+ 3677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:49.910556 (+ 990us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:49.910562 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:49.910566 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:49.910688 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:49.911071 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:49.911076 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:49.911079 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:49.911407 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:49.911565 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:49.911974 (+ 409us) server_negotiation.cc:299] Negotiation successful
0808 02:30:49.912197 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
I20260808 02:30:49.913106 28165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:49.896082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:34851 (local address 127.24.116.194:39813)
0808 02:30:49.896993 (+ 911us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:49.897020 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:49.897197 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:49.897590 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:49.897597 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:49.898379 (+ 782us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:30:49.898847 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:49.898864 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:49.899857 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:49.899865 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:49.902069 (+ 2204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:49.902088 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:49.903115 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:49.903125 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:49.903408 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:49.904124 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:30:49.904156 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:30:49.905554 (+ 1398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:30:49.909710 (+ 4156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:49.909715 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:49.909719 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:49.910406 (+ 687us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:49.910801 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:49.910806 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:49.910810 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:49.910953 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:49.911530 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:30:49.911535 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:30:49.911725 (+ 190us) client_negotiation.cc:769] Sending connection context
0808 02:30:49.911866 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 02:30:49.912198 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":707,"thread_start_us":503,"threads_started":1}
I20260808 02:30:49.921916 28037 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:44539
I20260808 02:30:49.921960 28241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:44539 every 8 connection(s)
I20260808 02:30:49.923291 28037 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:30:49.925169 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 28037
I20260808 02:30:49.925364 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:30:49.925761 28242 heartbeater.cc:347] Connected to a master server at 127.24.116.254:34851
I20260808 02:30:49.925984 25043 external_mini_cluster.cc:1428] Setting key 9d93ab10b99903916480e4c82bc2ff64
I20260808 02:30:49.926007 28242 heartbeater.cc:464] Registering TS with master...
I20260808 02:30:49.926676 28242 heartbeater.cc:511] Master 127.24.116.254:34851 requested a full tablet report, sending...
I20260808 02:30:49.928061 27703 ts_manager.cc:194] Registered new tserver with Master: 199593e26c834084b7d52e7a01623f37 (127.24.116.194:44539)
I20260808 02:30:49.928926 27703 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.194@KRBTEST.COM'} at 127.24.116.194:50267
WARNING: no policy specified for kudu/127.24.116.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
I20260808 02:30:49.973999 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:34851
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:36969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:30:50.337857 28249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:30:50.338166 28249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:30:50.338351 28249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:30:50.345991 28249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:30:50.346132 28249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:30:50.346243 28249 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 02:30:50.346299 28249 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 02:30:50.346372 28249 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:30:50.356153 28249 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:36969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.116.254:34851
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:30:50.357400 28249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:30:50.358711 28249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:30:50.372478 28255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:50.372426 28257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:50.372454 28254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:30:50.373368 28249 server_base.cc:1034] running on GCE node
I20260808 02:30:50.374068 28249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:30:50.375185 28249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:30:50.376413 28249 hybrid_clock.cc:648] HybridClock initialized: now 1786156250376371 us; error 41 us; skew 500 ppm
I20260808 02:30:50.376842 28249 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:30:50 dist-test-slave-45dx krb5kdc[27639](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156250, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:30:50.384421 28249 init.cc:377] Logged in from keytab as kudu/127.24.116.195@KRBTEST.COM (short username kudu)
I20260808 02:30:50.385929 28249 webserver.cc:460] Webserver started at http://127.24.116.195:42221/ using document root <none> and password file <none>
I20260808 02:30:50.386615 28249 fs_manager.cc:359] Metadata directory not provided
I20260808 02:30:50.386761 28249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:30:50.387091 28249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:30:50.387926 28032 heartbeater.cc:503] Master 127.24.116.254:34851 was elected leader, sending a full tablet report...
I20260808 02:30:50.390317 28249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "ce2a187174c942719f006db95776a968"
format_stamp: "Formatted at 2026-08-08 02:30:50 on dist-test-slave-45dx"
server_key: "46177e05334b7a18b07b532ccaa259be"
server_key_iv: "180579843a14b3274ca8c77f71860b95"
server_key_version: "encryptionkey@0"
I20260808 02:30:50.391139 28249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "ce2a187174c942719f006db95776a968"
format_stamp: "Formatted at 2026-08-08 02:30:50 on dist-test-slave-45dx"
server_key: "46177e05334b7a18b07b532ccaa259be"
server_key_iv: "180579843a14b3274ca8c77f71860b95"
server_key_version: "encryptionkey@0"
I20260808 02:30:50.397106 28249 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260808 02:30:50.400751 28266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:50.402150 28249 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 02:30:50.402333 28249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "ce2a187174c942719f006db95776a968"
format_stamp: "Formatted at 2026-08-08 02:30:50 on dist-test-slave-45dx"
server_key: "46177e05334b7a18b07b532ccaa259be"
server_key_iv: "180579843a14b3274ca8c77f71860b95"
server_key_version: "encryptionkey@0"
I20260808 02:30:50.402563 28249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:30:50.431744 28249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:30:50.437107 28249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:30:50.437441 28249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:30:50.440189 28249 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:30:50.440347 28249 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:50.440495 28249 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:30:50.440586 28249 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 02:30:50 dist-test-slave-45dx krb5kdc[27639](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156250, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:30:50.466351 28283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:50.441111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:41297 (local address 127.24.116.254:34851)
0808 02:30:50.441628 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:50.441634 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:50.442945 (+ 1311us) server_negotiation.cc:407] Connection header received
0808 02:30:50.446416 (+ 3471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:50.446424 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:50.446521 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:50.446657 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:50.449489 (+ 2832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.450498 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.453759 (+ 3261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.454287 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.454437 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:50.458878 (+ 4441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:50.458882 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:50.458886 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:50.458919 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:50.462626 (+ 3707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:50.463587 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:50.463592 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:50.463595 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:50.463738 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:50.464209 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:50.464213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:50.464221 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:50.464550 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:50.464712 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:50.465688 (+ 976us) server_negotiation.cc:299] Negotiation successful
0808 02:30:50.465917 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":280,"threads_started":1}
I20260808 02:30:50.467459 28287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:50.441804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:34851 (local address 127.24.116.195:41297)
0808 02:30:50.442746 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:50.442802 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:50.445937 (+ 3135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:50.446988 (+ 1051us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:50.447004 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:50.448099 (+ 1095us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:30:50.449239 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:50.449287 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.450703 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.450711 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:50.453547 (+ 2836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:50.453572 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.454697 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.454703 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:50.454882 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:50.455664 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:30:50.455690 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:30:50.458627 (+ 2937us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:30:50.462801 (+ 4174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:50.462812 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:50.462838 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:50.463399 (+ 561us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:50.463860 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:50.463865 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:50.463869 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:50.464082 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:50.464698 (+ 616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:30:50.464708 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:30:50.465188 (+ 480us) client_negotiation.cc:769] Sending connection context
0808 02:30:50.465583 (+ 395us) client_negotiation.cc:240] Negotiation successful
0808 02:30:50.466157 (+ 574us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"thread_start_us":410,"threads_started":1}
I20260808 02:30:50.490188 28395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:50.473562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:34851 (local address 127.24.116.195:53243)
0808 02:30:50.474530 (+ 968us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:50.474560 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:50.474745 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:50.475157 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:50.475165 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:50.475945 (+ 780us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:30:50.476463 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:50.476481 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.477610 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.477619 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:50.479864 (+ 2245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:50.479885 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.480790 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.480798 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:50.480990 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:50.481917 (+ 927us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:30:50.481935 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:30:50.483198 (+ 1263us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:30:50.487000 (+ 3802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:50.487006 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:50.487010 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:50.487646 (+ 636us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:50.488150 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:50.488157 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:50.488163 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:50.488403 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:50.489126 (+ 723us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:30:50.489129 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:30:50.489378 (+ 249us) client_negotiation.cc:769] Sending connection context
0808 02:30:50.489579 (+ 201us) client_negotiation.cc:240] Negotiation successful
0808 02:30:50.489851 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"thread_start_us":669,"threads_started":1}
I20260808 02:30:50.490607 28283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:50.474005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:53243 (local address 127.24.116.254:34851)
0808 02:30:50.474213 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:50.474221 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:50.474667 (+ 446us) server_negotiation.cc:407] Connection header received
0808 02:30:50.474882 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:50.474886 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:50.475002 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:50.475090 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:50.476633 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.477458 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.480052 (+ 2594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.480548 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.480699 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:50.483422 (+ 2723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:50.483426 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:50.483430 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:50.483462 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:50.486856 (+ 3394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:50.487832 (+ 976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:50.487838 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:50.487842 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:50.487974 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:50.488511 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:50.488517 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:50.488521 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:50.488920 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:50.489074 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:50.489746 (+ 672us) server_negotiation.cc:299] Negotiation successful
0808 02:30:50.490074 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 02:30:50.497906 28249 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:37917
I20260808 02:30:50.497954 28453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:37917 every 8 connection(s)
I20260808 02:30:50.499168 28249 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:30:50.501309 28454 heartbeater.cc:347] Connected to a master server at 127.24.116.254:34851
I20260808 02:30:50.501513 28454 heartbeater.cc:464] Registering TS with master...
I20260808 02:30:50.502139 28454 heartbeater.cc:511] Master 127.24.116.254:34851 requested a full tablet report, sending...
I20260808 02:30:50.503448 27703 ts_manager.cc:194] Registered new tserver with Master: ce2a187174c942719f006db95776a968 (127.24.116.195:37917)
I20260808 02:30:50.504237 27703 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.195@KRBTEST.COM'} at 127.24.116.195:41297
I20260808 02:30:50.507946 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 28249
I20260808 02:30:50.508121 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:30:50.508674 25043 external_mini_cluster.cc:1428] Setting key 6c3d542f196150329a517906e0887394
I20260808 02:30:50.511792 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 02:30:50 dist-test-slave-45dx krb5kdc[27639](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156250, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 02:30:50 dist-test-slave-45dx krb5kdc[27639](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156250, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:30:50.567543 28283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:50.553111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45626 (local address 127.24.116.254:34851)
0808 02:30:50.553290 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:50.553295 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:50.553784 (+ 489us) server_negotiation.cc:407] Connection header received
0808 02:30:50.553955 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:50.553959 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:50.554037 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:50.554127 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:50.555565 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.556360 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.557594 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.558003 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.558106 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:50.562167 (+ 4061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:50.562172 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:50.562175 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:50.562211 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:50.564993 (+ 2782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:50.565697 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:50.565704 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:50.565708 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:50.565858 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:50.566338 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:50.566341 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:50.566343 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:50.566627 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:50.566882 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:50.567094 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 02:30:50.567267 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 02:30:50.572126 27703 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45626:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:30:50.579352 27703 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:30:50.607445 28470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:50.591859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:37917 (local address 127.0.0.1:36752)
0808 02:30:50.593042 (+ 1183us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:50.593163 (+ 121us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:50.593370 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:50.596527 (+ 3157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:50.596539 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:50.596584 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:30:50.597156 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:50.597173 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.601079 (+ 3906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.601084 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:50.603680 (+ 2596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:50.603705 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.606434 (+ 2729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.606442 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:50.606656 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:50.606720 (+ 64us) client_negotiation.cc:769] Sending connection context
0808 02:30:50.606833 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 02:30:50.607016 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":875,"thread_start_us":742,"threads_started":1}
I20260808 02:30:50.609064 28473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:50.592265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36752 (local address 127.24.116.195:37917)
0808 02:30:50.595597 (+ 3332us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:50.595610 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:50.595655 (+ 45us) server_negotiation.cc:407] Connection header received
0808 02:30:50.595781 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:50.595793 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:50.596121 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:50.597418 (+ 1297us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:30:50.597843 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.600071 (+ 2228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.603909 (+ 3838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.606150 (+ 2241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.608274 (+ 2124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:50.608481 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:50.608552 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 02:30:50.608741 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3099,"thread_start_us":2921,"threads_started":1}
I20260808 02:30:50.609193 28474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:50.592641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52006 (local address 127.24.116.194:44539)
0808 02:30:50.594613 (+ 1972us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:50.594626 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:50.600855 (+ 6229us) server_negotiation.cc:407] Connection header received
0808 02:30:50.601077 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:50.601085 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:50.601354 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:50.601550 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:30:50.602479 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.603874 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.606386 (+ 2512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.607779 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.607932 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:50.608133 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:50.608740 (+ 607us) server_negotiation.cc:299] Negotiation successful
0808 02:30:50.608917 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1799,"thread_start_us":1665,"threads_started":1}
I20260808 02:30:50.609941 28472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:50.592211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:44539 (local address 127.0.0.1:52006)
0808 02:30:50.600713 (+ 8502us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:50.600731 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:50.600884 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:50.601790 (+ 906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:50.601802 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:50.601834 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:30:50.602278 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:50.602289 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.604060 (+ 1771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.604065 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:50.606201 (+ 2136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:50.606218 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.608342 (+ 2124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.608348 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:50.608535 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:50.608568 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 02:30:50.609453 (+ 885us) client_negotiation.cc:240] Negotiation successful
0808 02:30:50.609606 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8362,"thread_start_us":8210,"threads_started":1}
I20260808 02:30:50.612835 28354 tablet_service.cc:1467] Processing CreateTablet for tablet 160f6b3840994c36a1b88478b7df297f (DEFAULT_TABLE table=test-table [id=522b0f1d8f26485baebe086cd15c8391]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:30:50.613409 28138 tablet_service.cc:1467] Processing CreateTablet for tablet 160f6b3840994c36a1b88478b7df297f (DEFAULT_TABLE table=test-table [id=522b0f1d8f26485baebe086cd15c8391]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:30:50.614418 28354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 160f6b3840994c36a1b88478b7df297f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:50.614779 28138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 160f6b3840994c36a1b88478b7df297f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:50.615407 28470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:50.594481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:34459 (local address 127.0.0.1:60924)
0808 02:30:50.607738 (+ 13257us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:50.607759 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:50.607871 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:50.608650 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:50.608658 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:50.608697 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:30:50.608939 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:50.608973 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.611033 (+ 2060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.611040 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:50.612881 (+ 1841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:50.612895 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.614658 (+ 1763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.614664 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:50.614873 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:50.614932 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 02:30:50.615004 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 02:30:50.615142 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13156,"thread_start_us":15150,"threads_started":1}
I20260808 02:30:50.616432 28479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:50.595076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60924 (local address 127.24.116.193:34459)
0808 02:30:50.607679 (+ 12603us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:50.607688 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:50.607940 (+ 252us) server_negotiation.cc:407] Connection header received
0808 02:30:50.608065 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:50.608072 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:50.608367 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:50.609223 (+ 856us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:30:50.609447 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.610810 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.613056 (+ 2246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.614463 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.615694 (+ 1231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:50.615863 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:50.615947 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 02:30:50.616106 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12414,"thread_start_us":12605,"threads_started":1}
I20260808 02:30:50.619969 27908 tablet_service.cc:1467] Processing CreateTablet for tablet 160f6b3840994c36a1b88478b7df297f (DEFAULT_TABLE table=test-table [id=522b0f1d8f26485baebe086cd15c8391]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:30:50.621946 27908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 160f6b3840994c36a1b88478b7df297f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:50.627558 28483 tablet_bootstrap.cc:492] T 160f6b3840994c36a1b88478b7df297f P ce2a187174c942719f006db95776a968: Bootstrap starting.
I20260808 02:30:50.629498 28484 tablet_bootstrap.cc:492] T 160f6b3840994c36a1b88478b7df297f P 199593e26c834084b7d52e7a01623f37: Bootstrap starting.
I20260808 02:30:50.631501 28483 tablet_bootstrap.cc:654] T 160f6b3840994c36a1b88478b7df297f P ce2a187174c942719f006db95776a968: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:50.632884 28484 tablet_bootstrap.cc:654] T 160f6b3840994c36a1b88478b7df297f P 199593e26c834084b7d52e7a01623f37: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:50.632951 28483 log.cc:824] T 160f6b3840994c36a1b88478b7df297f P ce2a187174c942719f006db95776a968: Log is configured to *not* fsync() on all Append() calls
I20260808 02:30:50.634038 28484 log.cc:824] T 160f6b3840994c36a1b88478b7df297f P 199593e26c834084b7d52e7a01623f37: Log is configured to *not* fsync() on all Append() calls
I20260808 02:30:50.636055 28483 tablet_bootstrap.cc:492] T 160f6b3840994c36a1b88478b7df297f P ce2a187174c942719f006db95776a968: No bootstrap required, opened a new log
I20260808 02:30:50.636479 28483 ts_tablet_manager.cc:1397] T 160f6b3840994c36a1b88478b7df297f P ce2a187174c942719f006db95776a968: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260808 02:30:50.636646 28489 tablet_bootstrap.cc:492] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc: Bootstrap starting.
I20260808 02:30:50.637133 28484 tablet_bootstrap.cc:492] T 160f6b3840994c36a1b88478b7df297f P 199593e26c834084b7d52e7a01623f37: No bootstrap required, opened a new log
I20260808 02:30:50.637405 28484 ts_tablet_manager.cc:1397] T 160f6b3840994c36a1b88478b7df297f P 199593e26c834084b7d52e7a01623f37: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260808 02:30:50.639818 28489 tablet_bootstrap.cc:654] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:50.640882 28489 log.cc:824] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc: Log is configured to *not* fsync() on all Append() calls
I20260808 02:30:50.643430 28489 tablet_bootstrap.cc:492] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc: No bootstrap required, opened a new log
I20260808 02:30:50.643692 28489 ts_tablet_manager.cc:1397] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 02:30:50.648414 28484 raft_consensus.cc:348] T 160f6b3840994c36a1b88478b7df297f P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } }
I20260808 02:30:50.648401 28483 raft_consensus.cc:348] T 160f6b3840994c36a1b88478b7df297f P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } }
I20260808 02:30:50.648864 28484 raft_consensus.cc:374] T 160f6b3840994c36a1b88478b7df297f P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:50.648864 28483 raft_consensus.cc:374] T 160f6b3840994c36a1b88478b7df297f P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:50.648979 28484 raft_consensus.cc:729] T 160f6b3840994c36a1b88478b7df297f P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 199593e26c834084b7d52e7a01623f37, State: Initialized, Role: FOLLOWER
I20260808 02:30:50.648973 28483 raft_consensus.cc:729] T 160f6b3840994c36a1b88478b7df297f P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce2a187174c942719f006db95776a968, State: Initialized, Role: FOLLOWER
I20260808 02:30:50.649616 28484 consensus_queue.cc:260] T 160f6b3840994c36a1b88478b7df297f P 199593e26c834084b7d52e7a01623f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } }
I20260808 02:30:50.649617 28483 consensus_queue.cc:260] T 160f6b3840994c36a1b88478b7df297f P ce2a187174c942719f006db95776a968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } }
I20260808 02:30:50.650904 28242 heartbeater.cc:503] Master 127.24.116.254:34851 was elected leader, sending a full tablet report...
I20260808 02:30:50.651396 28454 heartbeater.cc:503] Master 127.24.116.254:34851 was elected leader, sending a full tablet report...
I20260808 02:30:50.652104 28483 ts_tablet_manager.cc:1428] T 160f6b3840994c36a1b88478b7df297f P ce2a187174c942719f006db95776a968: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260808 02:30:50.653787 28484 ts_tablet_manager.cc:1428] T 160f6b3840994c36a1b88478b7df297f P 199593e26c834084b7d52e7a01623f37: Time spent starting tablet: real 0.016s user 0.010s sys 0.004s
I20260808 02:30:50.654091 28489 raft_consensus.cc:348] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } }
I20260808 02:30:50.654556 28489 raft_consensus.cc:374] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:50.654667 28489 raft_consensus.cc:729] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f25891bfc740d58c8572ed05539bdc, State: Initialized, Role: FOLLOWER
I20260808 02:30:50.655297 28489 consensus_queue.cc:260] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } }
I20260808 02:30:50.657059 28489 ts_tablet_manager.cc:1428] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc: Time spent starting tablet: real 0.013s user 0.009s sys 0.005s
W20260808 02:30:50.675204 28243 tablet.cc:2369] T 160f6b3840994c36a1b88478b7df297f P 199593e26c834084b7d52e7a01623f37: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:30:50.750946 28457 tablet.cc:2369] T 160f6b3840994c36a1b88478b7df297f P ce2a187174c942719f006db95776a968: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:30:50.880955 28033 tablet.cc:2369] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:30:50.974864 28500 raft_consensus.cc:482] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:30:50.975234 28500 raft_consensus.cc:504] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } }
I20260808 02:30:50.976976 28500 leader_election.cc:288] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce2a187174c942719f006db95776a968 (127.24.116.195:37917), 199593e26c834084b7d52e7a01623f37 (127.24.116.194:44539)
I20260808 02:30:50.986722 28473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:50.977480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:55555 (local address 127.24.116.195:37917)
0808 02:30:50.977682 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:50.977690 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:50.978536 (+ 846us) server_negotiation.cc:407] Connection header received
0808 02:30:50.978738 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:50.978743 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:50.978824 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:50.978932 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:30:50.979773 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.980927 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.984142 (+ 3215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.985448 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.985626 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:50.985709 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:50.986288 (+ 579us) server_negotiation.cc:299] Negotiation successful
0808 02:30:50.986432 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 02:30:50.986744 28474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:50.977715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:60779 (local address 127.24.116.194:44539)
0808 02:30:50.977899 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:50.977909 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:50.978536 (+ 627us) server_negotiation.cc:407] Connection header received
0808 02:30:50.978738 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:50.978744 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:50.978824 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:50.978942 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:30:50.979773 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.980940 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.984143 (+ 3203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.985448 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.985626 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:50.985709 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:50.986288 (+ 579us) server_negotiation.cc:299] Negotiation successful
0808 02:30:50.986429 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 02:30:50.987164 28503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:50.977554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:37917 (local address 127.24.116.193:55555)
0808 02:30:50.978419 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:50.978438 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:50.978587 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:50.978983 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:50.978989 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:50.979026 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:30:50.979558 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:50.979578 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.981090 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.981095 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:50.983943 (+ 2848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:50.983961 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.985769 (+ 1808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.985777 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:50.986062 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:50.986141 (+ 79us) client_negotiation.cc:769] Sending connection context
0808 02:30:50.986247 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 02:30:50.986453 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":748,"mutex_wait_us":356,"spinlock_wait_cycles":24704,"thread_start_us":429,"threads_started":1}
I20260808 02:30:50.987205 28504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:50.977469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:44539 (local address 127.24.116.193:60779)
0808 02:30:50.978377 (+ 908us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:50.978408 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:50.978587 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:50.978984 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:50.978989 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:50.979024 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:30:50.979638 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:50.979647 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.981089 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.981095 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:50.983943 (+ 2848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:50.983963 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:50.985780 (+ 1817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:50.985785 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:50.986045 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:50.986136 (+ 91us) client_negotiation.cc:769] Sending connection context
0808 02:30:50.986247 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 02:30:50.986453 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":741,"mutex_wait_us":309,"spinlock_wait_cycles":15744,"thread_start_us":618,"threads_started":1}
I20260808 02:30:50.988257 28388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "160f6b3840994c36a1b88478b7df297f" candidate_uuid: "b2f25891bfc740d58c8572ed05539bdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce2a187174c942719f006db95776a968" is_pre_election: true
I20260808 02:30:50.988269 28181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "160f6b3840994c36a1b88478b7df297f" candidate_uuid: "b2f25891bfc740d58c8572ed05539bdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "199593e26c834084b7d52e7a01623f37" is_pre_election: true
I20260808 02:30:50.988790 28388 raft_consensus.cc:2454] T 160f6b3840994c36a1b88478b7df297f P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2f25891bfc740d58c8572ed05539bdc in term 0.
I20260808 02:30:50.988811 28181 raft_consensus.cc:2454] T 160f6b3840994c36a1b88478b7df297f P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2f25891bfc740d58c8572ed05539bdc in term 0.
I20260808 02:30:50.989463 27835 leader_election.cc:302] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 199593e26c834084b7d52e7a01623f37, b2f25891bfc740d58c8572ed05539bdc, ce2a187174c942719f006db95776a968; no voters:
I20260808 02:30:50.989871 28500 raft_consensus.cc:2781] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:30:50.990032 28500 raft_consensus.cc:482] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:30:50.990154 28500 raft_consensus.cc:3037] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:50.992561 28500 raft_consensus.cc:504] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } }
I20260808 02:30:50.993240 28500 leader_election.cc:288] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc [CANDIDATE]: Term 1 election: Requested vote from peers ce2a187174c942719f006db95776a968 (127.24.116.195:37917), 199593e26c834084b7d52e7a01623f37 (127.24.116.194:44539)
I20260808 02:30:50.993667 28388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "160f6b3840994c36a1b88478b7df297f" candidate_uuid: "b2f25891bfc740d58c8572ed05539bdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce2a187174c942719f006db95776a968"
I20260808 02:30:50.993702 28181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "160f6b3840994c36a1b88478b7df297f" candidate_uuid: "b2f25891bfc740d58c8572ed05539bdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "199593e26c834084b7d52e7a01623f37"
I20260808 02:30:50.993892 28388 raft_consensus.cc:3037] T 160f6b3840994c36a1b88478b7df297f P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:50.993920 28181 raft_consensus.cc:3037] T 160f6b3840994c36a1b88478b7df297f P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:50.996145 28388 raft_consensus.cc:2454] T 160f6b3840994c36a1b88478b7df297f P ce2a187174c942719f006db95776a968 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2f25891bfc740d58c8572ed05539bdc in term 1.
I20260808 02:30:50.996232 28181 raft_consensus.cc:2454] T 160f6b3840994c36a1b88478b7df297f P 199593e26c834084b7d52e7a01623f37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2f25891bfc740d58c8572ed05539bdc in term 1.
I20260808 02:30:50.996647 27835 leader_election.cc:302] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2f25891bfc740d58c8572ed05539bdc, ce2a187174c942719f006db95776a968; no voters:
I20260808 02:30:50.997041 28500 raft_consensus.cc:2781] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:30:50.997422 28500 raft_consensus.cc:686] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc [term 1 LEADER]: Becoming Leader. State: Replica: b2f25891bfc740d58c8572ed05539bdc, State: Running, Role: LEADER
I20260808 02:30:50.997890 28500 consensus_queue.cc:237] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } }
I20260808 02:30:51.002640 27702 catalog_manager.cc:5495] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc reported cstate change: term changed from 0 to 1, leader changed from <none> to b2f25891bfc740d58c8572ed05539bdc (127.24.116.193). New cstate: current_term: 1 leader_uuid: "b2f25891bfc740d58c8572ed05539bdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } health_report { overall_health: HEALTHY } } }
Aug 08 02:30:51 dist-test-slave-45dx krb5kdc[27639](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156248, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:30:51.096644 28514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:51.082465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:34851 (local address 127.0.0.1:45638)
0808 02:30:51.083287 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:51.083308 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:51.083462 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:51.083789 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:51.083796 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:51.084646 (+ 850us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:30:51.084904 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:51.084914 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.086018 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.086024 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:51.086986 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:51.086998 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.087717 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.087725 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:51.087913 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:51.088698 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:30:51.088719 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:30:51.090909 (+ 2190us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:30:51.093938 (+ 3029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:51.093953 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:51.093962 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:51.094365 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:51.094749 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:51.094755 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:51.094759 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:51.094895 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:51.095499 (+ 604us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:30:51.095508 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:30:51.095688 (+ 180us) client_negotiation.cc:769] Sending connection context
0808 02:30:51.095853 (+ 165us) client_negotiation.cc:240] Negotiation successful
0808 02:30:51.096144 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":365,"threads_started":1}
I20260808 02:30:51.096688 28513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:51.082471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45638 (local address 127.24.116.254:34851)
0808 02:30:51.083287 (+ 816us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:51.083293 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:51.083373 (+ 80us) server_negotiation.cc:407] Connection header received
0808 02:30:51.083581 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:51.083585 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:51.083646 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:51.083755 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:51.085081 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.085874 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.087126 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.087529 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.087655 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:51.091118 (+ 3463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:51.091123 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:51.091126 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:51.091179 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:51.093790 (+ 2611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:51.094502 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:51.094508 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:51.094511 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:51.094641 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:51.095010 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:51.095016 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:51.095019 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:51.095320 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:51.095501 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:51.095941 (+ 440us) server_negotiation.cc:299] Negotiation successful
0808 02:30:51.096280 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":139,"server-negotiator.queue_time_us":706,"thread_start_us":429,"threads_started":1}
I20260808 02:30:51.101696 27702 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:45638:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 02:30:51.102702 27702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:30:51.109500 28138 tablet_service.cc:1467] Processing CreateTablet for tablet d8ac713146bf4752a70d956f4f0e1cd4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5a806c203b3f4067b431ae6e9c8e05f7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 02:30:51.109431 27908 tablet_service.cc:1467] Processing CreateTablet for tablet d8ac713146bf4752a70d956f4f0e1cd4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5a806c203b3f4067b431ae6e9c8e05f7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 02:30:51.109804 28354 tablet_service.cc:1467] Processing CreateTablet for tablet d8ac713146bf4752a70d956f4f0e1cd4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5a806c203b3f4067b431ae6e9c8e05f7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 02:30:51.110462 28138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8ac713146bf4752a70d956f4f0e1cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:51.110477 27908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8ac713146bf4752a70d956f4f0e1cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:51.110533 28354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8ac713146bf4752a70d956f4f0e1cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:51.115803 28484 tablet_bootstrap.cc:492] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37: Bootstrap starting.
I20260808 02:30:51.117223 28484 tablet_bootstrap.cc:654] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:51.117728 28489 tablet_bootstrap.cc:492] T d8ac713146bf4752a70d956f4f0e1cd4 P b2f25891bfc740d58c8572ed05539bdc: Bootstrap starting.
I20260808 02:30:51.119055 28483 tablet_bootstrap.cc:492] T d8ac713146bf4752a70d956f4f0e1cd4 P ce2a187174c942719f006db95776a968: Bootstrap starting.
I20260808 02:30:51.119482 28489 tablet_bootstrap.cc:654] T d8ac713146bf4752a70d956f4f0e1cd4 P b2f25891bfc740d58c8572ed05539bdc: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:51.119720 28484 tablet_bootstrap.cc:492] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37: No bootstrap required, opened a new log
I20260808 02:30:51.119889 28484 ts_tablet_manager.cc:1397] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 02:30:51.120863 28483 tablet_bootstrap.cc:654] T d8ac713146bf4752a70d956f4f0e1cd4 P ce2a187174c942719f006db95776a968: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:51.120656 28484 raft_consensus.cc:348] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:51.120965 28484 raft_consensus.cc:374] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:51.121083 28484 raft_consensus.cc:729] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 199593e26c834084b7d52e7a01623f37, State: Initialized, Role: FOLLOWER
I20260808 02:30:51.121389 28484 consensus_queue.cc:260] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:51.121821 28489 tablet_bootstrap.cc:492] T d8ac713146bf4752a70d956f4f0e1cd4 P b2f25891bfc740d58c8572ed05539bdc: No bootstrap required, opened a new log
I20260808 02:30:51.121975 28489 ts_tablet_manager.cc:1397] T d8ac713146bf4752a70d956f4f0e1cd4 P b2f25891bfc740d58c8572ed05539bdc: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.003s
I20260808 02:30:51.122058 28484 ts_tablet_manager.cc:1428] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 02:30:51.121874 28491 tablet_replica.cc:439] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } } }
I20260808 02:30:51.122517 28491 tablet_replica.cc:442] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:30:51.122828 28489 raft_consensus.cc:348] T d8ac713146bf4752a70d956f4f0e1cd4 P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:51.123153 28489 raft_consensus.cc:374] T d8ac713146bf4752a70d956f4f0e1cd4 P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:51.123268 28489 raft_consensus.cc:729] T d8ac713146bf4752a70d956f4f0e1cd4 P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f25891bfc740d58c8572ed05539bdc, State: Initialized, Role: FOLLOWER
I20260808 02:30:51.123567 28489 consensus_queue.cc:260] T d8ac713146bf4752a70d956f4f0e1cd4 P b2f25891bfc740d58c8572ed05539bdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:51.124336 28489 ts_tablet_manager.cc:1428] T d8ac713146bf4752a70d956f4f0e1cd4 P b2f25891bfc740d58c8572ed05539bdc: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 02:30:51.124142 28500 tablet_replica.cc:439] T d8ac713146bf4752a70d956f4f0e1cd4 P b2f25891bfc740d58c8572ed05539bdc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } } }
I20260808 02:30:51.124513 28500 tablet_replica.cc:442] T d8ac713146bf4752a70d956f4f0e1cd4 P b2f25891bfc740d58c8572ed05539bdc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:30:51.126250 28483 tablet_bootstrap.cc:492] T d8ac713146bf4752a70d956f4f0e1cd4 P ce2a187174c942719f006db95776a968: No bootstrap required, opened a new log
I20260808 02:30:51.126420 28483 ts_tablet_manager.cc:1397] T d8ac713146bf4752a70d956f4f0e1cd4 P ce2a187174c942719f006db95776a968: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.002s
I20260808 02:30:51.127233 28483 raft_consensus.cc:348] T d8ac713146bf4752a70d956f4f0e1cd4 P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:51.127488 28483 raft_consensus.cc:374] T d8ac713146bf4752a70d956f4f0e1cd4 P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:51.127610 28483 raft_consensus.cc:729] T d8ac713146bf4752a70d956f4f0e1cd4 P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce2a187174c942719f006db95776a968, State: Initialized, Role: FOLLOWER
I20260808 02:30:51.127862 28483 consensus_queue.cc:260] T d8ac713146bf4752a70d956f4f0e1cd4 P ce2a187174c942719f006db95776a968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:51.128541 28483 ts_tablet_manager.cc:1428] T d8ac713146bf4752a70d956f4f0e1cd4 P ce2a187174c942719f006db95776a968: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 02:30:51.128458 28497 tablet_replica.cc:439] T d8ac713146bf4752a70d956f4f0e1cd4 P ce2a187174c942719f006db95776a968: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } } }
I20260808 02:30:51.128840 28497 tablet_replica.cc:442] T d8ac713146bf4752a70d956f4f0e1cd4 P ce2a187174c942719f006db95776a968: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:30:51.147709 28491 raft_consensus.cc:482] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:30:51.147950 28491 raft_consensus.cc:504] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:51.149622 28491 leader_election.cc:288] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2f25891bfc740d58c8572ed05539bdc (127.24.116.193:34459), ce2a187174c942719f006db95776a968 (127.24.116.195:37917)
I20260808 02:30:51.158370 28473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:51.150068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:50599 (local address 127.24.116.195:37917)
0808 02:30:51.150275 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:51.150281 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:51.150829 (+ 548us) server_negotiation.cc:407] Connection header received
0808 02:30:51.150960 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:51.150964 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:51.151034 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:51.151126 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:30:51.151870 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.153005 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.156087 (+ 3082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.157336 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.157497 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:51.157579 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:51.157953 (+ 374us) server_negotiation.cc:299] Negotiation successful
0808 02:30:51.158105 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 02:30:51.158406 28521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:51.149840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:37917 (local address 127.24.116.194:50599)
0808 02:30:51.150716 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:51.150731 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:51.150831 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:51.151159 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:51.151164 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:51.151191 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:30:51.151695 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:51.151710 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.153134 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.153140 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:51.155918 (+ 2778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:51.155934 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.157619 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.157624 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:51.157749 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:51.157795 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 02:30:51.157870 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 02:30:51.157966 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":747,"mutex_wait_us":193,"thread_start_us":567,"threads_started":1}
I20260808 02:30:51.158706 28520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:51.149840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:34459 (local address 127.24.116.194:56261)
0808 02:30:51.150457 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:51.150481 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:51.150633 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:51.151159 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:51.151163 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:51.151223 (+ 60us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:30:51.151660 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:51.151679 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.153136 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.153140 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:51.155918 (+ 2778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:51.155934 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.157743 (+ 1809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.157748 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:51.157929 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:51.157963 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 02:30:51.158064 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 02:30:51.158194 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"mutex_wait_us":189,"spinlock_wait_cycles":32640,"thread_start_us":345,"threads_started":1}
I20260808 02:30:51.159094 28388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8ac713146bf4752a70d956f4f0e1cd4" candidate_uuid: "199593e26c834084b7d52e7a01623f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce2a187174c942719f006db95776a968" is_pre_election: true
I20260808 02:30:51.159199 28522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:51.150230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:56261 (local address 127.24.116.193:34459)
0808 02:30:51.150831 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:51.150836 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:51.150856 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:30:51.150929 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:51.150934 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:51.151008 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:51.151122 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:30:51.151870 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.152998 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.156087 (+ 3089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.157365 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.157518 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:51.157586 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:51.158112 (+ 526us) server_negotiation.cc:299] Negotiation successful
0808 02:30:51.158258 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":488,"thread_start_us":432,"threads_started":1}
I20260808 02:30:51.159392 28388 raft_consensus.cc:2454] T d8ac713146bf4752a70d956f4f0e1cd4 P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 199593e26c834084b7d52e7a01623f37 in term 0.
I20260808 02:30:51.159894 28065 leader_election.cc:302] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 199593e26c834084b7d52e7a01623f37, ce2a187174c942719f006db95776a968; no voters:
I20260808 02:30:51.160329 28491 raft_consensus.cc:2781] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:30:51.160138 27958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8ac713146bf4752a70d956f4f0e1cd4" candidate_uuid: "199593e26c834084b7d52e7a01623f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f25891bfc740d58c8572ed05539bdc" is_pre_election: true
I20260808 02:30:51.160475 28491 raft_consensus.cc:482] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:30:51.160583 28491 raft_consensus.cc:3037] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:51.160619 27958 raft_consensus.cc:2454] T d8ac713146bf4752a70d956f4f0e1cd4 P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 199593e26c834084b7d52e7a01623f37 in term 0.
I20260808 02:30:51.162835 28491 raft_consensus.cc:504] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:51.163347 28491 leader_election.cc:288] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37 [CANDIDATE]: Term 1 election: Requested vote from peers b2f25891bfc740d58c8572ed05539bdc (127.24.116.193:34459), ce2a187174c942719f006db95776a968 (127.24.116.195:37917)
I20260808 02:30:51.163815 28388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8ac713146bf4752a70d956f4f0e1cd4" candidate_uuid: "199593e26c834084b7d52e7a01623f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce2a187174c942719f006db95776a968"
I20260808 02:30:51.164026 28388 raft_consensus.cc:3037] T d8ac713146bf4752a70d956f4f0e1cd4 P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:51.164527 27958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8ac713146bf4752a70d956f4f0e1cd4" candidate_uuid: "199593e26c834084b7d52e7a01623f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f25891bfc740d58c8572ed05539bdc"
I20260808 02:30:51.164731 27958 raft_consensus.cc:3037] T d8ac713146bf4752a70d956f4f0e1cd4 P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:51.167019 28388 raft_consensus.cc:2454] T d8ac713146bf4752a70d956f4f0e1cd4 P ce2a187174c942719f006db95776a968 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 199593e26c834084b7d52e7a01623f37 in term 1.
I20260808 02:30:51.167425 28065 leader_election.cc:302] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 199593e26c834084b7d52e7a01623f37, ce2a187174c942719f006db95776a968; no voters:
I20260808 02:30:51.167723 27958 raft_consensus.cc:2454] T d8ac713146bf4752a70d956f4f0e1cd4 P b2f25891bfc740d58c8572ed05539bdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 199593e26c834084b7d52e7a01623f37 in term 1.
I20260808 02:30:51.168067 28491 raft_consensus.cc:2781] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:30:51.168563 28491 raft_consensus.cc:686] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37 [term 1 LEADER]: Becoming Leader. State: Replica: 199593e26c834084b7d52e7a01623f37, State: Running, Role: LEADER
I20260808 02:30:51.169080 28491 consensus_queue.cc:237] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:51.172416 28523 tablet_replica.cc:439] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37: TxnStatusTablet state changed. Reason: New leader 199593e26c834084b7d52e7a01623f37. Latest consensus state: current_term: 1 leader_uuid: "199593e26c834084b7d52e7a01623f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } } }
I20260808 02:30:51.172755 28523 tablet_replica.cc:442] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37: This TxnStatusTablet replica's current role is: LEADER
I20260808 02:30:51.173557 28530 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 02:30:51.173815 28530 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 02:30:51.174319 27703 catalog_manager.cc:5495] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 199593e26c834084b7d52e7a01623f37 (127.24.116.194). New cstate: current_term: 1 leader_uuid: "199593e26c834084b7d52e7a01623f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } health_report { overall_health: UNKNOWN } } }
I20260808 02:30:51.203207 28514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:51.197222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:44539 (local address 127.0.0.1:52008)
0808 02:30:51.197462 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:51.197486 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:51.197643 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:51.198107 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:51.198112 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:51.198126 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:30:51.198310 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:51.198319 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.199455 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.199462 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:51.200586 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:51.200614 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.201378 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.201385 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:51.201592 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:51.201655 (+ 63us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:30:51.202596 (+ 941us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:30:51.202621 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 02:30:51.202714 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 02:30:51.202896 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 02:30:51.203193 28474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:51.197284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52008 (local address 127.24.116.194:44539)
0808 02:30:51.197462 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:51.197470 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:51.197572 (+ 102us) server_negotiation.cc:407] Connection header received
0808 02:30:51.197823 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:51.197832 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:51.197916 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:51.198068 (+ 152us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:30:51.198457 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.199294 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.200744 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.201212 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.201382 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:51.201875 (+ 493us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:30:51.202472 (+ 597us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:30:51.202654 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:51.202739 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 02:30:51.202827 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 02:30:51.212607 28388 raft_consensus.cc:1261] T d8ac713146bf4752a70d956f4f0e1cd4 P ce2a187174c942719f006db95776a968 [term 1 FOLLOWER]: Refusing update from remote peer 199593e26c834084b7d52e7a01623f37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:30:51.212586 27958 raft_consensus.cc:1261] T d8ac713146bf4752a70d956f4f0e1cd4 P b2f25891bfc740d58c8572ed05539bdc [term 1 FOLLOWER]: Refusing update from remote peer 199593e26c834084b7d52e7a01623f37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:30:51.213609 28523 consensus_queue.cc:1035] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:30:51.214048 28491 consensus_queue.cc:1035] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:30:51.221674 28497 tablet_replica.cc:439] T d8ac713146bf4752a70d956f4f0e1cd4 P ce2a187174c942719f006db95776a968: TxnStatusTablet state changed. Reason: New leader 199593e26c834084b7d52e7a01623f37. Latest consensus state: current_term: 1 leader_uuid: "199593e26c834084b7d52e7a01623f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } } }
I20260808 02:30:51.221998 28497 tablet_replica.cc:442] T d8ac713146bf4752a70d956f4f0e1cd4 P ce2a187174c942719f006db95776a968: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:30:51.224992 28534 mvcc.cc:205] Tried to move back new op lower bound from 7316096004956332032 to 7316096004792336384. Current Snapshot: MvccSnapshot[applied={T|T < 7316096004956332032}]
I20260808 02:30:51.233047 28500 tablet_replica.cc:439] T d8ac713146bf4752a70d956f4f0e1cd4 P b2f25891bfc740d58c8572ed05539bdc: TxnStatusTablet state changed. Reason: New leader 199593e26c834084b7d52e7a01623f37. Latest consensus state: current_term: 1 leader_uuid: "199593e26c834084b7d52e7a01623f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } } }
I20260808 02:30:51.233568 28500 tablet_replica.cc:442] T d8ac713146bf4752a70d956f4f0e1cd4 P b2f25891bfc740d58c8572ed05539bdc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:30:51.236924 28491 tablet_replica.cc:439] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "199593e26c834084b7d52e7a01623f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } } }
I20260808 02:30:51.237324 28491 tablet_replica.cc:442] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37: This TxnStatusTablet replica's current role is: LEADER
I20260808 02:30:51.238418 28497 tablet_replica.cc:439] T d8ac713146bf4752a70d956f4f0e1cd4 P ce2a187174c942719f006db95776a968: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "199593e26c834084b7d52e7a01623f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } } }
I20260808 02:30:51.238658 28497 tablet_replica.cc:442] T d8ac713146bf4752a70d956f4f0e1cd4 P ce2a187174c942719f006db95776a968: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:30:51.241233 28491 tablet_replica.cc:439] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "199593e26c834084b7d52e7a01623f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } } }
I20260808 02:30:51.241497 28491 tablet_replica.cc:442] T d8ac713146bf4752a70d956f4f0e1cd4 P 199593e26c834084b7d52e7a01623f37: This TxnStatusTablet replica's current role is: LEADER
I20260808 02:30:51.243000 28500 tablet_replica.cc:439] T d8ac713146bf4752a70d956f4f0e1cd4 P b2f25891bfc740d58c8572ed05539bdc: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "199593e26c834084b7d52e7a01623f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } } }
I20260808 02:30:51.243327 28500 tablet_replica.cc:442] T d8ac713146bf4752a70d956f4f0e1cd4 P b2f25891bfc740d58c8572ed05539bdc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:30:51.257053 28522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:51.250161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60932 (local address 127.24.116.193:34459)
0808 02:30:51.250371 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:51.250386 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:51.250925 (+ 539us) server_negotiation.cc:407] Connection header received
0808 02:30:51.251168 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:51.251174 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:51.251274 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:51.251445 (+ 171us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:30:51.251855 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.253041 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.254544 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.255172 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.255299 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:51.255697 (+ 398us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:30:51.256400 (+ 703us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:30:51.256563 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:51.256654 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 02:30:51.256741 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 02:30:51.277251 28474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:51.271216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:42025 (local address 127.24.116.194:44539)
0808 02:30:51.271412 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:51.271417 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:51.271981 (+ 564us) server_negotiation.cc:407] Connection header received
0808 02:30:51.272196 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:51.272202 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:51.272289 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:51.272447 (+ 158us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:30:51.272961 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.273875 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.275364 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.275803 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.275955 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:51.276459 (+ 504us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:30:51.276598 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:30:51.276700 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:51.276833 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 02:30:51.276946 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 02:30:51.277280 28557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:51.271233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:44539 (local address 127.24.116.193:42025)
0808 02:30:51.271857 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:51.271873 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:51.272057 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:51.272462 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:51.272467 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:51.272479 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:30:51.272808 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:51.272816 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.274002 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.274009 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:51.275208 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:51.275220 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.275998 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.276006 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:51.276136 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:51.276191 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:30:51.276708 (+ 517us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:30:51.276716 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 02:30:51.276779 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 02:30:51.276880 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":358,"threads_started":1}
I20260808 02:30:51.288833 28388 raft_consensus.cc:1261] T 160f6b3840994c36a1b88478b7df297f P ce2a187174c942719f006db95776a968 [term 1 FOLLOWER]: Refusing update from remote peer b2f25891bfc740d58c8572ed05539bdc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:30:51.289223 28181 raft_consensus.cc:1261] T 160f6b3840994c36a1b88478b7df297f P 199593e26c834084b7d52e7a01623f37 [term 1 FOLLOWER]: Refusing update from remote peer b2f25891bfc740d58c8572ed05539bdc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:30:51.289644 28505 consensus_queue.cc:1035] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:30:51.290033 28500 consensus_queue.cc:1035] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:30:51.303787 28538 mvcc.cc:205] Tried to move back new op lower bound from 7316096005270740992 to 7316096004090757120. Current Snapshot: MvccSnapshot[applied={T|T < 7316096005270740992}]
I20260808 02:30:51.339140 28522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:51.332106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:57333 (local address 127.24.116.193:34459)
0808 02:30:51.332368 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:51.332377 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:51.333078 (+ 701us) server_negotiation.cc:407] Connection header received
0808 02:30:51.333286 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:51.333292 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:51.333410 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:51.333501 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:30:51.334306 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.335349 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.337035 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.337590 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.337684 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:51.338327 (+ 643us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:30:51.338445 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:30:51.338545 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:51.338712 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 02:30:51.338799 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 02:30:51.339805 28565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:51.332037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:34459 (local address 127.24.116.194:57333)
0808 02:30:51.332959 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:51.332983 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:51.333137 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:51.333674 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:51.333679 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:51.333692 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:30:51.334139 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:51.334150 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.335494 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.335499 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:51.336833 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:51.336846 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.337925 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.337935 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:51.338087 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:51.338145 (+ 58us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:30:51.338546 (+ 401us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:30:51.338565 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 02:30:51.339363 (+ 798us) client_negotiation.cc:240] Negotiation successful
0808 02:30:51.339481 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":717,"thread_start_us":562,"threads_started":1}
I20260808 02:30:51.384766 27701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45626:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:30:51.385135 27701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45626:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:30:51.389997 27701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747: Sending DeleteTablet for 3 replicas of tablet 160f6b3840994c36a1b88478b7df297f
I20260808 02:30:51.391355 28354 tablet_service.cc:1514] Processing DeleteTablet for tablet 160f6b3840994c36a1b88478b7df297f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:30:51 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:36752
I20260808 02:30:51.398263 28138 tablet_service.cc:1514] Processing DeleteTablet for tablet 160f6b3840994c36a1b88478b7df297f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:30:51 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:52006
I20260808 02:30:51.398720 27908 tablet_service.cc:1514] Processing DeleteTablet for tablet 160f6b3840994c36a1b88478b7df297f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:30:51 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:60924
I20260808 02:30:51.410440 27703 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45626:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:30:51.411195 27703 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:30:51.417479 28572 tablet_replica.cc:330] T 160f6b3840994c36a1b88478b7df297f P 199593e26c834084b7d52e7a01623f37: stopping tablet replica
I20260808 02:30:51.417994 28572 raft_consensus.cc:2229] T 160f6b3840994c36a1b88478b7df297f P 199593e26c834084b7d52e7a01623f37 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:30:51.418386 28572 raft_consensus.cc:2258] T 160f6b3840994c36a1b88478b7df297f P 199593e26c834084b7d52e7a01623f37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:30:51.421144 28351 tablet_service.cc:1467] Processing CreateTablet for tablet 58d133a04e7a4f548b4d21ead2758db5 (DEFAULT_TABLE table=test-table [id=830ce85d369e420dbf0650eb61a98a92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:30:51.421550 27906 tablet_service.cc:1467] Processing CreateTablet for tablet 58d133a04e7a4f548b4d21ead2758db5 (DEFAULT_TABLE table=test-table [id=830ce85d369e420dbf0650eb61a98a92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:30:51.421798 28351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58d133a04e7a4f548b4d21ead2758db5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:51.422094 27906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58d133a04e7a4f548b4d21ead2758db5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:51.423528 28138 tablet_service.cc:1467] Processing CreateTablet for tablet 58d133a04e7a4f548b4d21ead2758db5 (DEFAULT_TABLE table=test-table [id=830ce85d369e420dbf0650eb61a98a92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:30:51.424060 28138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58d133a04e7a4f548b4d21ead2758db5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:51.428745 28483 tablet_bootstrap.cc:492] T 58d133a04e7a4f548b4d21ead2758db5 P ce2a187174c942719f006db95776a968: Bootstrap starting.
I20260808 02:30:51.429004 28489 tablet_bootstrap.cc:492] T 58d133a04e7a4f548b4d21ead2758db5 P b2f25891bfc740d58c8572ed05539bdc: Bootstrap starting.
I20260808 02:30:51.430482 28483 tablet_bootstrap.cc:654] T 58d133a04e7a4f548b4d21ead2758db5 P ce2a187174c942719f006db95776a968: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:51.430629 28489 tablet_bootstrap.cc:654] T 58d133a04e7a4f548b4d21ead2758db5 P b2f25891bfc740d58c8572ed05539bdc: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:51.437618 28572 ts_tablet_manager.cc:1905] T 160f6b3840994c36a1b88478b7df297f P 199593e26c834084b7d52e7a01623f37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:30:51.441224 28484 tablet_bootstrap.cc:492] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37: Bootstrap starting.
I20260808 02:30:51.443300 28484 tablet_bootstrap.cc:654] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:51.443697 28575 tablet_replica.cc:330] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc: stopping tablet replica
I20260808 02:30:51.444886 28575 raft_consensus.cc:2229] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:30:51.445477 28571 tablet_replica.cc:330] T 160f6b3840994c36a1b88478b7df297f P ce2a187174c942719f006db95776a968: stopping tablet replica
I20260808 02:30:51.445978 28571 raft_consensus.cc:2229] T 160f6b3840994c36a1b88478b7df297f P ce2a187174c942719f006db95776a968 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:30:51.446822 28571 raft_consensus.cc:2258] T 160f6b3840994c36a1b88478b7df297f P ce2a187174c942719f006db95776a968 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:30:51.447142 28575 raft_consensus.cc:2258] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:30:51.447091 28483 tablet_bootstrap.cc:492] T 58d133a04e7a4f548b4d21ead2758db5 P ce2a187174c942719f006db95776a968: No bootstrap required, opened a new log
I20260808 02:30:51.447535 28483 ts_tablet_manager.cc:1397] T 58d133a04e7a4f548b4d21ead2758db5 P ce2a187174c942719f006db95776a968: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.004s
I20260808 02:30:51.448762 28483 raft_consensus.cc:348] T 58d133a04e7a4f548b4d21ead2758db5 P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:51.449041 28483 raft_consensus.cc:374] T 58d133a04e7a4f548b4d21ead2758db5 P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:51.449120 28483 raft_consensus.cc:729] T 58d133a04e7a4f548b4d21ead2758db5 P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce2a187174c942719f006db95776a968, State: Initialized, Role: FOLLOWER
I20260808 02:30:51.449455 28483 consensus_queue.cc:260] T 58d133a04e7a4f548b4d21ead2758db5 P ce2a187174c942719f006db95776a968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:51.450173 28483 ts_tablet_manager.cc:1428] T 58d133a04e7a4f548b4d21ead2758db5 P ce2a187174c942719f006db95776a968: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 02:30:51.451045 28575 ts_tablet_manager.cc:1905] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:30:51.451787 28571 ts_tablet_manager.cc:1905] T 160f6b3840994c36a1b88478b7df297f P ce2a187174c942719f006db95776a968: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:30:51.466111 28484 tablet_bootstrap.cc:492] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37: No bootstrap required, opened a new log
I20260808 02:30:51.466353 28484 ts_tablet_manager.cc:1397] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37: Time spent bootstrapping tablet: real 0.025s user 0.014s sys 0.000s
I20260808 02:30:51.467284 28484 raft_consensus.cc:348] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:51.467568 28484 raft_consensus.cc:374] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:51.467675 28484 raft_consensus.cc:729] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 199593e26c834084b7d52e7a01623f37, State: Initialized, Role: FOLLOWER
I20260808 02:30:51.467976 28484 consensus_queue.cc:260] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:51.468777 28489 tablet_bootstrap.cc:492] T 58d133a04e7a4f548b4d21ead2758db5 P b2f25891bfc740d58c8572ed05539bdc: No bootstrap required, opened a new log
I20260808 02:30:51.469033 28489 ts_tablet_manager.cc:1397] T 58d133a04e7a4f548b4d21ead2758db5 P b2f25891bfc740d58c8572ed05539bdc: Time spent bootstrapping tablet: real 0.040s user 0.008s sys 0.002s
I20260808 02:30:51.469695 28571 ts_tablet_manager.cc:1918] T 160f6b3840994c36a1b88478b7df297f P ce2a187174c942719f006db95776a968: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:30:51.469743 28484 ts_tablet_manager.cc:1428] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 02:30:51.471158 28571 log.cc:1196] T 160f6b3840994c36a1b88478b7df297f P ce2a187174c942719f006db95776a968: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/160f6b3840994c36a1b88478b7df297f
I20260808 02:30:51.471899 28571 ts_tablet_manager.cc:1939] T 160f6b3840994c36a1b88478b7df297f P ce2a187174c942719f006db95776a968: Deleting consensus metadata
I20260808 02:30:51.474151 27682 catalog_manager.cc:4841] TS ce2a187174c942719f006db95776a968 (127.24.116.195:37917): tablet 160f6b3840994c36a1b88478b7df297f (table test-table [id=522b0f1d8f26485baebe086cd15c8391]) successfully deleted
I20260808 02:30:51.476364 28489 raft_consensus.cc:348] T 58d133a04e7a4f548b4d21ead2758db5 P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:51.476878 28572 ts_tablet_manager.cc:1918] T 160f6b3840994c36a1b88478b7df297f P 199593e26c834084b7d52e7a01623f37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:30:51.476912 28489 raft_consensus.cc:374] T 58d133a04e7a4f548b4d21ead2758db5 P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:51.477068 28572 log.cc:1196] T 160f6b3840994c36a1b88478b7df297f P 199593e26c834084b7d52e7a01623f37: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/160f6b3840994c36a1b88478b7df297f
I20260808 02:30:51.477195 28489 raft_consensus.cc:729] T 58d133a04e7a4f548b4d21ead2758db5 P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f25891bfc740d58c8572ed05539bdc, State: Initialized, Role: FOLLOWER
I20260808 02:30:51.477762 28572 ts_tablet_manager.cc:1939] T 160f6b3840994c36a1b88478b7df297f P 199593e26c834084b7d52e7a01623f37: Deleting consensus metadata
I20260808 02:30:51.477638 28489 consensus_queue.cc:260] T 58d133a04e7a4f548b4d21ead2758db5 P b2f25891bfc740d58c8572ed05539bdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:51.478690 28489 ts_tablet_manager.cc:1428] T 58d133a04e7a4f548b4d21ead2758db5 P b2f25891bfc740d58c8572ed05539bdc: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260808 02:30:51.478974 28575 ts_tablet_manager.cc:1918] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:30:51.479212 28575 log.cc:1196] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/160f6b3840994c36a1b88478b7df297f
I20260808 02:30:51.479946 28575 ts_tablet_manager.cc:1939] T 160f6b3840994c36a1b88478b7df297f P b2f25891bfc740d58c8572ed05539bdc: Deleting consensus metadata
I20260808 02:30:51.482625 27686 catalog_manager.cc:4841] TS b2f25891bfc740d58c8572ed05539bdc (127.24.116.193:34459): tablet 160f6b3840994c36a1b88478b7df297f (table test-table [id=522b0f1d8f26485baebe086cd15c8391]) successfully deleted
I20260808 02:30:51.484432 27683 catalog_manager.cc:4841] TS 199593e26c834084b7d52e7a01623f37 (127.24.116.194:44539): tablet 160f6b3840994c36a1b88478b7df297f (table test-table [id=522b0f1d8f26485baebe086cd15c8391]) successfully deleted
I20260808 02:30:51.576865 28523 raft_consensus.cc:482] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:30:51.577157 28523 raft_consensus.cc:504] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:51.578007 28523 leader_election.cc:288] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2f25891bfc740d58c8572ed05539bdc (127.24.116.193:34459), ce2a187174c942719f006db95776a968 (127.24.116.195:37917)
I20260808 02:30:51.578737 27958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58d133a04e7a4f548b4d21ead2758db5" candidate_uuid: "199593e26c834084b7d52e7a01623f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f25891bfc740d58c8572ed05539bdc" is_pre_election: true
I20260808 02:30:51.579044 27958 raft_consensus.cc:2454] T 58d133a04e7a4f548b4d21ead2758db5 P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 199593e26c834084b7d52e7a01623f37 in term 0.
I20260808 02:30:51.579108 28387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58d133a04e7a4f548b4d21ead2758db5" candidate_uuid: "199593e26c834084b7d52e7a01623f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce2a187174c942719f006db95776a968" is_pre_election: true
I20260808 02:30:51.579407 28387 raft_consensus.cc:2454] T 58d133a04e7a4f548b4d21ead2758db5 P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 199593e26c834084b7d52e7a01623f37 in term 0.
I20260808 02:30:51.579991 28065 leader_election.cc:302] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 199593e26c834084b7d52e7a01623f37, ce2a187174c942719f006db95776a968; no voters:
I20260808 02:30:51.580430 28523 raft_consensus.cc:2781] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:30:51.580547 28523 raft_consensus.cc:482] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:30:51.580669 28523 raft_consensus.cc:3037] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:51.584141 28523 raft_consensus.cc:504] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:51.585546 28387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58d133a04e7a4f548b4d21ead2758db5" candidate_uuid: "199593e26c834084b7d52e7a01623f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce2a187174c942719f006db95776a968"
I20260808 02:30:51.585604 27958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58d133a04e7a4f548b4d21ead2758db5" candidate_uuid: "199593e26c834084b7d52e7a01623f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f25891bfc740d58c8572ed05539bdc"
I20260808 02:30:51.585796 28387 raft_consensus.cc:3037] T 58d133a04e7a4f548b4d21ead2758db5 P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:51.585857 27958 raft_consensus.cc:3037] T 58d133a04e7a4f548b4d21ead2758db5 P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:51.588986 28387 raft_consensus.cc:2454] T 58d133a04e7a4f548b4d21ead2758db5 P ce2a187174c942719f006db95776a968 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 199593e26c834084b7d52e7a01623f37 in term 1.
I20260808 02:30:51.589203 27958 raft_consensus.cc:2454] T 58d133a04e7a4f548b4d21ead2758db5 P b2f25891bfc740d58c8572ed05539bdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 199593e26c834084b7d52e7a01623f37 in term 1.
I20260808 02:30:51.589478 28065 leader_election.cc:302] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 199593e26c834084b7d52e7a01623f37, ce2a187174c942719f006db95776a968; no voters:
I20260808 02:30:51.589861 28559 raft_consensus.cc:2781] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:30:51.590018 28559 raft_consensus.cc:686] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37 [term 1 LEADER]: Becoming Leader. State: Replica: 199593e26c834084b7d52e7a01623f37, State: Running, Role: LEADER
I20260808 02:30:51.590344 28559 consensus_queue.cc:237] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:51.591820 28523 leader_election.cc:288] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37 [CANDIDATE]: Term 1 election: Requested vote from peers b2f25891bfc740d58c8572ed05539bdc (127.24.116.193:34459), ce2a187174c942719f006db95776a968 (127.24.116.195:37917)
I20260808 02:30:51.594036 27703 catalog_manager.cc:5495] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 199593e26c834084b7d52e7a01623f37 (127.24.116.194). New cstate: current_term: 1 leader_uuid: "199593e26c834084b7d52e7a01623f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } health_report { overall_health: UNKNOWN } } }
I20260808 02:30:51.662274 28474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:51.645320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52016 (local address 127.24.116.194:44539)
0808 02:30:51.645499 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:51.645506 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:51.645741 (+ 235us) server_negotiation.cc:407] Connection header received
0808 02:30:51.645895 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:51.645900 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:51.645987 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:51.646133 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:30:51.646551 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.651254 (+ 4703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.657212 (+ 5958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.658024 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.658193 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:51.660958 (+ 2765us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:30:51.661130 (+ 172us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:30:51.661236 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:51.661848 (+ 612us) server_negotiation.cc:299] Negotiation successful
0808 02:30:51.661948 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 02:30:51.679510 28474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:51.672832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:60189 (local address 127.24.116.194:44539)
0808 02:30:51.672985 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:51.672991 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:51.673009 (+ 18us) server_negotiation.cc:407] Connection header received
0808 02:30:51.673065 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:51.673070 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:51.673188 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:51.673279 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:30:51.673731 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.674871 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.677011 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.677784 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.677911 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:51.678508 (+ 597us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:30:51.678663 (+ 155us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:30:51.678765 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:51.678950 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 02:30:51.679091 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":50}
I20260808 02:30:51.679517 28565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:51.672590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:44539 (local address 127.24.116.194:60189)
0808 02:30:51.672805 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:51.672826 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:51.672938 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:51.673311 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:51.673316 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:51.673330 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:30:51.673591 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:51.673602 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.675033 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.675039 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:51.676859 (+ 1820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:51.676874 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:51.678068 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:51.678074 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:51.678255 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:51.678305 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:30:51.678799 (+ 494us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:30:51.678812 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 02:30:51.678911 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 02:30:51.679099 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":1}
I20260808 02:30:51.691468 28387 raft_consensus.cc:1261] T 58d133a04e7a4f548b4d21ead2758db5 P ce2a187174c942719f006db95776a968 [term 1 FOLLOWER]: Refusing update from remote peer 199593e26c834084b7d52e7a01623f37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:30:51.692234 28491 consensus_queue.cc:1035] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:30:51.692986 27958 raft_consensus.cc:1261] T 58d133a04e7a4f548b4d21ead2758db5 P b2f25891bfc740d58c8572ed05539bdc [term 1 FOLLOWER]: Refusing update from remote peer 199593e26c834084b7d52e7a01623f37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:30:51.693629 28491 consensus_queue.cc:1035] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:30:51.711066 28535 mvcc.cc:205] Tried to move back new op lower bound from 7316096006923337728 to 7316096006517391360. Current Snapshot: MvccSnapshot[applied={T|T < 7316096006923337728}]
W20260808 02:30:51.731809 28534 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 02:30:53.340446 27703 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45626:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:30:53.340735 27703 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45626:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:30:53.345352 27703 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747: Sending DeleteTablet for 3 replicas of tablet 58d133a04e7a4f548b4d21ead2758db5
I20260808 02:30:53.346306 27908 tablet_service.cc:1514] Processing DeleteTablet for tablet 58d133a04e7a4f548b4d21ead2758db5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:30:53 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:60924
I20260808 02:30:53.346509 28354 tablet_service.cc:1514] Processing DeleteTablet for tablet 58d133a04e7a4f548b4d21ead2758db5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:30:53 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:36752
I20260808 02:30:53.346645 28138 tablet_service.cc:1514] Processing DeleteTablet for tablet 58d133a04e7a4f548b4d21ead2758db5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:30:53 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:52006
I20260808 02:30:53.357219 28614 tablet_replica.cc:330] T 58d133a04e7a4f548b4d21ead2758db5 P ce2a187174c942719f006db95776a968: stopping tablet replica
I20260808 02:30:53.357543 28614 raft_consensus.cc:2229] T 58d133a04e7a4f548b4d21ead2758db5 P ce2a187174c942719f006db95776a968 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:30:53.357735 28615 tablet_replica.cc:330] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37: stopping tablet replica
I20260808 02:30:53.357841 28614 raft_consensus.cc:2258] T 58d133a04e7a4f548b4d21ead2758db5 P ce2a187174c942719f006db95776a968 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:30:53.357999 28612 tablet_replica.cc:330] T 58d133a04e7a4f548b4d21ead2758db5 P b2f25891bfc740d58c8572ed05539bdc: stopping tablet replica
I20260808 02:30:53.358330 28612 raft_consensus.cc:2229] T 58d133a04e7a4f548b4d21ead2758db5 P b2f25891bfc740d58c8572ed05539bdc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:30:53.358439 28615 raft_consensus.cc:2229] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:30:53.358673 28612 raft_consensus.cc:2258] T 58d133a04e7a4f548b4d21ead2758db5 P b2f25891bfc740d58c8572ed05539bdc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:30:53.359313 28615 raft_consensus.cc:2258] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:30:53.360010 28612 ts_tablet_manager.cc:1905] T 58d133a04e7a4f548b4d21ead2758db5 P b2f25891bfc740d58c8572ed05539bdc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:30:53.360576 28615 ts_tablet_manager.cc:1905] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:30:53.362615 28614 ts_tablet_manager.cc:1905] T 58d133a04e7a4f548b4d21ead2758db5 P ce2a187174c942719f006db95776a968: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:30:53.367818 28615 ts_tablet_manager.cc:1918] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 02:30:53.368014 28615 log.cc:1196] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/58d133a04e7a4f548b4d21ead2758db5
I20260808 02:30:53.368577 28615 ts_tablet_manager.cc:1939] T 58d133a04e7a4f548b4d21ead2758db5 P 199593e26c834084b7d52e7a01623f37: Deleting consensus metadata
I20260808 02:30:53.369264 28612 ts_tablet_manager.cc:1918] T 58d133a04e7a4f548b4d21ead2758db5 P b2f25891bfc740d58c8572ed05539bdc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 02:30:53.369547 28612 log.cc:1196] T 58d133a04e7a4f548b4d21ead2758db5 P b2f25891bfc740d58c8572ed05539bdc: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/58d133a04e7a4f548b4d21ead2758db5
I20260808 02:30:53.369590 28614 ts_tablet_manager.cc:1918] T 58d133a04e7a4f548b4d21ead2758db5 P ce2a187174c942719f006db95776a968: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 02:30:53.369733 28614 log.cc:1196] T 58d133a04e7a4f548b4d21ead2758db5 P ce2a187174c942719f006db95776a968: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/58d133a04e7a4f548b4d21ead2758db5
I20260808 02:30:53.370083 28612 ts_tablet_manager.cc:1939] T 58d133a04e7a4f548b4d21ead2758db5 P b2f25891bfc740d58c8572ed05539bdc: Deleting consensus metadata
I20260808 02:30:53.370098 27683 catalog_manager.cc:4841] TS 199593e26c834084b7d52e7a01623f37 (127.24.116.194:44539): tablet 58d133a04e7a4f548b4d21ead2758db5 (table test-table [id=830ce85d369e420dbf0650eb61a98a92]) successfully deleted
I20260808 02:30:53.370323 28614 ts_tablet_manager.cc:1939] T 58d133a04e7a4f548b4d21ead2758db5 P ce2a187174c942719f006db95776a968: Deleting consensus metadata
I20260808 02:30:53.371441 27686 catalog_manager.cc:4841] TS b2f25891bfc740d58c8572ed05539bdc (127.24.116.193:34459): tablet 58d133a04e7a4f548b4d21ead2758db5 (table test-table [id=830ce85d369e420dbf0650eb61a98a92]) successfully deleted
I20260808 02:30:53.371758 27682 catalog_manager.cc:4841] TS ce2a187174c942719f006db95776a968 (127.24.116.195:37917): tablet 58d133a04e7a4f548b4d21ead2758db5 (table test-table [id=830ce85d369e420dbf0650eb61a98a92]) successfully deleted
Aug 08 02:30:53 dist-test-slave-45dx krb5kdc[27639](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156253, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 02:30:53 dist-test-slave-45dx krb5kdc[27639](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156253, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:30:53.418248 28630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:53.403193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51126 (local address 127.24.116.254:34851)
0808 02:30:53.403851 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:53.403858 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:53.403886 (+ 28us) server_negotiation.cc:407] Connection header received
0808 02:30:53.404090 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:53.404095 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:53.404175 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:53.404297 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:53.405751 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:53.406695 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:53.408080 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:53.408541 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:53.408640 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:53.412820 (+ 4180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:53.412825 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:53.412828 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:53.412866 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:53.415657 (+ 2791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:53.416382 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:53.416387 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:53.416390 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:53.416579 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:53.416928 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:53.416931 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:53.416933 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:53.417207 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:53.417382 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:53.417680 (+ 298us) server_negotiation.cc:299] Negotiation successful
0808 02:30:53.417850 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":315,"threads_started":1}
I20260808 02:30:53.421918 27703 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51126:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:30:53.422544 27703 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:30:53.429476 27908 tablet_service.cc:1467] Processing CreateTablet for tablet 891518b85ed540e9a42bb6bd606a4628 (DEFAULT_TABLE table=test-table [id=5b361601b3c34983bdea91beca080aef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:30:53.429657 28354 tablet_service.cc:1467] Processing CreateTablet for tablet 891518b85ed540e9a42bb6bd606a4628 (DEFAULT_TABLE table=test-table [id=5b361601b3c34983bdea91beca080aef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:30:53.429613 28138 tablet_service.cc:1467] Processing CreateTablet for tablet 891518b85ed540e9a42bb6bd606a4628 (DEFAULT_TABLE table=test-table [id=5b361601b3c34983bdea91beca080aef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:30:53.429982 27908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 891518b85ed540e9a42bb6bd606a4628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:53.430088 28138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 891518b85ed540e9a42bb6bd606a4628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:53.430087 28354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 891518b85ed540e9a42bb6bd606a4628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:53.435820 28632 tablet_bootstrap.cc:492] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc: Bootstrap starting.
I20260808 02:30:53.437975 28632 tablet_bootstrap.cc:654] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:53.440042 28634 tablet_bootstrap.cc:492] T 891518b85ed540e9a42bb6bd606a4628 P 199593e26c834084b7d52e7a01623f37: Bootstrap starting.
I20260808 02:30:53.440052 28636 tablet_bootstrap.cc:492] T 891518b85ed540e9a42bb6bd606a4628 P ce2a187174c942719f006db95776a968: Bootstrap starting.
I20260808 02:30:53.441548 28632 tablet_bootstrap.cc:492] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc: No bootstrap required, opened a new log
I20260808 02:30:53.441691 28636 tablet_bootstrap.cc:654] T 891518b85ed540e9a42bb6bd606a4628 P ce2a187174c942719f006db95776a968: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:53.441699 28632 ts_tablet_manager.cc:1397] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 02:30:53.442214 28634 tablet_bootstrap.cc:654] T 891518b85ed540e9a42bb6bd606a4628 P 199593e26c834084b7d52e7a01623f37: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:53.442627 28632 raft_consensus.cc:348] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:53.443095 28632 raft_consensus.cc:374] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:53.443226 28632 raft_consensus.cc:729] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f25891bfc740d58c8572ed05539bdc, State: Initialized, Role: FOLLOWER
I20260808 02:30:53.443601 28632 consensus_queue.cc:260] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:53.444129 28636 tablet_bootstrap.cc:492] T 891518b85ed540e9a42bb6bd606a4628 P ce2a187174c942719f006db95776a968: No bootstrap required, opened a new log
I20260808 02:30:53.444331 28636 ts_tablet_manager.cc:1397] T 891518b85ed540e9a42bb6bd606a4628 P ce2a187174c942719f006db95776a968: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260808 02:30:53.445182 28636 raft_consensus.cc:348] T 891518b85ed540e9a42bb6bd606a4628 P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:53.445542 28636 raft_consensus.cc:374] T 891518b85ed540e9a42bb6bd606a4628 P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:53.445653 28636 raft_consensus.cc:729] T 891518b85ed540e9a42bb6bd606a4628 P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce2a187174c942719f006db95776a968, State: Initialized, Role: FOLLOWER
I20260808 02:30:53.445909 28632 ts_tablet_manager.cc:1428] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260808 02:30:53.446048 28636 consensus_queue.cc:260] T 891518b85ed540e9a42bb6bd606a4628 P ce2a187174c942719f006db95776a968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:53.447155 28636 ts_tablet_manager.cc:1428] T 891518b85ed540e9a42bb6bd606a4628 P ce2a187174c942719f006db95776a968: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260808 02:30:53.448633 28634 tablet_bootstrap.cc:492] T 891518b85ed540e9a42bb6bd606a4628 P 199593e26c834084b7d52e7a01623f37: No bootstrap required, opened a new log
I20260808 02:30:53.448848 28634 ts_tablet_manager.cc:1397] T 891518b85ed540e9a42bb6bd606a4628 P 199593e26c834084b7d52e7a01623f37: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.005s
I20260808 02:30:53.449690 28634 raft_consensus.cc:348] T 891518b85ed540e9a42bb6bd606a4628 P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:53.449949 28634 raft_consensus.cc:374] T 891518b85ed540e9a42bb6bd606a4628 P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:53.450073 28634 raft_consensus.cc:729] T 891518b85ed540e9a42bb6bd606a4628 P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 199593e26c834084b7d52e7a01623f37, State: Initialized, Role: FOLLOWER
I20260808 02:30:53.450357 28634 consensus_queue.cc:260] T 891518b85ed540e9a42bb6bd606a4628 P 199593e26c834084b7d52e7a01623f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:53.450876 28634 ts_tablet_manager.cc:1428] T 891518b85ed540e9a42bb6bd606a4628 P 199593e26c834084b7d52e7a01623f37: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 02:30:53.533563 28641 raft_consensus.cc:482] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:30:53.533865 28641 raft_consensus.cc:504] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:53.534703 28641 leader_election.cc:288] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 199593e26c834084b7d52e7a01623f37 (127.24.116.194:44539), ce2a187174c942719f006db95776a968 (127.24.116.195:37917)
I20260808 02:30:53.535370 28385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "891518b85ed540e9a42bb6bd606a4628" candidate_uuid: "b2f25891bfc740d58c8572ed05539bdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce2a187174c942719f006db95776a968" is_pre_election: true
I20260808 02:30:53.535352 28181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "891518b85ed540e9a42bb6bd606a4628" candidate_uuid: "b2f25891bfc740d58c8572ed05539bdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "199593e26c834084b7d52e7a01623f37" is_pre_election: true
I20260808 02:30:53.535658 28181 raft_consensus.cc:2454] T 891518b85ed540e9a42bb6bd606a4628 P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2f25891bfc740d58c8572ed05539bdc in term 0.
I20260808 02:30:53.535661 28385 raft_consensus.cc:2454] T 891518b85ed540e9a42bb6bd606a4628 P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2f25891bfc740d58c8572ed05539bdc in term 0.
I20260808 02:30:53.536226 27838 leader_election.cc:302] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 199593e26c834084b7d52e7a01623f37, b2f25891bfc740d58c8572ed05539bdc; no voters:
I20260808 02:30:53.536604 28641 raft_consensus.cc:2781] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:30:53.536736 28641 raft_consensus.cc:482] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:30:53.536813 28641 raft_consensus.cc:3037] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:53.538887 28641 raft_consensus.cc:504] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:53.539422 28641 leader_election.cc:288] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc [CANDIDATE]: Term 1 election: Requested vote from peers 199593e26c834084b7d52e7a01623f37 (127.24.116.194:44539), ce2a187174c942719f006db95776a968 (127.24.116.195:37917)
I20260808 02:30:53.539896 28181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "891518b85ed540e9a42bb6bd606a4628" candidate_uuid: "b2f25891bfc740d58c8572ed05539bdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "199593e26c834084b7d52e7a01623f37"
I20260808 02:30:53.540110 28181 raft_consensus.cc:3037] T 891518b85ed540e9a42bb6bd606a4628 P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:53.540057 28385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "891518b85ed540e9a42bb6bd606a4628" candidate_uuid: "b2f25891bfc740d58c8572ed05539bdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce2a187174c942719f006db95776a968"
I20260808 02:30:53.540284 28385 raft_consensus.cc:3037] T 891518b85ed540e9a42bb6bd606a4628 P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:53.542244 28181 raft_consensus.cc:2454] T 891518b85ed540e9a42bb6bd606a4628 P 199593e26c834084b7d52e7a01623f37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2f25891bfc740d58c8572ed05539bdc in term 1.
I20260808 02:30:53.542459 28385 raft_consensus.cc:2454] T 891518b85ed540e9a42bb6bd606a4628 P ce2a187174c942719f006db95776a968 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2f25891bfc740d58c8572ed05539bdc in term 1.
I20260808 02:30:53.542728 27838 leader_election.cc:302] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 199593e26c834084b7d52e7a01623f37, b2f25891bfc740d58c8572ed05539bdc; no voters:
I20260808 02:30:53.543095 28641 raft_consensus.cc:2781] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:30:53.543583 28641 raft_consensus.cc:686] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc [term 1 LEADER]: Becoming Leader. State: Replica: b2f25891bfc740d58c8572ed05539bdc, State: Running, Role: LEADER
I20260808 02:30:53.544034 28641 consensus_queue.cc:237] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:53.547114 27703 catalog_manager.cc:5495] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc reported cstate change: term changed from 0 to 1, leader changed from <none> to b2f25891bfc740d58c8572ed05539bdc (127.24.116.193). New cstate: current_term: 1 leader_uuid: "b2f25891bfc740d58c8572ed05539bdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } health_report { overall_health: UNKNOWN } } }
I20260808 02:30:53.579180 28648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:53.573452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39924 (local address 127.24.116.193:34459)
0808 02:30:53.574074 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:53.574078 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:53.574096 (+ 18us) server_negotiation.cc:407] Connection header received
0808 02:30:53.574147 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:53.574150 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:53.574213 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:53.574327 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:30:53.574917 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:53.575789 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:53.577310 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:53.577749 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:53.577908 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:53.578361 (+ 453us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:30:53.578469 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:30:53.578572 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:53.578740 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 02:30:53.578817 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":323,"threads_started":1}
I20260808 02:30:53.588949 28181 raft_consensus.cc:1261] T 891518b85ed540e9a42bb6bd606a4628 P 199593e26c834084b7d52e7a01623f37 [term 1 FOLLOWER]: Refusing update from remote peer b2f25891bfc740d58c8572ed05539bdc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:30:53.588949 28385 raft_consensus.cc:1261] T 891518b85ed540e9a42bb6bd606a4628 P ce2a187174c942719f006db95776a968 [term 1 FOLLOWER]: Refusing update from remote peer b2f25891bfc740d58c8572ed05539bdc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:30:53.589541 28643 consensus_queue.cc:1035] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:30:53.589874 28641 consensus_queue.cc:1035] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:30:53.643857 27703 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51126:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:30:53.644119 27703 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51126:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:30:53.647080 27703 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747: Sending DeleteTablet for 3 replicas of tablet 891518b85ed540e9a42bb6bd606a4628
I20260808 02:30:53.647960 28138 tablet_service.cc:1514] Processing DeleteTablet for tablet 891518b85ed540e9a42bb6bd606a4628 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:30:53 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:52006
I20260808 02:30:53.647979 27908 tablet_service.cc:1514] Processing DeleteTablet for tablet 891518b85ed540e9a42bb6bd606a4628 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:30:53 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:60924
I20260808 02:30:53.648339 28612 tablet_replica.cc:330] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc: stopping tablet replica
I20260808 02:30:53.648331 28354 tablet_service.cc:1514] Processing DeleteTablet for tablet 891518b85ed540e9a42bb6bd606a4628 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:30:53 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:36752
I20260808 02:30:53.648612 28614 tablet_replica.cc:330] T 891518b85ed540e9a42bb6bd606a4628 P ce2a187174c942719f006db95776a968: stopping tablet replica
I20260808 02:30:53.648618 28612 raft_consensus.cc:2229] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:30:53.648844 28614 raft_consensus.cc:2229] T 891518b85ed540e9a42bb6bd606a4628 P ce2a187174c942719f006db95776a968 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:30:53.648996 28612 raft_consensus.cc:2258] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:30:53.649061 28614 raft_consensus.cc:2258] T 891518b85ed540e9a42bb6bd606a4628 P ce2a187174c942719f006db95776a968 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:30:53.649073 27703 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51126:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 02:30:53.649313 28615 tablet_replica.cc:330] T 891518b85ed540e9a42bb6bd606a4628 P 199593e26c834084b7d52e7a01623f37: stopping tablet replica
I20260808 02:30:53.649600 28615 raft_consensus.cc:2229] T 891518b85ed540e9a42bb6bd606a4628 P 199593e26c834084b7d52e7a01623f37 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260808 02:30:53.649751 27703 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:30:53.649814 28615 raft_consensus.cc:2258] T 891518b85ed540e9a42bb6bd606a4628 P 199593e26c834084b7d52e7a01623f37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:30:53.650321 28614 ts_tablet_manager.cc:1905] T 891518b85ed540e9a42bb6bd606a4628 P ce2a187174c942719f006db95776a968: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:30:53.650660 28612 ts_tablet_manager.cc:1905] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:30:53.650936 28615 ts_tablet_manager.cc:1905] T 891518b85ed540e9a42bb6bd606a4628 P 199593e26c834084b7d52e7a01623f37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:30:53.657449 28354 tablet_service.cc:1467] Processing CreateTablet for tablet afc8bcb9fb164ce39cc220950ea4c6ec (DEFAULT_TABLE table=test-table [id=14d42e9e70814c9ab636a117f18ae96c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:30:53.657547 28612 ts_tablet_manager.cc:1918] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:30:53.657698 28612 log.cc:1196] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/891518b85ed540e9a42bb6bd606a4628
I20260808 02:30:53.657665 28138 tablet_service.cc:1467] Processing CreateTablet for tablet afc8bcb9fb164ce39cc220950ea4c6ec (DEFAULT_TABLE table=test-table [id=14d42e9e70814c9ab636a117f18ae96c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:30:53.657892 28614 ts_tablet_manager.cc:1918] T 891518b85ed540e9a42bb6bd606a4628 P ce2a187174c942719f006db95776a968: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:30:53.657931 28354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afc8bcb9fb164ce39cc220950ea4c6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:53.658061 28138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afc8bcb9fb164ce39cc220950ea4c6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:53.658192 28612 ts_tablet_manager.cc:1939] T 891518b85ed540e9a42bb6bd606a4628 P b2f25891bfc740d58c8572ed05539bdc: Deleting consensus metadata
I20260808 02:30:53.658193 28614 log.cc:1196] T 891518b85ed540e9a42bb6bd606a4628 P ce2a187174c942719f006db95776a968: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/891518b85ed540e9a42bb6bd606a4628
I20260808 02:30:53.658739 28614 ts_tablet_manager.cc:1939] T 891518b85ed540e9a42bb6bd606a4628 P ce2a187174c942719f006db95776a968: Deleting consensus metadata
I20260808 02:30:53.659547 27686 catalog_manager.cc:4841] TS b2f25891bfc740d58c8572ed05539bdc (127.24.116.193:34459): tablet 891518b85ed540e9a42bb6bd606a4628 (table test-table [id=5b361601b3c34983bdea91beca080aef]) successfully deleted
I20260808 02:30:53.660298 27908 tablet_service.cc:1467] Processing CreateTablet for tablet afc8bcb9fb164ce39cc220950ea4c6ec (DEFAULT_TABLE table=test-table [id=14d42e9e70814c9ab636a117f18ae96c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:30:53.660604 27682 catalog_manager.cc:4841] TS ce2a187174c942719f006db95776a968 (127.24.116.195:37917): tablet 891518b85ed540e9a42bb6bd606a4628 (table test-table [id=5b361601b3c34983bdea91beca080aef]) successfully deleted
I20260808 02:30:53.660741 27908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afc8bcb9fb164ce39cc220950ea4c6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:53.662493 28615 ts_tablet_manager.cc:1918] T 891518b85ed540e9a42bb6bd606a4628 P 199593e26c834084b7d52e7a01623f37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:30:53.663973 28615 log.cc:1196] T 891518b85ed540e9a42bb6bd606a4628 P 199593e26c834084b7d52e7a01623f37: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/891518b85ed540e9a42bb6bd606a4628
I20260808 02:30:53.664469 28634 tablet_bootstrap.cc:492] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37: Bootstrap starting.
I20260808 02:30:53.664671 28615 ts_tablet_manager.cc:1939] T 891518b85ed540e9a42bb6bd606a4628 P 199593e26c834084b7d52e7a01623f37: Deleting consensus metadata
I20260808 02:30:53.665953 27683 catalog_manager.cc:4841] TS 199593e26c834084b7d52e7a01623f37 (127.24.116.194:44539): tablet 891518b85ed540e9a42bb6bd606a4628 (table test-table [id=5b361601b3c34983bdea91beca080aef]) successfully deleted
I20260808 02:30:53.666282 28634 tablet_bootstrap.cc:654] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:53.667148 28632 tablet_bootstrap.cc:492] T afc8bcb9fb164ce39cc220950ea4c6ec P b2f25891bfc740d58c8572ed05539bdc: Bootstrap starting.
I20260808 02:30:53.667186 28636 tablet_bootstrap.cc:492] T afc8bcb9fb164ce39cc220950ea4c6ec P ce2a187174c942719f006db95776a968: Bootstrap starting.
I20260808 02:30:53.669003 28632 tablet_bootstrap.cc:654] T afc8bcb9fb164ce39cc220950ea4c6ec P b2f25891bfc740d58c8572ed05539bdc: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:53.669121 28636 tablet_bootstrap.cc:654] T afc8bcb9fb164ce39cc220950ea4c6ec P ce2a187174c942719f006db95776a968: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:53.669308 28634 tablet_bootstrap.cc:492] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37: No bootstrap required, opened a new log
I20260808 02:30:53.669721 28634 ts_tablet_manager.cc:1397] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.002s
I20260808 02:30:53.670840 28634 raft_consensus.cc:348] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:53.671274 28634 raft_consensus.cc:374] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:53.671425 28634 raft_consensus.cc:729] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 199593e26c834084b7d52e7a01623f37, State: Initialized, Role: FOLLOWER
I20260808 02:30:53.671490 28636 tablet_bootstrap.cc:492] T afc8bcb9fb164ce39cc220950ea4c6ec P ce2a187174c942719f006db95776a968: No bootstrap required, opened a new log
I20260808 02:30:53.671747 28636 ts_tablet_manager.cc:1397] T afc8bcb9fb164ce39cc220950ea4c6ec P ce2a187174c942719f006db95776a968: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260808 02:30:53.671746 28634 consensus_queue.cc:260] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:53.672539 28634 ts_tablet_manager.cc:1428] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 02:30:53.672739 28636 raft_consensus.cc:348] T afc8bcb9fb164ce39cc220950ea4c6ec P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:53.673748 28636 raft_consensus.cc:374] T afc8bcb9fb164ce39cc220950ea4c6ec P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:53.673838 28636 raft_consensus.cc:729] T afc8bcb9fb164ce39cc220950ea4c6ec P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce2a187174c942719f006db95776a968, State: Initialized, Role: FOLLOWER
I20260808 02:30:53.674295 28632 tablet_bootstrap.cc:492] T afc8bcb9fb164ce39cc220950ea4c6ec P b2f25891bfc740d58c8572ed05539bdc: No bootstrap required, opened a new log
I20260808 02:30:53.674155 28636 consensus_queue.cc:260] T afc8bcb9fb164ce39cc220950ea4c6ec P ce2a187174c942719f006db95776a968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:53.674576 28632 ts_tablet_manager.cc:1397] T afc8bcb9fb164ce39cc220950ea4c6ec P b2f25891bfc740d58c8572ed05539bdc: Time spent bootstrapping tablet: real 0.007s user 0.007s sys 0.000s
I20260808 02:30:53.674706 28636 ts_tablet_manager.cc:1428] T afc8bcb9fb164ce39cc220950ea4c6ec P ce2a187174c942719f006db95776a968: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260808 02:30:53.675315 28632 raft_consensus.cc:348] T afc8bcb9fb164ce39cc220950ea4c6ec P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:53.675571 28632 raft_consensus.cc:374] T afc8bcb9fb164ce39cc220950ea4c6ec P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:53.675659 28632 raft_consensus.cc:729] T afc8bcb9fb164ce39cc220950ea4c6ec P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f25891bfc740d58c8572ed05539bdc, State: Initialized, Role: FOLLOWER
I20260808 02:30:53.676004 28632 consensus_queue.cc:260] T afc8bcb9fb164ce39cc220950ea4c6ec P b2f25891bfc740d58c8572ed05539bdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:53.676651 28632 ts_tablet_manager.cc:1428] T afc8bcb9fb164ce39cc220950ea4c6ec P b2f25891bfc740d58c8572ed05539bdc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 02:30:53.839680 28596 raft_consensus.cc:482] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:30:53.839901 28596 raft_consensus.cc:504] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:53.840615 28596 leader_election.cc:288] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2f25891bfc740d58c8572ed05539bdc (127.24.116.193:34459), ce2a187174c942719f006db95776a968 (127.24.116.195:37917)
I20260808 02:30:53.841207 27953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afc8bcb9fb164ce39cc220950ea4c6ec" candidate_uuid: "199593e26c834084b7d52e7a01623f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f25891bfc740d58c8572ed05539bdc" is_pre_election: true
I20260808 02:30:53.841279 28385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afc8bcb9fb164ce39cc220950ea4c6ec" candidate_uuid: "199593e26c834084b7d52e7a01623f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce2a187174c942719f006db95776a968" is_pre_election: true
I20260808 02:30:53.841517 27953 raft_consensus.cc:2454] T afc8bcb9fb164ce39cc220950ea4c6ec P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 199593e26c834084b7d52e7a01623f37 in term 0.
I20260808 02:30:53.841566 28385 raft_consensus.cc:2454] T afc8bcb9fb164ce39cc220950ea4c6ec P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 199593e26c834084b7d52e7a01623f37 in term 0.
I20260808 02:30:53.842037 28065 leader_election.cc:302] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 199593e26c834084b7d52e7a01623f37, ce2a187174c942719f006db95776a968; no voters:
I20260808 02:30:53.842332 28596 raft_consensus.cc:2781] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:30:53.842469 28596 raft_consensus.cc:482] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:30:53.842559 28596 raft_consensus.cc:3037] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:53.844870 28596 raft_consensus.cc:504] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:53.845407 28596 leader_election.cc:288] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37 [CANDIDATE]: Term 1 election: Requested vote from peers b2f25891bfc740d58c8572ed05539bdc (127.24.116.193:34459), ce2a187174c942719f006db95776a968 (127.24.116.195:37917)
I20260808 02:30:53.846014 28385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afc8bcb9fb164ce39cc220950ea4c6ec" candidate_uuid: "199593e26c834084b7d52e7a01623f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce2a187174c942719f006db95776a968"
I20260808 02:30:53.846185 28385 raft_consensus.cc:3037] T afc8bcb9fb164ce39cc220950ea4c6ec P ce2a187174c942719f006db95776a968 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:53.846480 27953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afc8bcb9fb164ce39cc220950ea4c6ec" candidate_uuid: "199593e26c834084b7d52e7a01623f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2f25891bfc740d58c8572ed05539bdc"
I20260808 02:30:53.846716 27953 raft_consensus.cc:3037] T afc8bcb9fb164ce39cc220950ea4c6ec P b2f25891bfc740d58c8572ed05539bdc [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:53.848368 28385 raft_consensus.cc:2454] T afc8bcb9fb164ce39cc220950ea4c6ec P ce2a187174c942719f006db95776a968 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 199593e26c834084b7d52e7a01623f37 in term 1.
I20260808 02:30:53.848814 28065 leader_election.cc:302] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 199593e26c834084b7d52e7a01623f37, ce2a187174c942719f006db95776a968; no voters:
I20260808 02:30:53.849133 28596 raft_consensus.cc:2781] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:30:53.849277 28596 raft_consensus.cc:686] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37 [term 1 LEADER]: Becoming Leader. State: Replica: 199593e26c834084b7d52e7a01623f37, State: Running, Role: LEADER
I20260808 02:30:53.849412 27953 raft_consensus.cc:2454] T afc8bcb9fb164ce39cc220950ea4c6ec P b2f25891bfc740d58c8572ed05539bdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 199593e26c834084b7d52e7a01623f37 in term 1.
I20260808 02:30:53.849555 28596 consensus_queue.cc:237] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } }
I20260808 02:30:53.852593 27703 catalog_manager.cc:5495] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 199593e26c834084b7d52e7a01623f37 (127.24.116.194). New cstate: current_term: 1 leader_uuid: "199593e26c834084b7d52e7a01623f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "199593e26c834084b7d52e7a01623f37" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 44539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 } health_report { overall_health: UNKNOWN } } }
I20260808 02:30:53.919427 28661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:53.914169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37612 (local address 127.24.116.194:44539)
0808 02:30:53.914758 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:53.914762 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:53.914781 (+ 19us) server_negotiation.cc:407] Connection header received
0808 02:30:53.914830 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:53.914834 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:53.914916 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:53.914998 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:30:53.915337 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:53.916088 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:53.917627 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:53.918095 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:53.918190 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:53.918613 (+ 423us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:30:53.918714 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:30:53.918781 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:53.919015 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 02:30:53.919079 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":358,"threads_started":1}
I20260808 02:30:53.928860 28385 raft_consensus.cc:1261] T afc8bcb9fb164ce39cc220950ea4c6ec P ce2a187174c942719f006db95776a968 [term 1 FOLLOWER]: Refusing update from remote peer 199593e26c834084b7d52e7a01623f37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:30:53.929181 27953 raft_consensus.cc:1261] T afc8bcb9fb164ce39cc220950ea4c6ec P b2f25891bfc740d58c8572ed05539bdc [term 1 FOLLOWER]: Refusing update from remote peer 199593e26c834084b7d52e7a01623f37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:30:53.929453 28569 consensus_queue.cc:1035] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce2a187174c942719f006db95776a968" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:30:53.929783 28596 consensus_queue.cc:1035] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2f25891bfc740d58c8572ed05539bdc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 02:30:53.956151 28586 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 02:30:55.539871 27701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51126:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:30:55.540117 27701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51126:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:30:55.544391 27701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 216f22d34def4c6c878b71a43cd19747: Sending DeleteTablet for 3 replicas of tablet afc8bcb9fb164ce39cc220950ea4c6ec
I20260808 02:30:55.545334 27908 tablet_service.cc:1514] Processing DeleteTablet for tablet afc8bcb9fb164ce39cc220950ea4c6ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:30:55 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:60924
I20260808 02:30:55.545323 28138 tablet_service.cc:1514] Processing DeleteTablet for tablet afc8bcb9fb164ce39cc220950ea4c6ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:30:55 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:52006
I20260808 02:30:55.545399 28354 tablet_service.cc:1514] Processing DeleteTablet for tablet afc8bcb9fb164ce39cc220950ea4c6ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:30:55 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:36752
I20260808 02:30:55.546146 28698 tablet_replica.cc:330] T afc8bcb9fb164ce39cc220950ea4c6ec P b2f25891bfc740d58c8572ed05539bdc: stopping tablet replica
I20260808 02:30:55.546378 28698 raft_consensus.cc:2229] T afc8bcb9fb164ce39cc220950ea4c6ec P b2f25891bfc740d58c8572ed05539bdc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:30:55.546613 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 27810
I20260808 02:30:55.546686 28702 tablet_replica.cc:330] T afc8bcb9fb164ce39cc220950ea4c6ec P ce2a187174c942719f006db95776a968: stopping tablet replica
I20260808 02:30:55.546725 28698 raft_consensus.cc:2258] T afc8bcb9fb164ce39cc220950ea4c6ec P b2f25891bfc740d58c8572ed05539bdc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:30:55.546945 28702 raft_consensus.cc:2229] T afc8bcb9fb164ce39cc220950ea4c6ec P ce2a187174c942719f006db95776a968 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:30:55.547186 28702 raft_consensus.cc:2258] T afc8bcb9fb164ce39cc220950ea4c6ec P ce2a187174c942719f006db95776a968 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:30:55.547824 28698 ts_tablet_manager.cc:1905] T afc8bcb9fb164ce39cc220950ea4c6ec P b2f25891bfc740d58c8572ed05539bdc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:30:55.547967 28701 tablet_replica.cc:330] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37: stopping tablet replica
I20260808 02:30:55.548161 28701 raft_consensus.cc:2229] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:30:55.548714 28701 raft_consensus.cc:2258] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:30:55.549724 28701 ts_tablet_manager.cc:1905] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:30:55.551077 28702 ts_tablet_manager.cc:1905] T afc8bcb9fb164ce39cc220950ea4c6ec P ce2a187174c942719f006db95776a968: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:30:55.556704 28701 ts_tablet_manager.cc:1918] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 02:30:55.556939 28701 log.cc:1196] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/afc8bcb9fb164ce39cc220950ea4c6ec
I20260808 02:30:55.557507 28701 ts_tablet_manager.cc:1939] T afc8bcb9fb164ce39cc220950ea4c6ec P 199593e26c834084b7d52e7a01623f37: Deleting consensus metadata
I20260808 02:30:55.558717 28702 ts_tablet_manager.cc:1918] T afc8bcb9fb164ce39cc220950ea4c6ec P ce2a187174c942719f006db95776a968: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 02:30:55.558784 27683 catalog_manager.cc:4841] TS 199593e26c834084b7d52e7a01623f37 (127.24.116.194:44539): tablet afc8bcb9fb164ce39cc220950ea4c6ec (table test-table [id=14d42e9e70814c9ab636a117f18ae96c]) successfully deleted
I20260808 02:30:55.558892 28702 log.cc:1196] T afc8bcb9fb164ce39cc220950ea4c6ec P ce2a187174c942719f006db95776a968: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/afc8bcb9fb164ce39cc220950ea4c6ec
I20260808 02:30:55.559401 28702 ts_tablet_manager.cc:1939] T afc8bcb9fb164ce39cc220950ea4c6ec P ce2a187174c942719f006db95776a968: Deleting consensus metadata
I20260808 02:30:55.560204 28698 ts_tablet_manager.cc:1918] T afc8bcb9fb164ce39cc220950ea4c6ec P b2f25891bfc740d58c8572ed05539bdc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 02:30:55.560464 28698 log.cc:1196] T afc8bcb9fb164ce39cc220950ea4c6ec P b2f25891bfc740d58c8572ed05539bdc: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/afc8bcb9fb164ce39cc220950ea4c6ec
I20260808 02:30:55.560645 27682 catalog_manager.cc:4841] TS ce2a187174c942719f006db95776a968 (127.24.116.195:37917): tablet afc8bcb9fb164ce39cc220950ea4c6ec (table test-table [id=14d42e9e70814c9ab636a117f18ae96c]) successfully deleted
I20260808 02:30:55.561005 28698 ts_tablet_manager.cc:1939] T afc8bcb9fb164ce39cc220950ea4c6ec P b2f25891bfc740d58c8572ed05539bdc: Deleting consensus metadata
I20260808 02:30:55.562229 27686 catalog_manager.cc:4841] TS b2f25891bfc740d58c8572ed05539bdc (127.24.116.193:34459): tablet afc8bcb9fb164ce39cc220950ea4c6ec (table test-table [id=14d42e9e70814c9ab636a117f18ae96c]) successfully deleted
Aug 08 02:30:55 dist-test-slave-45dx krb5kdc[27639](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156253, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.116.193@KRBTEST.COM
I20260808 02:30:55.580657 28705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:55.549144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39940 (local address 127.24.116.193:34459)
0808 02:30:55.556037 (+ 6893us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:55.556044 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:55.559985 (+ 3941us) server_negotiation.cc:407] Connection header received
0808 02:30:55.560058 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:55.560063 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:55.560143 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:55.560264 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:55.562140 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:55.562963 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:55.564168 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:55.564815 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:55.564922 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:55.574494 (+ 9572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:55.574512 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:55.574529 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:55.574574 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:55.578056 (+ 3482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:55.578790 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:55.578798 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:55.578801 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:55.578980 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:55.579298 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:55.579301 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:55.579303 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:55.579664 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:55.579919 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:55.580120 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 02:30:55.580289 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6744,"thread_start_us":7173,"threads_started":1}
W20260808 02:30:55.581481 28025 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39940
W20260808 02:30:55.582108 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 27810: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:30:55.582352 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 27810
I20260808 02:30:55.616370 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 28037
Aug 08 02:30:55 dist-test-slave-45dx krb5kdc[27639](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156253, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.116.194@KRBTEST.COM
I20260808 02:30:55.631539 28706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:55.617230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37618 (local address 127.24.116.194:44539)
0808 02:30:55.617802 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:55.617807 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:55.617823 (+ 16us) server_negotiation.cc:407] Connection header received
0808 02:30:55.617884 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:55.617887 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:55.617950 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:55.618041 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:55.619394 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:55.620116 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:55.621389 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:55.621811 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:55.621910 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:55.626069 (+ 4159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:55.626084 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:55.626119 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:55.626153 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:55.629233 (+ 3080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:55.629834 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:55.629842 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:55.629844 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:55.630009 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:55.630322 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:55.630325 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:55.630327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:55.630676 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:55.630908 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:55.631123 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 02:30:55.631285 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":317,"threads_started":1}
W20260808 02:30:55.632238 28236 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37618
W20260808 02:30:55.633066 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 28037: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:30:55.633255 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 28037
I20260808 02:30:55.668134 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 28249
Aug 08 02:30:55 dist-test-slave-45dx krb5kdc[27639](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156253, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.116.195@KRBTEST.COM
I20260808 02:30:55.684226 28707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:55.668974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39292 (local address 127.24.116.195:37917)
0808 02:30:55.669500 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:55.669505 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:55.669521 (+ 16us) server_negotiation.cc:407] Connection header received
0808 02:30:55.669578 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:55.669582 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:55.669641 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:55.669756 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:55.671328 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:55.672111 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:55.673414 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:55.673956 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:55.674054 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:55.678554 (+ 4500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:55.678571 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:55.678588 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:55.678631 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:55.681712 (+ 3081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:55.682331 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:55.682339 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:55.682341 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:55.682482 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:55.682802 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:55.682805 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:55.682807 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:55.683171 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:55.683397 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:55.683645 (+ 248us) server_negotiation.cc:299] Negotiation successful
0808 02:30:55.683813 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":290,"threads_started":1}
W20260808 02:30:55.684998 28446 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39292
W20260808 02:30:55.685609 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 28249: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:30:55.685788 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 28249
I20260808 02:30:55.714761 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 27658
I20260808 02:30:55.715991 27769 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:30:55.833402 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 27658
2026-08-08T02:30:55Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9122 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:30:55 dist-test-slave-45dx krb5kdc[28713](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:30:55 dist-test-slave-45dx krb5kdc[28713](info): set up 2 sockets
Aug 08 02:30:55 dist-test-slave-45dx krb5kdc[28713](info): commencing operation
krb5kdc: starting...
W20260808 02:30:57.158280 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.269s user 0.002s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:30:57 dist-test-slave-45dx krb5kdc[28713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:30:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:30:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:30:57.381799 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:39857
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:39045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:39857
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:30:57.724031 28737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:30:57.724453 28737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:30:57.724570 28737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:30:57.731909 28737 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:30:57.732034 28737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:30:57.732082 28737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:30:57.732132 28737 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:30:57.732178 28737 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:30:57.742936 28737 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:39045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:39857
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:39857
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:30:57.744328 28737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:30:57.745639 28737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:30:57.758103 28753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:57.758139 28750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:57.758055 28749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:30:57.759267 28737 server_base.cc:1034] running on GCE node
I20260808 02:30:57.760078 28737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:30:57.761600 28737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:30:57.762837 28737 hybrid_clock.cc:648] HybridClock initialized: now 1786156257762788 us; error 69 us; skew 500 ppm
I20260808 02:30:57.763198 28737 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:30:57 dist-test-slave-45dx krb5kdc[28713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156257, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:30:57.766467 28737 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:30:57.768059 28737 webserver.cc:460] Webserver started at http://127.24.116.254:44609/ using document root <none> and password file <none>
I20260808 02:30:57.768944 28737 fs_manager.cc:359] Metadata directory not provided
I20260808 02:30:57.769095 28737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:30:57.769475 28737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:30:57.772969 28737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "32eab90a8afc404fb44d7630937c4408"
format_stamp: "Formatted at 2026-08-08 02:30:57 on dist-test-slave-45dx"
server_key: "3810e77c76d3ba0df1de1641979fcfc6"
server_key_iv: "d5752c588af9e79c283f2e0de0e21ce0"
server_key_version: "encryptionkey@0"
I20260808 02:30:57.773727 28737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "32eab90a8afc404fb44d7630937c4408"
format_stamp: "Formatted at 2026-08-08 02:30:57 on dist-test-slave-45dx"
server_key: "3810e77c76d3ba0df1de1641979fcfc6"
server_key_iv: "d5752c588af9e79c283f2e0de0e21ce0"
server_key_version: "encryptionkey@0"
I20260808 02:30:57.779052 28737 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 02:30:57.782662 28766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:57.784101 28737 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 02:30:57.784364 28737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "32eab90a8afc404fb44d7630937c4408"
format_stamp: "Formatted at 2026-08-08 02:30:57 on dist-test-slave-45dx"
server_key: "3810e77c76d3ba0df1de1641979fcfc6"
server_key_iv: "d5752c588af9e79c283f2e0de0e21ce0"
server_key_version: "encryptionkey@0"
I20260808 02:30:57.784593 28737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:30:57.814095 28737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:30:57.818321 28737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:30:57.818647 28737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:30:57.838169 28737 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:39857
I20260808 02:30:57.838166 28844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:39857 every 8 connection(s)
I20260808 02:30:57.839682 28737 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:30:57.843686 28845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:30:57.844776 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 28737
I20260808 02:30:57.845031 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:30:57.845669 25043 external_mini_cluster.cc:1428] Setting key 123acd565cf99027dbf43c6bbdb5e5ec
I20260808 02:30:57.857988 28845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32eab90a8afc404fb44d7630937c4408: Bootstrap starting.
Aug 08 02:30:57 dist-test-slave-45dx krb5kdc[28713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:30:57.861879 28845 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32eab90a8afc404fb44d7630937c4408: Neither blocks nor log segments found. Creating new log.
I20260808 02:30:57.862962 28845 log.cc:824] T 00000000000000000000000000000000 P 32eab90a8afc404fb44d7630937c4408: Log is configured to *not* fsync() on all Append() calls
I20260808 02:30:57.865854 28845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32eab90a8afc404fb44d7630937c4408: No bootstrap required, opened a new log
I20260808 02:30:57.869525 28850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:57.847765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37588 (local address 127.24.116.254:39857)
0808 02:30:57.848651 (+ 886us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:57.848663 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:57.848704 (+ 41us) server_negotiation.cc:407] Connection header received
0808 02:30:57.850333 (+ 1629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:57.850358 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:57.850743 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:57.851055 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:57.852940 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:57.854333 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:57.856143 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:57.857059 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:57.857190 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:57.861929 (+ 4739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:57.861938 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:57.861952 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:57.862017 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:57.865300 (+ 3283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:57.866101 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:57.866108 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:57.866114 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:57.866282 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:57.866686 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:57.866691 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:57.866696 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:57.867211 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:57.867563 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:57.868008 (+ 445us) server_negotiation.cc:299] Negotiation successful
0808 02:30:57.868482 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":660,"thread_start_us":387,"threads_started":1}
I20260808 02:30:57.873797 28845 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32eab90a8afc404fb44d7630937c4408 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32eab90a8afc404fb44d7630937c4408" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39857 } }
I20260808 02:30:57.874183 28845 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32eab90a8afc404fb44d7630937c4408 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:30:57.874296 28845 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32eab90a8afc404fb44d7630937c4408 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32eab90a8afc404fb44d7630937c4408, State: Initialized, Role: FOLLOWER
I20260808 02:30:57.874889 28845 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32eab90a8afc404fb44d7630937c4408 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32eab90a8afc404fb44d7630937c4408" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39857 } }
I20260808 02:30:57.875172 28845 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32eab90a8afc404fb44d7630937c4408 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:30:57.875313 28845 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32eab90a8afc404fb44d7630937c4408 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:30:57.875511 28845 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32eab90a8afc404fb44d7630937c4408 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:30:57.878093 28845 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32eab90a8afc404fb44d7630937c4408 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32eab90a8afc404fb44d7630937c4408" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39857 } }
I20260808 02:30:57.878603 28845 leader_election.cc:302] T 00000000000000000000000000000000 P 32eab90a8afc404fb44d7630937c4408 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32eab90a8afc404fb44d7630937c4408; no voters:
I20260808 02:30:57.879191 28845 leader_election.cc:288] T 00000000000000000000000000000000 P 32eab90a8afc404fb44d7630937c4408 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:30:57.879343 28856 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32eab90a8afc404fb44d7630937c4408 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:30:57.880059 28856 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32eab90a8afc404fb44d7630937c4408 [term 1 LEADER]: Becoming Leader. State: Replica: 32eab90a8afc404fb44d7630937c4408, State: Running, Role: LEADER
I20260808 02:30:57.880612 28856 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32eab90a8afc404fb44d7630937c4408 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32eab90a8afc404fb44d7630937c4408" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39857 } }
I20260808 02:30:57.881423 28845 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32eab90a8afc404fb44d7630937c4408 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:30:57.884131 28857 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32eab90a8afc404fb44d7630937c4408 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32eab90a8afc404fb44d7630937c4408" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32eab90a8afc404fb44d7630937c4408" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39857 } } }
I20260808 02:30:57.884671 28857 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32eab90a8afc404fb44d7630937c4408 [sys.catalog]: This master's current role is: LEADER
I20260808 02:30:57.884922 28859 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32eab90a8afc404fb44d7630937c4408 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32eab90a8afc404fb44d7630937c4408. Latest consensus state: current_term: 1 leader_uuid: "32eab90a8afc404fb44d7630937c4408" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32eab90a8afc404fb44d7630937c4408" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39857 } } }
I20260808 02:30:57.885515 28859 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32eab90a8afc404fb44d7630937c4408 [sys.catalog]: This master's current role is: LEADER
I20260808 02:30:57.887202 28872 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:30:57.892501 28872 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:30:57.901652 28872 catalog_manager.cc:1347] Generated new cluster ID: 77a631f2e7994f4a83337722660012e0
I20260808 02:30:57.901816 28872 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:30:57.916859 28872 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:30:57.918303 28872 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:30:57.933471 28872 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32eab90a8afc404fb44d7630937c4408: Generated new TSK 0
I20260808 02:30:57.934514 28872 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.116.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
I20260808 02:30:58.000106 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:39857
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:39045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:30:58.340939 28894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:30:58.341295 28894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:30:58.341480 28894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:30:58.348863 28894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:30:58.349035 28894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:30:58.349229 28894 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:30:58.358827 28894 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:39045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:39857
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:30:58.360123 28894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:30:58.361451 28894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:30:58.375289 28906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:58.375600 28904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:58.375917 28903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:30:58.376950 28894 server_base.cc:1034] running on GCE node
I20260808 02:30:58.377620 28894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:30:58.378597 28894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:30:58.379827 28894 hybrid_clock.cc:648] HybridClock initialized: now 1786156258379776 us; error 69 us; skew 500 ppm
I20260808 02:30:58.380148 28894 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:30:58 dist-test-slave-45dx krb5kdc[28713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156258, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:30:58.383718 28894 init.cc:377] Logged in from keytab as kudu/127.24.116.193@KRBTEST.COM (short username kudu)
I20260808 02:30:58.385241 28894 webserver.cc:460] Webserver started at http://127.24.116.193:46599/ using document root <none> and password file <none>
I20260808 02:30:58.385941 28894 fs_manager.cc:359] Metadata directory not provided
I20260808 02:30:58.386090 28894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:30:58.386426 28894 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:30:58.389658 28894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "e06258eac9104c07af9361c0e1813532"
format_stamp: "Formatted at 2026-08-08 02:30:58 on dist-test-slave-45dx"
server_key: "c0d48cd5a28bf224b27be6356fd32e01"
server_key_iv: "e0a39e0a5910ae944aab4dbd52574a00"
server_key_version: "encryptionkey@0"
I20260808 02:30:58.390445 28894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "e06258eac9104c07af9361c0e1813532"
format_stamp: "Formatted at 2026-08-08 02:30:58 on dist-test-slave-45dx"
server_key: "c0d48cd5a28bf224b27be6356fd32e01"
server_key_iv: "e0a39e0a5910ae944aab4dbd52574a00"
server_key_version: "encryptionkey@0"
I20260808 02:30:58.395759 28894 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260808 02:30:58.399296 28917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:58.400631 28894 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 02:30:58.400804 28894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "e06258eac9104c07af9361c0e1813532"
format_stamp: "Formatted at 2026-08-08 02:30:58 on dist-test-slave-45dx"
server_key: "c0d48cd5a28bf224b27be6356fd32e01"
server_key_iv: "e0a39e0a5910ae944aab4dbd52574a00"
server_key_version: "encryptionkey@0"
I20260808 02:30:58.401018 28894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:30:58.415269 28894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:30:58.419458 28894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:30:58.419764 28894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:30:58.420799 28894 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:30:58.422129 28894 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:30:58.422235 28894 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:58.422394 28894 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:30:58.422470 28894 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:58.457055 28894 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:34111
I20260808 02:30:58.457105 29105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:34111 every 8 connection(s)
I20260808 02:30:58.458370 28894 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:30:58.464278 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 28894
I20260808 02:30:58.464571 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:30:58.465194 25043 external_mini_cluster.cc:1428] Setting key eafea6ff88a1d80e9851cc1f45f9042b
Aug 08 02:30:58 dist-test-slave-45dx krb5kdc[28713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156258, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:30:58.478403 29110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:58.461028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:36395 (local address 127.24.116.254:39857)
0808 02:30:58.461486 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:58.461490 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:58.462489 (+ 999us) server_negotiation.cc:407] Connection header received
0808 02:30:58.464374 (+ 1885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:58.464379 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:58.464507 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:58.464634 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:58.466314 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:58.467087 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:58.468709 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:58.469139 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:58.469292 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:58.472786 (+ 3494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:58.472791 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:58.472795 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:58.472826 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:58.475357 (+ 2531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:58.476093 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:58.476101 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:58.476106 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:58.476233 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:58.476691 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:58.476697 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:58.476701 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:58.476966 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:58.477127 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:58.477795 (+ 668us) server_negotiation.cc:299] Negotiation successful
0808 02:30:58.478021 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":229,"threads_started":1}
I20260808 02:30:58.479331 29113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:58.461597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:39857 (local address 127.24.116.193:36395)
0808 02:30:58.462329 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:58.462368 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:58.464092 (+ 1724us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:58.464875 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:58.464883 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:58.465455 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:30:58.466143 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:58.466163 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:58.467263 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:58.467267 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:58.468561 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:58.468573 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:58.469388 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:58.469397 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:58.469640 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:58.470363 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:30:58.470391 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:30:58.472573 (+ 2182us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:30:58.475526 (+ 2953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:58.475534 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:58.475550 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:58.475971 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:58.476375 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:58.476380 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:58.476384 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:58.476575 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:58.477100 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:30:58.477108 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:30:58.477429 (+ 321us) client_negotiation.cc:769] Sending connection context
0808 02:30:58.477694 (+ 265us) client_negotiation.cc:240] Negotiation successful
0808 02:30:58.478216 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":288,"threads_started":1}
I20260808 02:30:58.480944 29106 heartbeater.cc:347] Connected to a master server at 127.24.116.254:39857
I20260808 02:30:58.481361 29106 heartbeater.cc:464] Registering TS with master...
I20260808 02:30:58.482312 29106 heartbeater.cc:511] Master 127.24.116.254:39857 requested a full tablet report, sending...
I20260808 02:30:58.484992 28789 ts_manager.cc:194] Registered new tserver with Master: e06258eac9104c07af9361c0e1813532 (127.24.116.193:34111)
I20260808 02:30:58.487283 28789 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.193@KRBTEST.COM'} at 127.24.116.193:36395
WARNING: no policy specified for kudu/127.24.116.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
I20260808 02:30:58.519227 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:39857
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:39045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:30:58.890445 29118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:30:58.890782 29118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:30:58.890952 29118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:30:58.899240 29118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:30:58.899384 29118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:30:58.899570 29118 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:30:58.909579 29118 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:39045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:39857
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:30:58.910898 29118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:30:58.912250 29118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:30:58.926824 29129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:58.926882 29130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:58.927443 29135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:30:58.927994 29118 server_base.cc:1034] running on GCE node
I20260808 02:30:58.928718 29118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:30:58.929744 29118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:30:58.930999 29118 hybrid_clock.cc:648] HybridClock initialized: now 1786156258930941 us; error 49 us; skew 500 ppm
I20260808 02:30:58.931355 29118 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:30:58 dist-test-slave-45dx krb5kdc[28713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156258, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:30:58.934664 29118 init.cc:377] Logged in from keytab as kudu/127.24.116.194@KRBTEST.COM (short username kudu)
I20260808 02:30:58.936439 29118 webserver.cc:460] Webserver started at http://127.24.116.194:40665/ using document root <none> and password file <none>
I20260808 02:30:58.937156 29118 fs_manager.cc:359] Metadata directory not provided
I20260808 02:30:58.937284 29118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:30:58.937619 29118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:30:58.940653 29118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "4a43fe32b80742718c75ecb55c75b13f"
format_stamp: "Formatted at 2026-08-08 02:30:58 on dist-test-slave-45dx"
server_key: "22f16236519b6f97003f6a6530779a13"
server_key_iv: "1695d5910967ff48b8c03f92c2cf4fc8"
server_key_version: "encryptionkey@0"
I20260808 02:30:58.941462 29118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "4a43fe32b80742718c75ecb55c75b13f"
format_stamp: "Formatted at 2026-08-08 02:30:58 on dist-test-slave-45dx"
server_key: "22f16236519b6f97003f6a6530779a13"
server_key_iv: "1695d5910967ff48b8c03f92c2cf4fc8"
server_key_version: "encryptionkey@0"
I20260808 02:30:58.946769 29118 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 02:30:58.950280 29147 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:58.951630 29118 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 02:30:58.951790 29118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "4a43fe32b80742718c75ecb55c75b13f"
format_stamp: "Formatted at 2026-08-08 02:30:58 on dist-test-slave-45dx"
server_key: "22f16236519b6f97003f6a6530779a13"
server_key_iv: "1695d5910967ff48b8c03f92c2cf4fc8"
server_key_version: "encryptionkey@0"
I20260808 02:30:58.951972 29118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:30:58.983060 29118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:30:58.987875 29118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:30:58.988179 29118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:30:58.989374 29118 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:30:58.990865 29118 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:30:58.990949 29118 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:58.991127 29118 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:30:58.991202 29118 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:59.033377 29118 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:43811
I20260808 02:30:59.033427 29335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:43811 every 8 connection(s)
I20260808 02:30:59.034657 29118 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:30:59.037258 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 29118
I20260808 02:30:59.037493 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:30:59.038038 25043 external_mini_cluster.cc:1428] Setting key 08db481c7bb145bd2a15404f1a5db039
Aug 08 02:30:59 dist-test-slave-45dx krb5kdc[28713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156258, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:30:59.057017 29342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:59.037455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:58911 (local address 127.24.116.254:39857)
0808 02:30:59.038066 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:59.038073 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:59.039349 (+ 1276us) server_negotiation.cc:407] Connection header received
0808 02:30:59.041385 (+ 2036us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:59.041392 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:59.041488 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:59.041610 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:59.043148 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:59.044357 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:59.046056 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:59.046786 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:59.046966 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:59.050943 (+ 3977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:59.050949 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:59.050952 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:59.050984 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:59.053702 (+ 2718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:59.054427 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:59.054435 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:59.054440 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:59.054573 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:59.055038 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:59.055043 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:59.055048 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:59.055315 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:59.055506 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:59.056375 (+ 869us) server_negotiation.cc:299] Negotiation successful
0808 02:30:59.056606 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":248,"threads_started":1}
I20260808 02:30:59.058033 29343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:59.038069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:39857 (local address 127.24.116.194:58911)
0808 02:30:59.039162 (+ 1093us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:59.039218 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:59.041100 (+ 1882us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:59.041865 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:59.041873 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:59.042389 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:30:59.042964 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:59.042982 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:59.044518 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:59.044522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:59.045911 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:59.045924 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:59.047005 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:59.047010 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:59.047201 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:59.047909 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:30:59.047931 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:30:59.050722 (+ 2791us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:30:59.053850 (+ 3128us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:59.053859 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:59.053874 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:59.054301 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:59.054689 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:59.054701 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:59.054705 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:59.054922 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:59.055456 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:30:59.055464 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:30:59.055916 (+ 452us) client_negotiation.cc:769] Sending connection context
0808 02:30:59.056275 (+ 359us) client_negotiation.cc:240] Negotiation successful
0808 02:30:59.056827 (+ 552us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":710,"thread_start_us":385,"threads_started":1}
I20260808 02:30:59.059558 29338 heartbeater.cc:347] Connected to a master server at 127.24.116.254:39857
I20260808 02:30:59.059933 29338 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.24.116.195@KRBTEST.COM; defaulting to no policy
I20260808 02:30:59.060946 29338 heartbeater.cc:511] Master 127.24.116.254:39857 requested a full tablet report, sending...
I20260808 02:30:59.062492 28789 ts_manager.cc:194] Registered new tserver with Master: 4a43fe32b80742718c75ecb55c75b13f (127.24.116.194:43811)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.195@KRBTEST.COM" created.
I20260808 02:30:59.063330 28789 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.194@KRBTEST.COM'} at 127.24.116.194:58911
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
I20260808 02:30:59.091316 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:39857
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:39045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:30:59.429477 29346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:30:59.429747 29346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:30:59.429841 29346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:30:59.437556 29346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:30:59.437665 29346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:30:59.437774 29346 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:30:59.447705 29346 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:39045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:39857
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:30:59.449014 29346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:30:59.450260 29346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:30:59.464119 29353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:59.464175 29356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:30:59.464280 29352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:30:59.465334 29346 server_base.cc:1034] running on GCE node
I20260808 02:30:59.465911 29346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:30:59.466773 29346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:30:59.467988 29346 hybrid_clock.cc:648] HybridClock initialized: now 1786156259467945 us; error 40 us; skew 500 ppm
I20260808 02:30:59.468366 29346 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:30:59 dist-test-slave-45dx krb5kdc[28713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156259, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:30:59.471481 29346 init.cc:377] Logged in from keytab as kudu/127.24.116.195@KRBTEST.COM (short username kudu)
I20260808 02:30:59.473060 29346 webserver.cc:460] Webserver started at http://127.24.116.195:40067/ using document root <none> and password file <none>
I20260808 02:30:59.473765 29346 fs_manager.cc:359] Metadata directory not provided
I20260808 02:30:59.473927 29346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:30:59.474246 29346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:30:59.477195 29346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "5096f85a3a654d2d9ad97a00a0a249d3"
format_stamp: "Formatted at 2026-08-08 02:30:59 on dist-test-slave-45dx"
server_key: "9c9c96733e03502dce6665c985d2944a"
server_key_iv: "e15fe9699f0b6d8f009d148826a715fb"
server_key_version: "encryptionkey@0"
I20260808 02:30:59.478029 29346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "5096f85a3a654d2d9ad97a00a0a249d3"
format_stamp: "Formatted at 2026-08-08 02:30:59 on dist-test-slave-45dx"
server_key: "9c9c96733e03502dce6665c985d2944a"
server_key_iv: "e15fe9699f0b6d8f009d148826a715fb"
server_key_version: "encryptionkey@0"
I20260808 02:30:59.483304 29346 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260808 02:30:59.486865 29371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:59.488243 29346 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 02:30:59.488476 29346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "5096f85a3a654d2d9ad97a00a0a249d3"
format_stamp: "Formatted at 2026-08-08 02:30:59 on dist-test-slave-45dx"
server_key: "9c9c96733e03502dce6665c985d2944a"
server_key_iv: "e15fe9699f0b6d8f009d148826a715fb"
server_key_version: "encryptionkey@0"
I20260808 02:30:59.488677 29346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:30:59.490635 29106 heartbeater.cc:503] Master 127.24.116.254:39857 was elected leader, sending a full tablet report...
I20260808 02:30:59.513422 29346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:30:59.517493 29346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:30:59.517800 29346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:30:59.518790 29346 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:30:59.520181 29346 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:30:59.520288 29346 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:59.520428 29346 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:30:59.520509 29346 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:30:59.554322 29346 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:42097
I20260808 02:30:59.554426 29533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:42097 every 8 connection(s)
I20260808 02:30:59.555676 29346 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:30:59.563531 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 29346
I20260808 02:30:59.563750 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:30:59.564162 25043 external_mini_cluster.cc:1428] Setting key b6b6bc5914297a07e44c4fe3aff8be60
Aug 08 02:30:59 dist-test-slave-45dx krb5kdc[28713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156259, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:30:59.577222 29539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:59.558417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:33217 (local address 127.24.116.254:39857)
0808 02:30:59.558907 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:59.558914 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:59.559873 (+ 959us) server_negotiation.cc:407] Connection header received
0808 02:30:59.561669 (+ 1796us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:59.561674 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:59.561761 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:59.561902 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:59.563448 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:59.564436 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:59.566584 (+ 2148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:30:59.567211 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:30:59.567344 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:59.570808 (+ 3464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:30:59.570812 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:30:59.570816 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:30:59.570847 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:30:59.574233 (+ 3386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:59.575175 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:59.575179 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:59.575181 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:59.575307 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:30:59.575718 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:30:59.575722 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:30:59.575724 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:30:59.575976 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:30:59.576092 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 02:30:59.576784 (+ 692us) server_negotiation.cc:299] Negotiation successful
0808 02:30:59.576946 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":215,"threads_started":1}
I20260808 02:30:59.578200 29540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:30:59.559032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:39857 (local address 127.24.116.195:33217)
0808 02:30:59.559707 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0808 02:30:59.559745 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 02:30:59.561431 (+ 1686us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:30:59.562114 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:30:59.562121 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:30:59.562617 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:30:59.563264 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:59.563294 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:59.564601 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:59.564606 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:59.566452 (+ 1846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:30:59.566463 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:30:59.567476 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:30:59.567485 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:30:59.567700 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:30:59.568434 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:30:59.568457 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:30:59.570620 (+ 2163us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:30:59.574406 (+ 3786us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:59.574415 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:59.574432 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:59.575058 (+ 626us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:59.575421 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:30:59.575426 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:30:59.575430 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:30:59.575620 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:30:59.576091 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:30:59.576097 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:30:59.576465 (+ 368us) client_negotiation.cc:769] Sending connection context
0808 02:30:59.576706 (+ 241us) client_negotiation.cc:240] Negotiation successful
0808 02:30:59.577077 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":264,"threads_started":1}
I20260808 02:30:59.579669 29535 heartbeater.cc:347] Connected to a master server at 127.24.116.254:39857
I20260808 02:30:59.580005 29535 heartbeater.cc:464] Registering TS with master...
I20260808 02:30:59.580771 29535 heartbeater.cc:511] Master 127.24.116.254:39857 requested a full tablet report, sending...
I20260808 02:30:59.582253 28789 ts_manager.cc:194] Registered new tserver with Master: 5096f85a3a654d2d9ad97a00a0a249d3 (127.24.116.195:42097)
I20260808 02:30:59.583081 28789 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.195@KRBTEST.COM'} at 127.24.116.195:33217
I20260808 02:30:59.591881 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 02:30:59.631661 29539 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:30:59.629159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37590 (local address 127.24.116.254:39857)
0808 02:30:59.629432 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0808 02:30:59.629439 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:30:59.629738 (+ 299us) server_negotiation.cc:407] Connection header received
0808 02:30:59.629892 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:30:59.629898 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:30:59.629982 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:30:59.630072 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:30:59.631351 (+ 1279us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37590: BlockingRecv error: recv got EOF from 127.0.0.1:37590 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 02:30:59.635007 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 28894
W20260808 02:30:59.637661 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 28894: Not authorized: Client connection negotiation failed: client connection to 127.24.116.193:34111: server requires authentication, but client does not have Kerberos credentials available
I20260808 02:30:59.637849 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 28894
I20260808 02:30:59.666325 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 29118
W20260808 02:30:59.669306 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 29118: Not authorized: Client connection negotiation failed: client connection to 127.24.116.194:43811: server requires authentication, but client does not have Kerberos credentials available
I20260808 02:30:59.669502 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 29118
I20260808 02:30:59.694967 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 29346
W20260808 02:30:59.697926 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 29346: Not authorized: Client connection negotiation failed: client connection to 127.24.116.195:42097: server requires authentication, but client does not have Kerberos credentials available
I20260808 02:30:59.698051 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 29346
I20260808 02:30:59.724934 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 28737
I20260808 02:30:59.726203 28840 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:30:59.831174 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 28737
2026-08-08T02:30:59Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3991 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:30:59 dist-test-slave-45dx krb5kdc[29563](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:30:59 dist-test-slave-45dx krb5kdc[29563](info): set up 2 sockets
Aug 08 02:30:59 dist-test-slave-45dx krb5kdc[29563](info): commencing operation
krb5kdc: starting...
W20260808 02:31:01.155088 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.275s user 0.005s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:31:01 dist-test-slave-45dx krb5kdc[29563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156261, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:31:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:31:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:31:01.384991 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:39775
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:33871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:39775
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:01.727334 29582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:01.727617 29582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:01.727811 29582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:01.735072 29582 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:31:01.735204 29582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:01.735317 29582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:01.735415 29582 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:31:01.735512 29582 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:31:01.745388 29582 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:33871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:39775
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:39775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:01.746810 29582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:01.748203 29582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:01.759791 29597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:01.759843 29591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:01.760322 29601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:01.760630 29582 server_base.cc:1034] running on GCE node
I20260808 02:31:01.761430 29582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:01.762778 29582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:01.764036 29582 hybrid_clock.cc:648] HybridClock initialized: now 1786156261763987 us; error 50 us; skew 500 ppm
I20260808 02:31:01.764545 29582 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:01 dist-test-slave-45dx krb5kdc[29563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156261, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:01.773969 29582 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:31:01.775543 29582 webserver.cc:460] Webserver started at http://127.24.116.254:41117/ using document root <none> and password file <none>
I20260808 02:31:01.776235 29582 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:01.776409 29582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:01.776793 29582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:01.780771 29582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "2887baa4f07e4d45a098ebf6cdde2079"
format_stamp: "Formatted at 2026-08-08 02:31:01 on dist-test-slave-45dx"
server_key: "3e671f194b9cc516da3ca1c65798f540"
server_key_iv: "59f138a3fbf707b7ea6f28af628d93c0"
server_key_version: "encryptionkey@0"
I20260808 02:31:01.781541 29582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "2887baa4f07e4d45a098ebf6cdde2079"
format_stamp: "Formatted at 2026-08-08 02:31:01 on dist-test-slave-45dx"
server_key: "3e671f194b9cc516da3ca1c65798f540"
server_key_iv: "59f138a3fbf707b7ea6f28af628d93c0"
server_key_version: "encryptionkey@0"
I20260808 02:31:01.786782 29582 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 02:31:01.790299 29610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:01.791652 29582 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 02:31:01.791795 29582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "2887baa4f07e4d45a098ebf6cdde2079"
format_stamp: "Formatted at 2026-08-08 02:31:01 on dist-test-slave-45dx"
server_key: "3e671f194b9cc516da3ca1c65798f540"
server_key_iv: "59f138a3fbf707b7ea6f28af628d93c0"
server_key_version: "encryptionkey@0"
I20260808 02:31:01.791955 29582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:01.807974 29582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:01.811834 29582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:01.812078 29582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:01.830729 29582 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:39775
I20260808 02:31:01.830765 29686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:39775 every 8 connection(s)
I20260808 02:31:01.832080 29582 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:31:01.835753 29687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:01.838558 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 29582
I20260808 02:31:01.838799 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:31:01.839674 25043 external_mini_cluster.cc:1428] Setting key 144d353361b6ef3cf0168bec7db2df6a
I20260808 02:31:01.849123 29687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2887baa4f07e4d45a098ebf6cdde2079: Bootstrap starting.
I20260808 02:31:01.853065 29687 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2887baa4f07e4d45a098ebf6cdde2079: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:01.854445 29687 log.cc:824] T 00000000000000000000000000000000 P 2887baa4f07e4d45a098ebf6cdde2079: Log is configured to *not* fsync() on all Append() calls
Aug 08 02:31:01 dist-test-slave-45dx krb5kdc[29563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156261, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:31:01.857386 29687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2887baa4f07e4d45a098ebf6cdde2079: No bootstrap required, opened a new log
I20260808 02:31:01.863675 29690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:01.841668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58902 (local address 127.24.116.254:39775)
0808 02:31:01.842554 (+ 886us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:01.842565 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:01.842614 (+ 49us) server_negotiation.cc:407] Connection header received
0808 02:31:01.844287 (+ 1673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:01.844373 (+ 86us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:01.844753 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:01.845086 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:01.847043 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:01.848508 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:01.850224 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:01.850909 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:01.851076 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:01.856190 (+ 5114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:01.856197 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:01.856211 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:01.856248 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:01.859500 (+ 3252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:01.860263 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:01.860270 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:01.860280 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:01.860515 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:01.860909 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:01.860914 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:01.860917 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:01.861474 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:01.861828 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:01.862280 (+ 452us) server_negotiation.cc:299] Negotiation successful
0808 02:31:01.862693 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":669,"thread_start_us":445,"threads_started":1}
I20260808 02:31:01.865281 29687 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2887baa4f07e4d45a098ebf6cdde2079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2887baa4f07e4d45a098ebf6cdde2079" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39775 } }
I20260808 02:31:01.865656 29687 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2887baa4f07e4d45a098ebf6cdde2079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:01.865798 29687 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2887baa4f07e4d45a098ebf6cdde2079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2887baa4f07e4d45a098ebf6cdde2079, State: Initialized, Role: FOLLOWER
I20260808 02:31:01.866506 29687 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2887baa4f07e4d45a098ebf6cdde2079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2887baa4f07e4d45a098ebf6cdde2079" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39775 } }
I20260808 02:31:01.866814 29687 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2887baa4f07e4d45a098ebf6cdde2079 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:31:01.866971 29687 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2887baa4f07e4d45a098ebf6cdde2079 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:31:01.867172 29687 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2887baa4f07e4d45a098ebf6cdde2079 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:01.867772 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:31:01.870528 29687 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2887baa4f07e4d45a098ebf6cdde2079 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2887baa4f07e4d45a098ebf6cdde2079" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39775 } }
I20260808 02:31:01.871131 29687 leader_election.cc:302] T 00000000000000000000000000000000 P 2887baa4f07e4d45a098ebf6cdde2079 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2887baa4f07e4d45a098ebf6cdde2079; no voters:
I20260808 02:31:01.871824 29687 leader_election.cc:288] T 00000000000000000000000000000000 P 2887baa4f07e4d45a098ebf6cdde2079 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:31:01.871892 29696 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2887baa4f07e4d45a098ebf6cdde2079 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:31:01.873472 29696 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2887baa4f07e4d45a098ebf6cdde2079 [term 1 LEADER]: Becoming Leader. State: Replica: 2887baa4f07e4d45a098ebf6cdde2079, State: Running, Role: LEADER
I20260808 02:31:01.874015 29696 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2887baa4f07e4d45a098ebf6cdde2079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2887baa4f07e4d45a098ebf6cdde2079" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39775 } }
I20260808 02:31:01.874205 29687 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2887baa4f07e4d45a098ebf6cdde2079 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:31:01.876748 29699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2887baa4f07e4d45a098ebf6cdde2079 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2887baa4f07e4d45a098ebf6cdde2079. Latest consensus state: current_term: 1 leader_uuid: "2887baa4f07e4d45a098ebf6cdde2079" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2887baa4f07e4d45a098ebf6cdde2079" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39775 } } }
I20260808 02:31:01.877158 29699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2887baa4f07e4d45a098ebf6cdde2079 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:01.877770 29698 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2887baa4f07e4d45a098ebf6cdde2079 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2887baa4f07e4d45a098ebf6cdde2079" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2887baa4f07e4d45a098ebf6cdde2079" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39775 } } }
I20260808 02:31:01.878067 29698 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2887baa4f07e4d45a098ebf6cdde2079 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:01.880333 29708 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:31:01.899691 29708 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:31:01.918509 29708 catalog_manager.cc:1347] Generated new cluster ID: a2e65c15cbd04d89a5e87bfc3f4c52d9
I20260808 02:31:01.918670 29708 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:31:01.943984 29690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:01.934635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58916 (local address 127.24.116.254:39775)
0808 02:31:01.934825 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:01.934835 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:01.935301 (+ 466us) server_negotiation.cc:407] Connection header received
0808 02:31:01.935501 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:01.935507 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:01.935592 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:01.935703 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:01.937060 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:01.938288 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:01.940033 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:01.940730 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:01.940886 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:01.942126 (+ 1240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:01.942132 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:01.942137 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:31:01.943098 (+ 961us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:01.943175 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:31:01.943217 (+ 42us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:01.943340 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:01.943468 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 02:31:01.943566 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":41}
I20260808 02:31:01.963071 29708 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:31:01.964416 29708 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:31:01.975442 29708 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2887baa4f07e4d45a098ebf6cdde2079: Generated new TSK 0
I20260808 02:31:01.976541 29708 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:31:01.988654 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 29582
I20260808 02:31:01.990319 29681 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:02.085057 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 29582
2026-08-08T02:31:02Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2249 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:31:02 dist-test-slave-45dx krb5kdc[29740](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:31:02 dist-test-slave-45dx krb5kdc[29740](info): set up 2 sockets
Aug 08 02:31:02 dist-test-slave-45dx krb5kdc[29740](info): commencing operation
krb5kdc: starting...
W20260808 02:31:03.405709 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.276s user 0.000s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:31:03 dist-test-slave-45dx krb5kdc[29740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156263, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:31:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:31:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:31:03.635485 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:36639
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:43399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:36639
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:03.964425 29760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:03.964781 29760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:03.964937 29760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:03.972119 29760 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:31:03.972265 29760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:03.972391 29760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:03.972504 29760 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:31:03.972582 29760 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:31:03.982208 29760 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:43399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:36639
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:36639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:03.983553 29760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:03.984927 29760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:03.996591 29774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:03.996706 29767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:03.996773 29766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:03.997830 29760 server_base.cc:1034] running on GCE node
I20260808 02:31:03.998631 29760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:04.000054 29760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:04.001291 29760 hybrid_clock.cc:648] HybridClock initialized: now 1786156264001231 us; error 43 us; skew 500 ppm
I20260808 02:31:04.001653 29760 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:03 dist-test-slave-45dx krb5kdc[29740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156263, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:04.004773 29760 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:31:04.006210 29760 webserver.cc:460] Webserver started at http://127.24.116.254:35349/ using document root <none> and password file <none>
I20260808 02:31:04.006876 29760 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:04.006989 29760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:04.007331 29760 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:04.010387 29760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "9d163a444d5741dfa917d810f8e7890b"
format_stamp: "Formatted at 2026-08-08 02:31:04 on dist-test-slave-45dx"
server_key: "df7a0a3e9776bfb284b49c82accb3b0e"
server_key_iv: "e9729c0dda7e1bab51b136b3767a269e"
server_key_version: "encryptionkey@0"
I20260808 02:31:04.011092 29760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "9d163a444d5741dfa917d810f8e7890b"
format_stamp: "Formatted at 2026-08-08 02:31:04 on dist-test-slave-45dx"
server_key: "df7a0a3e9776bfb284b49c82accb3b0e"
server_key_iv: "e9729c0dda7e1bab51b136b3767a269e"
server_key_version: "encryptionkey@0"
I20260808 02:31:04.016280 29760 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 02:31:04.019573 29792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:04.020944 29760 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 02:31:04.021131 29760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "9d163a444d5741dfa917d810f8e7890b"
format_stamp: "Formatted at 2026-08-08 02:31:04 on dist-test-slave-45dx"
server_key: "df7a0a3e9776bfb284b49c82accb3b0e"
server_key_iv: "e9729c0dda7e1bab51b136b3767a269e"
server_key_version: "encryptionkey@0"
I20260808 02:31:04.021327 29760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:04.051998 29760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:04.055943 29760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:04.056252 29760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:04.074970 29760 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:36639
I20260808 02:31:04.075011 29872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:36639 every 8 connection(s)
I20260808 02:31:04.076383 29760 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:31:04.077625 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 29760
I20260808 02:31:04.077852 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:31:04.078518 25043 external_mini_cluster.cc:1428] Setting key f5502014bd5c9598ae9eb6a886e11124
I20260808 02:31:04.080845 29873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 02:31:04 dist-test-slave-45dx krb5kdc[29740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156263, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:31:04.095086 29873 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d163a444d5741dfa917d810f8e7890b: Bootstrap starting.
I20260808 02:31:04.098342 29873 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d163a444d5741dfa917d810f8e7890b: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:04.099670 29873 log.cc:824] T 00000000000000000000000000000000 P 9d163a444d5741dfa917d810f8e7890b: Log is configured to *not* fsync() on all Append() calls
I20260808 02:31:04.102787 29877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:04.080643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45972 (local address 127.24.116.254:36639)
0808 02:31:04.081523 (+ 880us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:04.081535 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:04.081578 (+ 43us) server_negotiation.cc:407] Connection header received
0808 02:31:04.083282 (+ 1704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:04.083303 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:04.083686 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:04.084000 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:04.085905 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:04.087193 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:04.088992 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:04.089653 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:04.089784 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:04.095074 (+ 5290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:04.095082 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:04.095097 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:04.095131 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:04.098310 (+ 3179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:04.099153 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:04.099160 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:04.099166 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:04.099325 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:04.099775 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:04.099799 (+ 24us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:04.099805 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:04.100516 (+ 711us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:04.100897 (+ 381us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:04.101401 (+ 504us) server_negotiation.cc:299] Negotiation successful
0808 02:31:04.101773 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":648,"thread_start_us":400,"threads_started":1}
I20260808 02:31:04.102967 29873 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d163a444d5741dfa917d810f8e7890b: No bootstrap required, opened a new log
I20260808 02:31:04.111418 29873 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d163a444d5741dfa917d810f8e7890b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d163a444d5741dfa917d810f8e7890b" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 36639 } }
I20260808 02:31:04.111929 29873 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d163a444d5741dfa917d810f8e7890b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:04.112064 29873 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d163a444d5741dfa917d810f8e7890b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d163a444d5741dfa917d810f8e7890b, State: Initialized, Role: FOLLOWER
I20260808 02:31:04.112713 29873 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d163a444d5741dfa917d810f8e7890b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d163a444d5741dfa917d810f8e7890b" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 36639 } }
I20260808 02:31:04.112963 29873 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d163a444d5741dfa917d810f8e7890b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:31:04.113111 29873 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d163a444d5741dfa917d810f8e7890b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:31:04.113308 29873 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d163a444d5741dfa917d810f8e7890b [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:04.115442 29873 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d163a444d5741dfa917d810f8e7890b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d163a444d5741dfa917d810f8e7890b" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 36639 } }
I20260808 02:31:04.115917 29873 leader_election.cc:302] T 00000000000000000000000000000000 P 9d163a444d5741dfa917d810f8e7890b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d163a444d5741dfa917d810f8e7890b; no voters:
I20260808 02:31:04.116529 29873 leader_election.cc:288] T 00000000000000000000000000000000 P 9d163a444d5741dfa917d810f8e7890b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:31:04.116647 29881 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d163a444d5741dfa917d810f8e7890b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:31:04.117345 29881 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d163a444d5741dfa917d810f8e7890b [term 1 LEADER]: Becoming Leader. State: Replica: 9d163a444d5741dfa917d810f8e7890b, State: Running, Role: LEADER
I20260808 02:31:04.117822 29881 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d163a444d5741dfa917d810f8e7890b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d163a444d5741dfa917d810f8e7890b" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 36639 } }
I20260808 02:31:04.118574 29873 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d163a444d5741dfa917d810f8e7890b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:31:04.120950 29882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d163a444d5741dfa917d810f8e7890b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d163a444d5741dfa917d810f8e7890b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d163a444d5741dfa917d810f8e7890b" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 36639 } } }
I20260808 02:31:04.121009 29883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d163a444d5741dfa917d810f8e7890b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d163a444d5741dfa917d810f8e7890b. Latest consensus state: current_term: 1 leader_uuid: "9d163a444d5741dfa917d810f8e7890b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d163a444d5741dfa917d810f8e7890b" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 36639 } } }
I20260808 02:31:04.121419 29882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d163a444d5741dfa917d810f8e7890b [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:04.121424 29883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d163a444d5741dfa917d810f8e7890b [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:04.122305 29891 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:31:04.128230 29891 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:31:04.137567 29891 catalog_manager.cc:1347] Generated new cluster ID: fcac8332c9f44273acbe43a9d643b76d
I20260808 02:31:04.137699 29891 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:31:04.154597 29891 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:31:04.155851 29891 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:31:04.163744 29891 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d163a444d5741dfa917d810f8e7890b: Generated new TSK 0
I20260808 02:31:04.164557 29891 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.116.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
I20260808 02:31:04.232010 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:36639
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:43399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:04.611737 29911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:04.612037 29911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:04.612147 29911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:04.619598 29911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:04.619751 29911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:04.619964 29911 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:31:04.630016 29911 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:43399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:36639
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:04.631403 29911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:04.633073 29911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:04.646915 29920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:04.646857 29922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:04.646952 29925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:04.647742 29911 server_base.cc:1034] running on GCE node
I20260808 02:31:04.648355 29911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:04.649266 29911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:04.650501 29911 hybrid_clock.cc:648] HybridClock initialized: now 1786156264650446 us; error 31 us; skew 500 ppm
I20260808 02:31:04.650866 29911 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:04 dist-test-slave-45dx krb5kdc[29740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156264, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:04.654268 29911 init.cc:377] Logged in from keytab as kudu/127.24.116.193@KRBTEST.COM (short username kudu)
I20260808 02:31:04.655756 29911 webserver.cc:460] Webserver started at http://127.24.116.193:35077/ using document root <none> and password file <none>
I20260808 02:31:04.656551 29911 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:04.656708 29911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:04.657047 29911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:04.660013 29911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "f261f83255054ebc9bc7696aa98356dc"
format_stamp: "Formatted at 2026-08-08 02:31:04 on dist-test-slave-45dx"
server_key: "9a9aa7fa8ec9d8cd741a5c7fd6f25689"
server_key_iv: "c76ad4541e76000dee831b1120fbceac"
server_key_version: "encryptionkey@0"
I20260808 02:31:04.660830 29911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "f261f83255054ebc9bc7696aa98356dc"
format_stamp: "Formatted at 2026-08-08 02:31:04 on dist-test-slave-45dx"
server_key: "9a9aa7fa8ec9d8cd741a5c7fd6f25689"
server_key_iv: "c76ad4541e76000dee831b1120fbceac"
server_key_version: "encryptionkey@0"
I20260808 02:31:04.665990 29911 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260808 02:31:04.669395 29940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:04.670680 29911 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 02:31:04.670907 29911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "f261f83255054ebc9bc7696aa98356dc"
format_stamp: "Formatted at 2026-08-08 02:31:04 on dist-test-slave-45dx"
server_key: "9a9aa7fa8ec9d8cd741a5c7fd6f25689"
server_key_iv: "c76ad4541e76000dee831b1120fbceac"
server_key_version: "encryptionkey@0"
I20260808 02:31:04.671113 29911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:04.695791 29911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:04.700012 29911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:04.700357 29911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:04.701367 29911 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:04.702764 29911 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:04.702885 29911 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:04.703039 29911 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:04.703115 29911 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:04.737598 29911 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:41911
I20260808 02:31:04.737656 30107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:41911 every 8 connection(s)
I20260808 02:31:04.739063 29911 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:31:04.749208 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 29911
I20260808 02:31:04.749442 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:31:04.750144 25043 external_mini_cluster.cc:1428] Setting key b0b08dd0a4e3f2e75e307655fcd87ca3
Aug 08 02:31:04 dist-test-slave-45dx krb5kdc[29740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156264, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:31:04.760115 30110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:04.741755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:54239 (local address 127.24.116.254:36639)
0808 02:31:04.742224 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:04.742228 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:04.743173 (+ 945us) server_negotiation.cc:407] Connection header received
0808 02:31:04.745127 (+ 1954us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:04.745133 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:04.745224 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:04.745348 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:04.746845 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:04.747583 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:04.749628 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:04.750031 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:04.750138 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:04.754072 (+ 3934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:04.754077 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:04.754081 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:04.754112 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:04.756778 (+ 2666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:04.757528 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:04.757533 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:04.757535 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:04.757653 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:04.758096 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:04.758101 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:04.758110 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:04.758366 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:04.758548 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:04.759360 (+ 812us) server_negotiation.cc:299] Negotiation successful
0808 02:31:04.759622 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":249,"threads_started":1}
I20260808 02:31:04.760928 30111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:04.742312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:36639 (local address 127.24.116.193:54239)
0808 02:31:04.743021 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:04.743059 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:04.744827 (+ 1768us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:04.745591 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:04.745599 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:04.746110 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:04.746668 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:04.746684 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:04.747756 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:04.747761 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:04.749432 (+ 1671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:04.749450 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:04.750285 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:04.750294 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:04.750608 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:04.751381 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:04.751408 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:04.753825 (+ 2417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:04.756924 (+ 3099us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:04.756933 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:04.756951 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:04.757391 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:04.757767 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:04.757772 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:04.757776 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:04.757973 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:04.758517 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:04.758525 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:04.758863 (+ 338us) client_negotiation.cc:769] Sending connection context
0808 02:31:04.759170 (+ 307us) client_negotiation.cc:240] Negotiation successful
0808 02:31:04.759627 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":270,"threads_started":1}
I20260808 02:31:04.762542 30108 heartbeater.cc:347] Connected to a master server at 127.24.116.254:36639
I20260808 02:31:04.762861 30108 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:04.763608 30108 heartbeater.cc:511] Master 127.24.116.254:36639 requested a full tablet report, sending...
I20260808 02:31:04.765743 29819 ts_manager.cc:194] Registered new tserver with Master: f261f83255054ebc9bc7696aa98356dc (127.24.116.193:41911)
I20260808 02:31:04.767202 29819 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.193@KRBTEST.COM'} at 127.24.116.193:54239
WARNING: no policy specified for kudu/127.24.116.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
I20260808 02:31:04.805378 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:36639
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:43399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:05.142869 30115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:05.143213 30115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:05.143392 30115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:05.150859 30115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:05.151015 30115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:05.151203 30115 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:31:05.161170 30115 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:43399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:36639
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:05.162578 30115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:05.164013 30115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:05.177248 30123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:05.177328 30127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:05.177364 30124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:05.178483 30115 server_base.cc:1034] running on GCE node
I20260808 02:31:05.179136 30115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:05.180152 30115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:05.181373 30115 hybrid_clock.cc:648] HybridClock initialized: now 1786156265181300 us; error 63 us; skew 500 ppm
I20260808 02:31:05.181711 30115 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:05 dist-test-slave-45dx krb5kdc[29740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156265, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:05.185041 30115 init.cc:377] Logged in from keytab as kudu/127.24.116.194@KRBTEST.COM (short username kudu)
I20260808 02:31:05.186582 30115 webserver.cc:460] Webserver started at http://127.24.116.194:44261/ using document root <none> and password file <none>
I20260808 02:31:05.187239 30115 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:05.187340 30115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:05.187601 30115 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:05.190595 30115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "a3731bcdf76c4ea9b0ceaafc2e697b5e"
format_stamp: "Formatted at 2026-08-08 02:31:05 on dist-test-slave-45dx"
server_key: "9edc16b18d4148c2e477b412842d55a8"
server_key_iv: "b2fa75d583e6f6da80794001ce4f131a"
server_key_version: "encryptionkey@0"
I20260808 02:31:05.191345 30115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "a3731bcdf76c4ea9b0ceaafc2e697b5e"
format_stamp: "Formatted at 2026-08-08 02:31:05 on dist-test-slave-45dx"
server_key: "9edc16b18d4148c2e477b412842d55a8"
server_key_iv: "b2fa75d583e6f6da80794001ce4f131a"
server_key_version: "encryptionkey@0"
I20260808 02:31:05.196791 30115 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260808 02:31:05.200138 30139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:05.201530 30115 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:31:05.201712 30115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "a3731bcdf76c4ea9b0ceaafc2e697b5e"
format_stamp: "Formatted at 2026-08-08 02:31:05 on dist-test-slave-45dx"
server_key: "9edc16b18d4148c2e477b412842d55a8"
server_key_iv: "b2fa75d583e6f6da80794001ce4f131a"
server_key_version: "encryptionkey@0"
I20260808 02:31:05.201907 30115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:05.231490 30115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:05.235466 30115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:05.235776 30115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:05.236853 30115 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:05.238229 30115 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:05.238304 30115 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:05.238492 30115 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:05.238572 30115 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:05.272907 30115 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:46839
I20260808 02:31:05.272958 30309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:46839 every 8 connection(s)
I20260808 02:31:05.274251 30115 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:31:05.277793 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 30115
I20260808 02:31:05.278013 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:31:05.278651 25043 external_mini_cluster.cc:1428] Setting key b4f63c9ba76b62e8ce5d9e38ae077f82
Aug 08 02:31:05 dist-test-slave-45dx krb5kdc[29740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156265, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:31:05.295455 30314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:05.277063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:46783 (local address 127.24.116.254:36639)
0808 02:31:05.277574 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:05.277578 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:05.278576 (+ 998us) server_negotiation.cc:407] Connection header received
0808 02:31:05.280964 (+ 2388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:05.280969 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:05.281053 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:05.281167 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:05.282661 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:05.283408 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:05.285478 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:05.285927 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:05.286064 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:05.289614 (+ 3550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:05.289620 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:05.289623 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:05.289655 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:05.292422 (+ 2767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:05.293141 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:05.293147 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:05.293152 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:05.293287 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:05.293748 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:05.293752 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:05.293754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:05.294012 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:05.294169 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:05.294835 (+ 666us) server_negotiation.cc:299] Negotiation successful
0808 02:31:05.295069 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":310,"threads_started":1}
I20260808 02:31:05.296492 30315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:05.277591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:36639 (local address 127.24.116.194:46783)
0808 02:31:05.278411 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:05.278449 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:05.280656 (+ 2207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:05.281413 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:05.281421 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:05.281942 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:05.282494 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:05.282510 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:05.283559 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:05.283565 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:05.285327 (+ 1762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:05.285339 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:05.286154 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:05.286163 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:05.286412 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:05.287115 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:05.287138 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:05.289372 (+ 2234us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:05.292579 (+ 3207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:05.292588 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:05.292604 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:05.293014 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:05.293418 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:05.293423 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:05.293426 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:05.293618 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:05.294147 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:05.294154 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:05.294484 (+ 330us) client_negotiation.cc:769] Sending connection context
0808 02:31:05.294738 (+ 254us) client_negotiation.cc:240] Negotiation successful
0808 02:31:05.295255 (+ 517us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":364,"threads_started":1}
I20260808 02:31:05.298010 30311 heartbeater.cc:347] Connected to a master server at 127.24.116.254:36639
I20260808 02:31:05.298329 30311 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:05.299044 30311 heartbeater.cc:511] Master 127.24.116.254:36639 requested a full tablet report, sending...
I20260808 02:31:05.300578 29819 ts_manager.cc:194] Registered new tserver with Master: a3731bcdf76c4ea9b0ceaafc2e697b5e (127.24.116.194:46839)
I20260808 02:31:05.301863 29819 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.194@KRBTEST.COM'} at 127.24.116.194:46783
WARNING: no policy specified for kudu/127.24.116.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
I20260808 02:31:05.332418 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:36639
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:43399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:05.674551 30322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:05.674875 30322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:05.675066 30322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:05.682211 30322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:05.682318 30322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:05.682427 30322 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:31:05.691818 30322 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:43399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:36639
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:05.693248 30322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:05.694505 30322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:05.707986 30328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:05.708073 30327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:05.708096 30330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:05.709219 30322 server_base.cc:1034] running on GCE node
I20260808 02:31:05.709874 30322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:05.710808 30322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:05.712055 30322 hybrid_clock.cc:648] HybridClock initialized: now 1786156265712010 us; error 56 us; skew 500 ppm
I20260808 02:31:05.712445 30322 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:05 dist-test-slave-45dx krb5kdc[29740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156265, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:05.715627 30322 init.cc:377] Logged in from keytab as kudu/127.24.116.195@KRBTEST.COM (short username kudu)
I20260808 02:31:05.717197 30322 webserver.cc:460] Webserver started at http://127.24.116.195:36891/ using document root <none> and password file <none>
I20260808 02:31:05.717903 30322 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:05.718060 30322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:05.718384 30322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:05.721423 30322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "178838d15c0f4cc49cd73b4d0d916fce"
format_stamp: "Formatted at 2026-08-08 02:31:05 on dist-test-slave-45dx"
server_key: "9722b517a9613c4aa2b8714d8bc5771c"
server_key_iv: "1a6e63195abc9cfb849432134daa42d5"
server_key_version: "encryptionkey@0"
I20260808 02:31:05.722251 30322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "178838d15c0f4cc49cd73b4d0d916fce"
format_stamp: "Formatted at 2026-08-08 02:31:05 on dist-test-slave-45dx"
server_key: "9722b517a9613c4aa2b8714d8bc5771c"
server_key_iv: "1a6e63195abc9cfb849432134daa42d5"
server_key_version: "encryptionkey@0"
I20260808 02:31:05.727599 30322 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 02:31:05.731199 30343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:05.732555 30322 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:31:05.732736 30322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "178838d15c0f4cc49cd73b4d0d916fce"
format_stamp: "Formatted at 2026-08-08 02:31:05 on dist-test-slave-45dx"
server_key: "9722b517a9613c4aa2b8714d8bc5771c"
server_key_iv: "1a6e63195abc9cfb849432134daa42d5"
server_key_version: "encryptionkey@0"
I20260808 02:31:05.732969 30322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:05.753065 30322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:05.757251 30322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:05.757602 30322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:05.758910 30322 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:05.760218 30322 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:05.760345 30322 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:05.760463 30322 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:05.760510 30322 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:05.770226 30108 heartbeater.cc:503] Master 127.24.116.254:36639 was elected leader, sending a full tablet report...
I20260808 02:31:05.797916 30322 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:41193
I20260808 02:31:05.798007 30528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:41193 every 8 connection(s)
I20260808 02:31:05.799270 30322 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:31:05.805675 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 30322
I20260808 02:31:05.805856 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:31:05.806391 25043 external_mini_cluster.cc:1428] Setting key bd089f3d834b166088925b67a1ef5d36
Aug 08 02:31:05 dist-test-slave-45dx krb5kdc[29740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156265, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:31:05.819859 30534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:05.801980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:59931 (local address 127.24.116.254:36639)
0808 02:31:05.802461 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:05.802465 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:05.803233 (+ 768us) server_negotiation.cc:407] Connection header received
0808 02:31:05.805115 (+ 1882us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:05.805121 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:05.805271 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:05.805394 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:05.807466 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:05.808584 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:05.810341 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:05.810748 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:05.810846 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:05.814450 (+ 3604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:05.814454 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:05.814457 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:05.814496 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:05.817156 (+ 2660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:05.817800 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:05.817804 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:05.817806 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:05.817919 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:05.818255 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:05.818258 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:05.818260 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:05.818589 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:05.818709 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:05.819340 (+ 631us) server_negotiation.cc:299] Negotiation successful
0808 02:31:05.819518 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":261,"threads_started":1}
I20260808 02:31:05.821030 30536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:05.802371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:36639 (local address 127.24.116.195:59931)
0808 02:31:05.803069 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:05.803114 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:05.804851 (+ 1737us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:05.805691 (+ 840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:05.805699 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:05.806560 (+ 861us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:05.807261 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:05.807287 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:05.808764 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:05.808768 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:05.810206 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:05.810219 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:05.810961 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:05.810966 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:05.811172 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:05.811880 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:05.811911 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:05.814245 (+ 2334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:05.817273 (+ 3028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:05.817279 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:05.817289 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:05.817703 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:05.818009 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:05.818012 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:05.818014 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:05.818180 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:05.818693 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:05.818698 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:05.818974 (+ 276us) client_negotiation.cc:769] Sending connection context
0808 02:31:05.819192 (+ 218us) client_negotiation.cc:240] Negotiation successful
0808 02:31:05.819669 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":272,"threads_started":1}
I20260808 02:31:05.822409 30529 heartbeater.cc:347] Connected to a master server at 127.24.116.254:36639
I20260808 02:31:05.822672 30529 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:05.823391 30529 heartbeater.cc:511] Master 127.24.116.254:36639 requested a full tablet report, sending...
I20260808 02:31:05.824870 29819 ts_manager.cc:194] Registered new tserver with Master: 178838d15c0f4cc49cd73b4d0d916fce (127.24.116.195:41193)
I20260808 02:31:05.825663 29819 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.195@KRBTEST.COM'} at 127.24.116.195:59931
I20260808 02:31:05.834163 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 02:31:05 dist-test-slave-45dx krb5kdc[29740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156265, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 02:31:05 dist-test-slave-45dx krb5kdc[29740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156265, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:31:05.890643 30534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:05.876076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45974 (local address 127.24.116.254:36639)
0808 02:31:05.876294 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:05.876303 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:05.876811 (+ 508us) server_negotiation.cc:407] Connection header received
0808 02:31:05.877058 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:05.877062 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:05.877128 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:05.877239 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:05.878653 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:05.879398 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:05.880735 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:05.881160 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:05.881300 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:05.885166 (+ 3866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:05.885170 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:05.885174 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:05.885207 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:05.887879 (+ 2672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:05.888608 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:05.888620 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:05.888623 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:05.888749 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:05.889158 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:05.889161 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:05.889163 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:05.889513 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:05.889785 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:05.890082 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 02:31:05.890319 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260808 02:31:05.891204 29819 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:45974
I20260808 02:31:05.893314 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 29911
Aug 08 02:31:05 dist-test-slave-45dx krb5kdc[29740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156265, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.24.116.193@KRBTEST.COM
I20260808 02:31:05.909456 30550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:05.894364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37952 (local address 127.24.116.193:41911)
0808 02:31:05.895038 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:05.895045 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:05.895069 (+ 24us) server_negotiation.cc:407] Connection header received
0808 02:31:05.895138 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:05.895144 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:05.895333 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:05.895471 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:05.896621 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:05.897614 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:05.898753 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:05.899311 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:05.899414 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:05.903753 (+ 4339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:05.903765 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:05.903813 (+ 48us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:05.903853 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:05.906879 (+ 3026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:05.907485 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:05.907492 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:05.907495 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:05.907626 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:05.907979 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:05.907983 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:05.907985 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:05.908398 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:05.908641 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:05.908853 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 02:31:05.909093 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":520,"thread_start_us":342,"threads_started":1}
W20260808 02:31:05.910681 30100 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:37952
W20260808 02:31:05.911789 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 29911: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:31:05.912009 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 29911
I20260808 02:31:05.936131 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 30115
Aug 08 02:31:05 dist-test-slave-45dx krb5kdc[29740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156265, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.24.116.194@KRBTEST.COM
I20260808 02:31:05.951844 30552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:05.937150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59206 (local address 127.24.116.194:46839)
0808 02:31:05.937757 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:05.937764 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:05.937792 (+ 28us) server_negotiation.cc:407] Connection header received
0808 02:31:05.937856 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:05.937862 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:05.938087 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:05.938220 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:05.939457 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:05.940567 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:05.941783 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:05.942315 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:05.942409 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:05.946458 (+ 4049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:05.946470 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:05.946484 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:05.946517 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:05.949459 (+ 2942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:05.950052 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:05.950059 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:05.950061 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:05.950176 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:05.950470 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:05.950473 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:05.950475 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:05.950789 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:05.951020 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:05.951226 (+ 206us) server_negotiation.cc:299] Negotiation successful
0808 02:31:05.951413 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":298,"threads_started":1}
W20260808 02:31:05.953212 30300 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:59206
W20260808 02:31:05.954282 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 30115: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:31:05.954411 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 30115
I20260808 02:31:05.979696 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 30322
Aug 08 02:31:05 dist-test-slave-45dx krb5kdc[29740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156265, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.24.116.195@KRBTEST.COM
I20260808 02:31:05.996017 30553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:05.980793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41828 (local address 127.24.116.195:41193)
0808 02:31:05.981501 (+ 708us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:05.981508 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:05.981536 (+ 28us) server_negotiation.cc:407] Connection header received
0808 02:31:05.981598 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:05.981604 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:05.981822 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:05.981973 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:05.983233 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:05.984286 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:05.985558 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:05.986102 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:05.986196 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:05.990435 (+ 4239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:05.990446 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:05.990461 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:05.990499 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:05.993457 (+ 2958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:05.994034 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:05.994041 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:05.994043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:05.994164 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:05.994481 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:05.994484 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:05.994486 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:05.994932 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:05.995207 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:05.995384 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 02:31:05.995581 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":384,"threads_started":1}
W20260808 02:31:05.997359 30519 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:41828
W20260808 02:31:05.998450 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 30322: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:31:05.998643 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 30322
I20260808 02:31:06.023924 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 29760
I20260808 02:31:06.025418 29867 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:06.131191 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 29760
2026-08-08T02:31:06Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (4052 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:31:06 dist-test-slave-45dx krb5kdc[30558](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:31:06 dist-test-slave-45dx krb5kdc[30558](info): set up 2 sockets
Aug 08 02:31:06 dist-test-slave-45dx krb5kdc[30558](info): commencing operation
krb5kdc: starting...
W20260808 02:31:07.483771 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.301s user 0.001s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:31:07 dist-test-slave-45dx krb5kdc[30558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:31:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:31:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:31:07.750159 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:46361
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:41871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:46361
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:08.092710 30578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:08.092998 30578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:08.093088 30578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:08.100072 30578 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:31:08.100175 30578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:08.100220 30578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:08.100281 30578 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:31:08.100345 30578 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:31:08.110005 30578 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:41871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:46361
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:46361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:08.111250 30578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:08.112545 30578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:08.125051 30585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:08.125128 30588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:08.125161 30586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:08.125725 30578 server_base.cc:1034] running on GCE node
I20260808 02:31:08.126600 30578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:08.127919 30578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:08.129124 30578 hybrid_clock.cc:648] HybridClock initialized: now 1786156268129069 us; error 41 us; skew 500 ppm
I20260808 02:31:08.129504 30578 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:08 dist-test-slave-45dx krb5kdc[30558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156268, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:08.138651 30578 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:31:08.140486 30578 webserver.cc:460] Webserver started at http://127.24.116.254:38493/ using document root <none> and password file <none>
I20260808 02:31:08.141325 30578 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:08.141484 30578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:08.141908 30578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:08.145287 30578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "41477d2463b44e5a87986e97eda982a1"
format_stamp: "Formatted at 2026-08-08 02:31:08 on dist-test-slave-45dx"
server_key: "5d86e4b6ff2bfaed51c588292442df65"
server_key_iv: "3e061a57611d361140a460c7c7bfeeb1"
server_key_version: "encryptionkey@0"
I20260808 02:31:08.146181 30578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "41477d2463b44e5a87986e97eda982a1"
format_stamp: "Formatted at 2026-08-08 02:31:08 on dist-test-slave-45dx"
server_key: "5d86e4b6ff2bfaed51c588292442df65"
server_key_iv: "3e061a57611d361140a460c7c7bfeeb1"
server_key_version: "encryptionkey@0"
I20260808 02:31:08.151693 30578 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 02:31:08.155283 30599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:08.156837 30578 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:31:08.157050 30578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "41477d2463b44e5a87986e97eda982a1"
format_stamp: "Formatted at 2026-08-08 02:31:08 on dist-test-slave-45dx"
server_key: "5d86e4b6ff2bfaed51c588292442df65"
server_key_iv: "3e061a57611d361140a460c7c7bfeeb1"
server_key_version: "encryptionkey@0"
I20260808 02:31:08.157287 30578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:08.172021 30578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:08.176551 30578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:08.176980 30578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:08.196969 30578 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:46361
I20260808 02:31:08.196975 30681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:46361 every 8 connection(s)
I20260808 02:31:08.198498 30578 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:31:08.202356 30685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:08.204711 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 30578
I20260808 02:31:08.204953 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:31:08.205751 25043 external_mini_cluster.cc:1428] Setting key 77acce9cd501d0c77befa2030e68f54f
I20260808 02:31:08.215144 30685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41477d2463b44e5a87986e97eda982a1: Bootstrap starting.
I20260808 02:31:08.219082 30685 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 41477d2463b44e5a87986e97eda982a1: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:08.220539 30685 log.cc:824] T 00000000000000000000000000000000 P 41477d2463b44e5a87986e97eda982a1: Log is configured to *not* fsync() on all Append() calls
Aug 08 02:31:08 dist-test-slave-45dx krb5kdc[30558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:31:08.224123 30685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41477d2463b44e5a87986e97eda982a1: No bootstrap required, opened a new log
I20260808 02:31:08.232051 30688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:08.208035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33624 (local address 127.24.116.254:46361)
0808 02:31:08.209007 (+ 972us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:08.209023 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:08.209065 (+ 42us) server_negotiation.cc:407] Connection header received
0808 02:31:08.210887 (+ 1822us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:08.210911 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:08.211327 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:08.211663 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:08.213567 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:08.214996 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:08.216869 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:08.217600 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:08.217743 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:08.222967 (+ 5224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:08.222979 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:08.222999 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:08.223042 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:08.227254 (+ 4212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:08.228021 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:08.228031 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:08.228040 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:08.228271 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:08.228673 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:08.228678 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:08.228681 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:08.229430 (+ 749us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:08.229737 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:08.230101 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 02:31:08.230589 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":748,"thread_start_us":500,"threads_started":1}
I20260808 02:31:08.235131 30685 raft_consensus.cc:348] T 00000000000000000000000000000000 P 41477d2463b44e5a87986e97eda982a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41477d2463b44e5a87986e97eda982a1" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 46361 } }
I20260808 02:31:08.235515 30685 raft_consensus.cc:374] T 00000000000000000000000000000000 P 41477d2463b44e5a87986e97eda982a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:08.235597 30685 raft_consensus.cc:729] T 00000000000000000000000000000000 P 41477d2463b44e5a87986e97eda982a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41477d2463b44e5a87986e97eda982a1, State: Initialized, Role: FOLLOWER
I20260808 02:31:08.236068 30685 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41477d2463b44e5a87986e97eda982a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41477d2463b44e5a87986e97eda982a1" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 46361 } }
I20260808 02:31:08.236281 30685 raft_consensus.cc:388] T 00000000000000000000000000000000 P 41477d2463b44e5a87986e97eda982a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:31:08.236451 30685 raft_consensus.cc:482] T 00000000000000000000000000000000 P 41477d2463b44e5a87986e97eda982a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:31:08.236577 30685 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 41477d2463b44e5a87986e97eda982a1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:08.238772 30685 raft_consensus.cc:504] T 00000000000000000000000000000000 P 41477d2463b44e5a87986e97eda982a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41477d2463b44e5a87986e97eda982a1" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 46361 } }
I20260808 02:31:08.239198 30685 leader_election.cc:302] T 00000000000000000000000000000000 P 41477d2463b44e5a87986e97eda982a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 41477d2463b44e5a87986e97eda982a1; no voters:
I20260808 02:31:08.239815 30685 leader_election.cc:288] T 00000000000000000000000000000000 P 41477d2463b44e5a87986e97eda982a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:31:08.239964 30692 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 41477d2463b44e5a87986e97eda982a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:31:08.241436 30692 raft_consensus.cc:686] T 00000000000000000000000000000000 P 41477d2463b44e5a87986e97eda982a1 [term 1 LEADER]: Becoming Leader. State: Replica: 41477d2463b44e5a87986e97eda982a1, State: Running, Role: LEADER
I20260808 02:31:08.242039 30685 sys_catalog.cc:564] T 00000000000000000000000000000000 P 41477d2463b44e5a87986e97eda982a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:31:08.241974 30692 consensus_queue.cc:237] T 00000000000000000000000000000000 P 41477d2463b44e5a87986e97eda982a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41477d2463b44e5a87986e97eda982a1" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 46361 } }
I20260808 02:31:08.245020 30694 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41477d2463b44e5a87986e97eda982a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41477d2463b44e5a87986e97eda982a1. Latest consensus state: current_term: 1 leader_uuid: "41477d2463b44e5a87986e97eda982a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41477d2463b44e5a87986e97eda982a1" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 46361 } } }
I20260808 02:31:08.245009 30693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41477d2463b44e5a87986e97eda982a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "41477d2463b44e5a87986e97eda982a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41477d2463b44e5a87986e97eda982a1" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 46361 } } }
I20260808 02:31:08.245647 30693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41477d2463b44e5a87986e97eda982a1 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:08.245647 30694 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41477d2463b44e5a87986e97eda982a1 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:08.247704 30701 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:31:08.254593 30701 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:31:08.270589 30701 catalog_manager.cc:1347] Generated new cluster ID: d67edf513b6346b48161da3edac114bd
I20260808 02:31:08.270717 30701 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:31:08.310974 30701 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:31:08.312500 30701 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:31:08.326256 30701 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 41477d2463b44e5a87986e97eda982a1: Generated new TSK 0
I20260808 02:31:08.327108 30701 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.116.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
I20260808 02:31:08.396153 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:46361
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:41871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:08.745810 30728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:08.746094 30728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:08.746260 30728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:08.754402 30728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:08.754523 30728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:08.754729 30728 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:31:08.765722 30728 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:41871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:46361
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:08.767114 30728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:08.768641 30728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:08.781970 30742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:08.782044 30738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:08.782070 30737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:08.783079 30728 server_base.cc:1034] running on GCE node
I20260808 02:31:08.783667 30728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:08.784631 30728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:08.785836 30728 hybrid_clock.cc:648] HybridClock initialized: now 1786156268785771 us; error 56 us; skew 500 ppm
I20260808 02:31:08.786163 30728 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:08 dist-test-slave-45dx krb5kdc[30558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156268, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:08.789537 30728 init.cc:377] Logged in from keytab as kudu/127.24.116.193@KRBTEST.COM (short username kudu)
I20260808 02:31:08.790980 30728 webserver.cc:460] Webserver started at http://127.24.116.193:39853/ using document root <none> and password file <none>
I20260808 02:31:08.791693 30728 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:08.791826 30728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:08.792151 30728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:08.795116 30728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "85665b38ddc948a78653c76e2dfbaf99"
format_stamp: "Formatted at 2026-08-08 02:31:08 on dist-test-slave-45dx"
server_key: "c000c5d818a72f52d929b9ab95913c0c"
server_key_iv: "a2243070a68e814b69f52b184b66becb"
server_key_version: "encryptionkey@0"
I20260808 02:31:08.795972 30728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "85665b38ddc948a78653c76e2dfbaf99"
format_stamp: "Formatted at 2026-08-08 02:31:08 on dist-test-slave-45dx"
server_key: "c000c5d818a72f52d929b9ab95913c0c"
server_key_iv: "a2243070a68e814b69f52b184b66becb"
server_key_version: "encryptionkey@0"
I20260808 02:31:08.801236 30728 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260808 02:31:08.804662 30751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:08.805944 30728 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 02:31:08.806129 30728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "85665b38ddc948a78653c76e2dfbaf99"
format_stamp: "Formatted at 2026-08-08 02:31:08 on dist-test-slave-45dx"
server_key: "c000c5d818a72f52d929b9ab95913c0c"
server_key_iv: "a2243070a68e814b69f52b184b66becb"
server_key_version: "encryptionkey@0"
I20260808 02:31:08.806344 30728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:08.819253 30728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:08.823796 30728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:08.824107 30728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:08.825117 30728 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:08.826526 30728 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:08.826629 30728 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:08.826783 30728 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:08.826862 30728 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:08.861585 30728 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:39255
I20260808 02:31:08.861616 30924 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:39255 every 8 connection(s)
I20260808 02:31:08.863003 30728 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:31:08.871076 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 30728
I20260808 02:31:08.871317 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:31:08.872139 25043 external_mini_cluster.cc:1428] Setting key ea2aeff2328d0578f3039381bfbb1626
Aug 08 02:31:08 dist-test-slave-45dx krb5kdc[30558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156268, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:31:08.884569 30928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:08.865612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:35647 (local address 127.24.116.254:46361)
0808 02:31:08.866115 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:08.866123 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:08.867071 (+ 948us) server_negotiation.cc:407] Connection header received
0808 02:31:08.869016 (+ 1945us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:08.869021 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:08.869093 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:08.869195 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:08.870767 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:08.871949 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:08.873760 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:08.874373 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:08.874487 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:08.878563 (+ 4076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:08.878568 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:08.878571 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:08.878603 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:08.881229 (+ 2626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:08.882014 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:08.882018 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:08.882021 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:08.882140 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:08.882584 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:08.882589 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:08.882592 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:08.882985 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:08.883147 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:08.883860 (+ 713us) server_negotiation.cc:299] Negotiation successful
0808 02:31:08.884153 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":226,"threads_started":1}
I20260808 02:31:08.885561 30930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:08.866188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:46361 (local address 127.24.116.193:35647)
0808 02:31:08.866907 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:08.866944 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:08.868744 (+ 1800us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:08.869427 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:08.869435 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:08.869957 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:08.870547 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:08.870568 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:08.872113 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:08.872117 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:08.873612 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:08.873624 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:08.874622 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:08.874631 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:08.874929 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:08.875664 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:08.875698 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:08.878343 (+ 2645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:08.881405 (+ 3062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:08.881414 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:08.881439 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:08.881867 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:08.882254 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:08.882259 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:08.882263 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:08.882461 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:08.883127 (+ 666us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:08.883133 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:08.883461 (+ 328us) client_negotiation.cc:769] Sending connection context
0808 02:31:08.883683 (+ 222us) client_negotiation.cc:240] Negotiation successful
0808 02:31:08.884074 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":278,"threads_started":1}
I20260808 02:31:08.887203 30925 heartbeater.cc:347] Connected to a master server at 127.24.116.254:46361
I20260808 02:31:08.887548 30925 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:08.888283 30925 heartbeater.cc:511] Master 127.24.116.254:46361 requested a full tablet report, sending...
I20260808 02:31:08.890425 30625 ts_manager.cc:194] Registered new tserver with Master: 85665b38ddc948a78653c76e2dfbaf99 (127.24.116.193:39255)
I20260808 02:31:08.892002 30625 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.193@KRBTEST.COM'} at 127.24.116.193:35647
WARNING: no policy specified for kudu/127.24.116.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
I20260808 02:31:08.925511 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:46361
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:41871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:09.265305 30937 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:09.265635 30937 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:09.265815 30937 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:09.274091 30937 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:09.274246 30937 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:09.274446 30937 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:31:09.284477 30937 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:41871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:46361
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:09.285763 30937 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:09.287191 30937 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:09.300549 30954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:09.300577 30950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:09.300654 30945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:09.301378 30937 server_base.cc:1034] running on GCE node
I20260808 02:31:09.301996 30937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:09.302937 30937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:09.304169 30937 hybrid_clock.cc:648] HybridClock initialized: now 1786156269304132 us; error 70 us; skew 500 ppm
I20260808 02:31:09.304541 30937 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:09 dist-test-slave-45dx krb5kdc[30558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156269, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:09.307662 30937 init.cc:377] Logged in from keytab as kudu/127.24.116.194@KRBTEST.COM (short username kudu)
I20260808 02:31:09.309125 30937 webserver.cc:460] Webserver started at http://127.24.116.194:32913/ using document root <none> and password file <none>
I20260808 02:31:09.309886 30937 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:09.310025 30937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:09.310432 30937 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:09.313403 30937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "a3a2f1bbc6c445bc97c59a9eed23c16d"
format_stamp: "Formatted at 2026-08-08 02:31:09 on dist-test-slave-45dx"
server_key: "8f6f8bedfb02b9161c3a5a1a2e829070"
server_key_iv: "2d9570a8cfada0f51763072ee5ab7336"
server_key_version: "encryptionkey@0"
I20260808 02:31:09.314203 30937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "a3a2f1bbc6c445bc97c59a9eed23c16d"
format_stamp: "Formatted at 2026-08-08 02:31:09 on dist-test-slave-45dx"
server_key: "8f6f8bedfb02b9161c3a5a1a2e829070"
server_key_iv: "2d9570a8cfada0f51763072ee5ab7336"
server_key_version: "encryptionkey@0"
I20260808 02:31:09.319384 30937 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 02:31:09.322803 30964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:09.324093 30937 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 02:31:09.324266 30937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "a3a2f1bbc6c445bc97c59a9eed23c16d"
format_stamp: "Formatted at 2026-08-08 02:31:09 on dist-test-slave-45dx"
server_key: "8f6f8bedfb02b9161c3a5a1a2e829070"
server_key_iv: "2d9570a8cfada0f51763072ee5ab7336"
server_key_version: "encryptionkey@0"
I20260808 02:31:09.324544 30937 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:09.345119 30937 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:09.349459 30937 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:09.349757 30937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:09.350781 30937 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:09.352135 30937 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:09.352267 30937 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:09.352460 30937 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:09.352536 30937 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:09.387820 30937 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:39645
I20260808 02:31:09.387929 31147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:39645 every 8 connection(s)
I20260808 02:31:09.389300 30937 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:31:09.398782 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 30937
I20260808 02:31:09.399091 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:31:09.399549 25043 external_mini_cluster.cc:1428] Setting key a545a1c7d128933c3610703004a8ba5a
Aug 08 02:31:09 dist-test-slave-45dx krb5kdc[30558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156269, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:31:09.410868 31154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:09.391906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:58843 (local address 127.24.116.254:46361)
0808 02:31:09.392373 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:09.392378 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:09.393546 (+ 1168us) server_negotiation.cc:407] Connection header received
0808 02:31:09.395520 (+ 1974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:09.395526 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:09.395624 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:09.395753 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:09.397438 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:09.398162 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:09.399926 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:09.400569 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:09.400716 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:09.404372 (+ 3656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:09.404377 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:09.404380 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:09.404414 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:09.407106 (+ 2692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:09.407878 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:09.407885 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:09.407889 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:09.408026 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:09.408529 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:09.408534 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:09.408539 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:09.408815 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:09.408974 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:09.410113 (+ 1139us) server_negotiation.cc:299] Negotiation successful
0808 02:31:09.410375 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":208,"threads_started":1}
I20260808 02:31:09.411351 31155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:09.392578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:46361 (local address 127.24.116.194:58843)
0808 02:31:09.393347 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:09.393407 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:09.395217 (+ 1810us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:09.396016 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:09.396024 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:09.396633 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:09.397239 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:09.397260 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:09.398370 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:09.398374 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:09.399770 (+ 1396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:09.399784 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:09.400830 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:09.400839 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:09.401079 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:09.401841 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:09.401872 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:09.404103 (+ 2231us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:09.407275 (+ 3172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:09.407285 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:09.407303 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:09.407746 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:09.408143 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:09.408148 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:09.408152 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:09.408414 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:09.408953 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:09.408961 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:09.409324 (+ 363us) client_negotiation.cc:769] Sending connection context
0808 02:31:09.409602 (+ 278us) client_negotiation.cc:240] Negotiation successful
0808 02:31:09.410033 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":314,"threads_started":1}
I20260808 02:31:09.412899 31148 heartbeater.cc:347] Connected to a master server at 127.24.116.254:46361
I20260808 02:31:09.413233 31148 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:09.413985 31148 heartbeater.cc:511] Master 127.24.116.254:46361 requested a full tablet report, sending...
I20260808 02:31:09.415462 30625 ts_manager.cc:194] Registered new tserver with Master: a3a2f1bbc6c445bc97c59a9eed23c16d (127.24.116.194:39645)
I20260808 02:31:09.416287 30625 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.194@KRBTEST.COM'} at 127.24.116.194:58843
WARNING: no policy specified for kudu/127.24.116.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
I20260808 02:31:09.452732 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:46361
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:41871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:09.797789 31158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:09.798143 31158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:09.798319 31158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:09.805770 31158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:09.805958 31158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:09.806151 31158 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:31:09.816370 31158 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:41871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:46361
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:09.817772 31158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:09.819139 31158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:09.833132 31166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:09.833310 31164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:09.833310 31168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:09.834261 31158 server_base.cc:1034] running on GCE node
I20260808 02:31:09.834954 31158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:09.835997 31158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:09.837196 31158 hybrid_clock.cc:648] HybridClock initialized: now 1786156269837145 us; error 38 us; skew 500 ppm
I20260808 02:31:09.837528 31158 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:09 dist-test-slave-45dx krb5kdc[30558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156269, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:09.840826 31158 init.cc:377] Logged in from keytab as kudu/127.24.116.195@KRBTEST.COM (short username kudu)
I20260808 02:31:09.842710 31158 webserver.cc:460] Webserver started at http://127.24.116.195:44149/ using document root <none> and password file <none>
I20260808 02:31:09.843466 31158 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:09.843570 31158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:09.843832 31158 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:09.846804 31158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "4b43a6bf5f764aaf9a9f5ed55487236c"
format_stamp: "Formatted at 2026-08-08 02:31:09 on dist-test-slave-45dx"
server_key: "1d4d3164de891ec0375fbc081a44df36"
server_key_iv: "390382596aa57699c5d8e81c9f0764f8"
server_key_version: "encryptionkey@0"
I20260808 02:31:09.847543 31158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "4b43a6bf5f764aaf9a9f5ed55487236c"
format_stamp: "Formatted at 2026-08-08 02:31:09 on dist-test-slave-45dx"
server_key: "1d4d3164de891ec0375fbc081a44df36"
server_key_iv: "390382596aa57699c5d8e81c9f0764f8"
server_key_version: "encryptionkey@0"
I20260808 02:31:09.852785 31158 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 02:31:09.856114 31177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:09.857514 31158 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:31:09.857653 31158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "4b43a6bf5f764aaf9a9f5ed55487236c"
format_stamp: "Formatted at 2026-08-08 02:31:09 on dist-test-slave-45dx"
server_key: "1d4d3164de891ec0375fbc081a44df36"
server_key_iv: "390382596aa57699c5d8e81c9f0764f8"
server_key_version: "encryptionkey@0"
I20260808 02:31:09.857841 31158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:09.890358 31158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:09.894539 31158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:09.894870 31158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:09.894925 30925 heartbeater.cc:503] Master 127.24.116.254:46361 was elected leader, sending a full tablet report...
I20260808 02:31:09.896099 31158 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:09.897650 31158 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:09.897723 31158 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:09.897807 31158 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:09.897851 31158 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:09.932367 31158 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:43673
I20260808 02:31:09.932425 31365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:43673 every 8 connection(s)
I20260808 02:31:09.933719 31158 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:31:09.937325 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 31158
I20260808 02:31:09.937553 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:31:09.938122 25043 external_mini_cluster.cc:1428] Setting key 37671b4ef4a334ea1d759622306ef51c
Aug 08 02:31:09 dist-test-slave-45dx krb5kdc[30558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156269, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:31:09.955564 31368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:09.936382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:38507 (local address 127.24.116.254:46361)
0808 02:31:09.936836 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:09.936842 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:09.937851 (+ 1009us) server_negotiation.cc:407] Connection header received
0808 02:31:09.940412 (+ 2561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:09.940418 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:09.940513 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:09.940626 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:09.942301 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:09.943085 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:09.944742 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:09.945131 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:09.945225 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:09.948817 (+ 3592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:09.948823 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:09.948827 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:09.948867 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:09.951964 (+ 3097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:09.952954 (+ 990us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:09.952958 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:09.952961 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:09.953110 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:09.953635 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:09.953639 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:09.953641 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:09.953933 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:09.954107 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:09.954872 (+ 765us) server_negotiation.cc:299] Negotiation successful
0808 02:31:09.955142 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":242,"threads_started":1}
I20260808 02:31:09.956660 31369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:09.936813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:46361 (local address 127.24.116.195:38507)
0808 02:31:09.937657 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:09.937720 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:09.940094 (+ 2374us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:09.940813 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:09.940821 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:09.941556 (+ 735us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:09.942119 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:09.942136 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:09.943231 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:09.943235 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:09.944621 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:09.944633 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:09.945317 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:09.945322 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:09.945515 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:09.946240 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:09.946263 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:09.948577 (+ 2314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:09.952173 (+ 3596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:09.952182 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:09.952196 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:09.952811 (+ 615us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:09.953243 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:09.953248 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:09.953252 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:09.953494 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:09.954088 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:09.954096 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:09.954471 (+ 375us) client_negotiation.cc:769] Sending connection context
0808 02:31:09.954750 (+ 279us) client_negotiation.cc:240] Negotiation successful
0808 02:31:09.955378 (+ 628us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":306,"threads_started":1}
I20260808 02:31:09.958160 31366 heartbeater.cc:347] Connected to a master server at 127.24.116.254:46361
I20260808 02:31:09.958458 31366 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:09.959157 31366 heartbeater.cc:511] Master 127.24.116.254:46361 requested a full tablet report, sending...
I20260808 02:31:09.960650 30625 ts_manager.cc:194] Registered new tserver with Master: 4b43a6bf5f764aaf9a9f5ed55487236c (127.24.116.195:43673)
I20260808 02:31:09.961565 30625 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.195@KRBTEST.COM'} at 127.24.116.195:38507
I20260808 02:31:09.966166 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 02:31:10 dist-test-slave-45dx krb5kdc[30558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156270, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 02:31:10 dist-test-slave-45dx krb5kdc[30558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156270, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.193@KRBTEST.COM
I20260808 02:31:10.023624 31381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:10.007983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33098 (local address 127.24.116.193:39255)
0808 02:31:10.008737 (+ 754us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:10.008745 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:10.008783 (+ 38us) server_negotiation.cc:407] Connection header received
0808 02:31:10.008852 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:10.008859 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:10.009101 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:10.009248 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:10.010818 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:10.012079 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:10.013333 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:10.013937 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:10.014041 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:10.017921 (+ 3880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:10.017933 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:10.017948 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:10.017986 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:10.020833 (+ 2847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:10.021505 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:10.021521 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:10.021524 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:10.021670 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:10.022091 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:10.022095 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:10.022098 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:10.022462 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:10.022723 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:10.022975 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 02:31:10.023190 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":429,"threads_started":1}
Aug 08 02:31:10 dist-test-slave-45dx krb5kdc[30558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156270, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:31:10.042542 31368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:10.028963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33636 (local address 127.24.116.254:46361)
0808 02:31:10.029199 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:10.029204 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:10.029313 (+ 109us) server_negotiation.cc:407] Connection header received
0808 02:31:10.029505 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:10.029530 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:10.029612 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:10.029695 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:10.030943 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:10.031636 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:10.032914 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:10.033376 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:10.033491 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:10.037347 (+ 3856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:10.037352 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:10.037355 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:10.037390 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:10.039968 (+ 2578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:10.040646 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:10.040650 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:10.040652 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:10.040774 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:10.041104 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:10.041106 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:10.041108 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:10.041441 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:10.041637 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:10.041957 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 02:31:10.042132 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
W20260808 02:31:10.043234 30625 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33636
I20260808 02:31:10.044269 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 30728
I20260808 02:31:10.057631 31381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:10.045391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33102 (local address 127.24.116.193:39255)
0808 02:31:10.045609 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:10.045616 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:10.045769 (+ 153us) server_negotiation.cc:407] Connection header received
0808 02:31:10.045965 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:10.045970 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:10.046032 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:10.046137 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:10.047324 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:10.048036 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:10.049340 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:10.049803 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:10.049961 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:10.052219 (+ 2258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:10.052225 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:10.052228 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:10.052260 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:10.054981 (+ 2721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:10.055657 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:10.055663 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:10.055667 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:10.055821 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:10.056194 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:10.056200 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:10.056203 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:10.056507 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:10.056769 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:10.057060 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 02:31:10.057292 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 02:31:10.058331 30918 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:10.143103 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 30728
I20260808 02:31:10.174264 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 30937
Aug 08 02:31:10 dist-test-slave-45dx krb5kdc[30558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156270, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.194@KRBTEST.COM
I20260808 02:31:10.195132 31390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:10.175339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60086 (local address 127.24.116.194:39645)
0808 02:31:10.175928 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:10.175935 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:10.175959 (+ 24us) server_negotiation.cc:407] Connection header received
0808 02:31:10.176023 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:10.176029 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:10.176377 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:10.176566 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:10.177896 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:10.178970 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:10.180695 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:10.181643 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:10.181817 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:10.188506 (+ 6689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:10.188520 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:10.188566 (+ 46us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:10.188613 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:10.192116 (+ 3503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:10.192889 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:10.192899 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:10.192903 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:10.193047 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:10.193454 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:10.193459 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:10.193462 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:10.193822 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:10.194142 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:10.194472 (+ 330us) server_negotiation.cc:299] Negotiation successful
0808 02:31:10.194758 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":307,"threads_started":1}
I20260808 02:31:10.202220 31140 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:10.293331 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 30937
I20260808 02:31:10.323514 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 31158
Aug 08 02:31:10 dist-test-slave-45dx krb5kdc[30558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156270, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.195@KRBTEST.COM
I20260808 02:31:10.341022 31393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:10.324646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51918 (local address 127.24.116.195:43673)
0808 02:31:10.325331 (+ 685us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:10.325338 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:10.325368 (+ 30us) server_negotiation.cc:407] Connection header received
0808 02:31:10.325431 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:10.325438 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:10.325662 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:10.325795 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:10.327058 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:10.328114 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:10.329493 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:10.330318 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:10.330431 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:10.334836 (+ 4405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:10.334849 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:10.334864 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:10.334901 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:10.338011 (+ 3110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:10.338765 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:10.338773 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:10.338775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:10.338907 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:10.339313 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:10.339317 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:10.339319 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:10.339702 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:10.340046 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:10.340379 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 02:31:10.340671 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":515,"thread_start_us":353,"threads_started":1}
I20260808 02:31:10.342350 31356 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:10.426265 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 31158
I20260808 02:31:10.452075 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 30578
I20260808 02:31:10.453423 30673 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:10.559466 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 30578
2026-08-08T02:31:10Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4427 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:31:10 dist-test-slave-45dx krb5kdc[31400](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:31:10 dist-test-slave-45dx krb5kdc[31400](info): set up 2 sockets
Aug 08 02:31:10 dist-test-slave-45dx krb5kdc[31400](info): commencing operation
krb5kdc: starting...
W20260808 02:31:11.898190 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.289s user 0.000s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:31:12 dist-test-slave-45dx krb5kdc[31400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156272, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:31:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:31:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:31:12.143425 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:38897
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:45247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:38897
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:12.487437 31422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:12.487725 31422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:12.487915 31422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:12.495148 31422 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:31:12.495296 31422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:12.495395 31422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:12.495503 31422 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:31:12.495595 31422 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:31:12.505514 31422 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:45247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:38897
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:38897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:12.506902 31422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:12.508350 31422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:12.520828 31436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:12.520769 31432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:12.520800 31431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:12.521642 31422 server_base.cc:1034] running on GCE node
I20260808 02:31:12.522504 31422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:12.523969 31422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:12.525188 31422 hybrid_clock.cc:648] HybridClock initialized: now 1786156272525149 us; error 32 us; skew 500 ppm
I20260808 02:31:12.525604 31422 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:12 dist-test-slave-45dx krb5kdc[31400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156272, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:12.528957 31422 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:31:12.530138 31422 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:12.530229 31422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:12.530503 31422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:12.533545 31422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "fc0e8739fb2f4f0a959649e13801a8a2"
format_stamp: "Formatted at 2026-08-08 02:31:12 on dist-test-slave-45dx"
server_key: "2d36d43f9500a7649b925c065ffac679"
server_key_iv: "611e7d764b0d7c0834e64c2b93b421b7"
server_key_version: "encryptionkey@0"
I20260808 02:31:12.534312 31422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "fc0e8739fb2f4f0a959649e13801a8a2"
format_stamp: "Formatted at 2026-08-08 02:31:12 on dist-test-slave-45dx"
server_key: "2d36d43f9500a7649b925c065ffac679"
server_key_iv: "611e7d764b0d7c0834e64c2b93b421b7"
server_key_version: "encryptionkey@0"
I20260808 02:31:12.539371 31422 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260808 02:31:12.542922 31442 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:12.544395 31422 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 02:31:12.544585 31422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "fc0e8739fb2f4f0a959649e13801a8a2"
format_stamp: "Formatted at 2026-08-08 02:31:12 on dist-test-slave-45dx"
server_key: "2d36d43f9500a7649b925c065ffac679"
server_key_iv: "611e7d764b0d7c0834e64c2b93b421b7"
server_key_version: "encryptionkey@0"
I20260808 02:31:12.544838 31422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:12.560078 31422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:12.564085 31422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:12.564432 31422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:12.583385 31422 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:38897
I20260808 02:31:12.583415 31525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:38897 every 8 connection(s)
I20260808 02:31:12.584332 31422 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:31:12.587829 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 31422
I20260808 02:31:12.588080 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:31:12.588340 31526 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:12.588981 25043 external_mini_cluster.cc:1428] Setting key 071cfe15bf2a8d4eb1b8762c75d0ec53
I20260808 02:31:12.603508 31526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc0e8739fb2f4f0a959649e13801a8a2: Bootstrap starting.
Aug 08 02:31:12 dist-test-slave-45dx krb5kdc[31400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156272, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:31:12.606745 31526 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc0e8739fb2f4f0a959649e13801a8a2: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:12.607838 31526 log.cc:824] T 00000000000000000000000000000000 P fc0e8739fb2f4f0a959649e13801a8a2: Log is configured to *not* fsync() on all Append() calls
I20260808 02:31:12.610554 31526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc0e8739fb2f4f0a959649e13801a8a2: No bootstrap required, opened a new log
I20260808 02:31:12.612828 31532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:12.591183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55190 (local address 127.24.116.254:38897)
0808 02:31:12.592165 (+ 982us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:12.592179 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:12.592220 (+ 41us) server_negotiation.cc:407] Connection header received
0808 02:31:12.593802 (+ 1582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:12.593824 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:12.594193 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:12.594551 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:12.596505 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:12.597767 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:12.599531 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:12.600191 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:12.600386 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:12.605228 (+ 4842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:12.605235 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:12.605254 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:12.605290 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:12.608427 (+ 3137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:12.609160 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:12.609175 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:12.609181 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:12.609348 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:12.609730 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:12.609735 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:12.609738 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:12.610261 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:12.610589 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:12.610994 (+ 405us) server_negotiation.cc:299] Negotiation successful
0808 02:31:12.611467 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":764,"thread_start_us":526,"threads_started":1}
I20260808 02:31:12.618747 31526 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc0e8739fb2f4f0a959649e13801a8a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc0e8739fb2f4f0a959649e13801a8a2" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38897 } }
I20260808 02:31:12.619092 31526 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc0e8739fb2f4f0a959649e13801a8a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:12.619169 31526 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc0e8739fb2f4f0a959649e13801a8a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0e8739fb2f4f0a959649e13801a8a2, State: Initialized, Role: FOLLOWER
I20260808 02:31:12.619623 31526 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc0e8739fb2f4f0a959649e13801a8a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc0e8739fb2f4f0a959649e13801a8a2" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38897 } }
I20260808 02:31:12.619817 31526 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc0e8739fb2f4f0a959649e13801a8a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:31:12.619917 31526 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc0e8739fb2f4f0a959649e13801a8a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:31:12.620036 31526 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc0e8739fb2f4f0a959649e13801a8a2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:12.622181 31526 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc0e8739fb2f4f0a959649e13801a8a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc0e8739fb2f4f0a959649e13801a8a2" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38897 } }
I20260808 02:31:12.622609 31526 leader_election.cc:302] T 00000000000000000000000000000000 P fc0e8739fb2f4f0a959649e13801a8a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc0e8739fb2f4f0a959649e13801a8a2; no voters:
I20260808 02:31:12.623139 31526 leader_election.cc:288] T 00000000000000000000000000000000 P fc0e8739fb2f4f0a959649e13801a8a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:31:12.623288 31534 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc0e8739fb2f4f0a959649e13801a8a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:31:12.624398 31534 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc0e8739fb2f4f0a959649e13801a8a2 [term 1 LEADER]: Becoming Leader. State: Replica: fc0e8739fb2f4f0a959649e13801a8a2, State: Running, Role: LEADER
I20260808 02:31:12.625114 31534 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc0e8739fb2f4f0a959649e13801a8a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc0e8739fb2f4f0a959649e13801a8a2" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38897 } }
I20260808 02:31:12.625710 31526 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc0e8739fb2f4f0a959649e13801a8a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:31:12.629279 31535 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc0e8739fb2f4f0a959649e13801a8a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc0e8739fb2f4f0a959649e13801a8a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc0e8739fb2f4f0a959649e13801a8a2" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38897 } } }
I20260808 02:31:12.629667 31535 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc0e8739fb2f4f0a959649e13801a8a2 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:12.630297 31537 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc0e8739fb2f4f0a959649e13801a8a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc0e8739fb2f4f0a959649e13801a8a2. Latest consensus state: current_term: 1 leader_uuid: "fc0e8739fb2f4f0a959649e13801a8a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc0e8739fb2f4f0a959649e13801a8a2" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38897 } } }
I20260808 02:31:12.630656 31537 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc0e8739fb2f4f0a959649e13801a8a2 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:12.633503 31555 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:31:12.638708 31555 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:31:12.648125 31555 catalog_manager.cc:1347] Generated new cluster ID: 8f0de78c22bd418c8e115196b0e46457
I20260808 02:31:12.648243 31555 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:31:12.662737 31555 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:31:12.664642 31555 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:31:12.674656 31555 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc0e8739fb2f4f0a959649e13801a8a2: Generated new TSK 0
I20260808 02:31:12.675693 31555 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.116.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
I20260808 02:31:12.746411 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:38897
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:45247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:13.096163 31570 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:13.096644 31570 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:13.096789 31570 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:13.104148 31570 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:13.104264 31570 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:13.104460 31570 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:31:13.114982 31570 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:45247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:38897
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:13.116592 31570 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:13.117887 31570 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:13.131202 31583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:13.131294 31589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:13.131237 31586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:13.132129 31570 server_base.cc:1034] running on GCE node
I20260808 02:31:13.132810 31570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:13.133774 31570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:13.134980 31570 hybrid_clock.cc:648] HybridClock initialized: now 1786156273134923 us; error 55 us; skew 500 ppm
I20260808 02:31:13.135294 31570 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:13 dist-test-slave-45dx krb5kdc[31400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156273, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:13.143567 31570 init.cc:377] Logged in from keytab as kudu/127.24.116.193@KRBTEST.COM (short username kudu)
I20260808 02:31:13.144982 31570 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:13.145105 31570 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:13.145458 31570 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:13.148639 31570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "a76b63f8811646b7ba86be5b66d3c10e"
format_stamp: "Formatted at 2026-08-08 02:31:13 on dist-test-slave-45dx"
server_key: "3f7d9dfc64dba0fa23bfe0862a43648e"
server_key_iv: "a5732a46afbc51fc6f9eab427a118beb"
server_key_version: "encryptionkey@0"
I20260808 02:31:13.149617 31570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "a76b63f8811646b7ba86be5b66d3c10e"
format_stamp: "Formatted at 2026-08-08 02:31:13 on dist-test-slave-45dx"
server_key: "3f7d9dfc64dba0fa23bfe0862a43648e"
server_key_iv: "a5732a46afbc51fc6f9eab427a118beb"
server_key_version: "encryptionkey@0"
I20260808 02:31:13.154961 31570 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 02:31:13.158584 31603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:13.159878 31570 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 02:31:13.160058 31570 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "a76b63f8811646b7ba86be5b66d3c10e"
format_stamp: "Formatted at 2026-08-08 02:31:13 on dist-test-slave-45dx"
server_key: "3f7d9dfc64dba0fa23bfe0862a43648e"
server_key_iv: "a5732a46afbc51fc6f9eab427a118beb"
server_key_version: "encryptionkey@0"
I20260808 02:31:13.160310 31570 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:13.189301 31570 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:13.193576 31570 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:13.193894 31570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:13.194933 31570 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:13.196506 31570 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:13.196625 31570 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:13.196760 31570 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:13.196875 31570 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:13.231422 31570 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:37647
I20260808 02:31:13.231483 31792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:37647 every 8 connection(s)
I20260808 02:31:13.232333 31570 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:31:13.236652 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 31570
I20260808 02:31:13.236909 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:31:13.237568 25043 external_mini_cluster.cc:1428] Setting key 1557b7d64ef18ad00995caac00694ea4
Aug 08 02:31:13 dist-test-slave-45dx krb5kdc[31400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156273, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:31:13.252946 31796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:13.234784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:44377 (local address 127.24.116.254:38897)
0808 02:31:13.235277 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:13.235282 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:13.236165 (+ 883us) server_negotiation.cc:407] Connection header received
0808 02:31:13.238155 (+ 1990us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:13.238160 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:13.238264 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:13.238389 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:13.239833 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:13.240646 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:13.242209 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:13.242612 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:13.242743 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:13.246638 (+ 3895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:13.246643 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:13.246646 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:13.246680 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:13.249545 (+ 2865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:13.250515 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:13.250520 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:13.250522 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:13.250652 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:13.251146 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:13.251150 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:13.251152 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:13.251423 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:13.251553 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:13.252495 (+ 942us) server_negotiation.cc:299] Negotiation successful
0808 02:31:13.252672 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":266,"threads_started":1}
I20260808 02:31:13.254532 31797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:13.235272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:38897 (local address 127.24.116.193:44377)
0808 02:31:13.236000 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:13.236047 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:13.237880 (+ 1833us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:13.238622 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:13.238630 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:13.239128 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:13.239666 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:13.239683 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:13.240795 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:13.240800 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:13.242051 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:13.242064 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:13.242850 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:13.242857 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:13.243081 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:13.243779 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:13.243806 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:13.246402 (+ 2596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:13.249685 (+ 3283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:13.249697 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:13.249718 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:13.250372 (+ 654us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:13.250767 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:13.250775 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:13.250781 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:13.251034 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:13.251551 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:13.251562 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:13.252038 (+ 476us) client_negotiation.cc:769] Sending connection context
0808 02:31:13.252391 (+ 353us) client_negotiation.cc:240] Negotiation successful
0808 02:31:13.253030 (+ 639us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":314,"threads_started":1}
I20260808 02:31:13.256232 31793 heartbeater.cc:347] Connected to a master server at 127.24.116.254:38897
I20260808 02:31:13.256577 31793 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:13.257252 31793 heartbeater.cc:511] Master 127.24.116.254:38897 requested a full tablet report, sending...
I20260808 02:31:13.259330 31472 ts_manager.cc:194] Registered new tserver with Master: a76b63f8811646b7ba86be5b66d3c10e (127.24.116.193:37647)
I20260808 02:31:13.260849 31472 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.193@KRBTEST.COM'} at 127.24.116.193:44377
WARNING: no policy specified for kudu/127.24.116.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
I20260808 02:31:13.293905 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:38897
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:45247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:13.637331 31801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:13.637661 31801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:13.637826 31801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:13.645364 31801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:13.645524 31801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:13.645709 31801 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:31:13.656395 31801 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:45247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:38897
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:13.657727 31801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:13.659065 31801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:13.672366 31808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:13.672288 31809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:13.672338 31811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:13.673386 31801 server_base.cc:1034] running on GCE node
I20260808 02:31:13.673969 31801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:13.674959 31801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:13.676182 31801 hybrid_clock.cc:648] HybridClock initialized: now 1786156273676128 us; error 50 us; skew 500 ppm
I20260808 02:31:13.676546 31801 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:13 dist-test-slave-45dx krb5kdc[31400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156273, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:13.679826 31801 init.cc:377] Logged in from keytab as kudu/127.24.116.194@KRBTEST.COM (short username kudu)
I20260808 02:31:13.681111 31801 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:13.681249 31801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:13.681571 31801 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:13.684583 31801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "8bf97e87964c44aea344da67047a4331"
format_stamp: "Formatted at 2026-08-08 02:31:13 on dist-test-slave-45dx"
server_key: "abf8e18cb0229e266cc814a58f360807"
server_key_iv: "7f258d2e3af7a8c96964d7c4cece2ec3"
server_key_version: "encryptionkey@0"
I20260808 02:31:13.685405 31801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "8bf97e87964c44aea344da67047a4331"
format_stamp: "Formatted at 2026-08-08 02:31:13 on dist-test-slave-45dx"
server_key: "abf8e18cb0229e266cc814a58f360807"
server_key_iv: "7f258d2e3af7a8c96964d7c4cece2ec3"
server_key_version: "encryptionkey@0"
I20260808 02:31:13.690414 31801 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 02:31:13.693771 31817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:13.695011 31801 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 02:31:13.695188 31801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "8bf97e87964c44aea344da67047a4331"
format_stamp: "Formatted at 2026-08-08 02:31:13 on dist-test-slave-45dx"
server_key: "abf8e18cb0229e266cc814a58f360807"
server_key_iv: "7f258d2e3af7a8c96964d7c4cece2ec3"
server_key_version: "encryptionkey@0"
I20260808 02:31:13.695405 31801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:13.726332 31801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:13.730618 31801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:13.730916 31801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:13.731909 31801 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:13.733340 31801 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:13.733479 31801 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:13.733606 31801 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:13.733701 31801 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:13.767979 31801 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:35107
I20260808 02:31:13.768035 31993 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:35107 every 8 connection(s)
I20260808 02:31:13.768929 31801 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:31:13.778972 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 31801
I20260808 02:31:13.779191 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:31:13.779672 25043 external_mini_cluster.cc:1428] Setting key 81d2cba69a08b40c46e23e8fa51c222d
Aug 08 02:31:13 dist-test-slave-45dx krb5kdc[31400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156273, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:31:13.789623 31996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:13.771358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:41595 (local address 127.24.116.254:38897)
0808 02:31:13.771822 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:13.771827 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:13.772702 (+ 875us) server_negotiation.cc:407] Connection header received
0808 02:31:13.774521 (+ 1819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:13.774529 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:13.774629 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:13.774750 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:13.776242 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:13.777013 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:13.778675 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:13.779174 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:13.779316 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:13.783654 (+ 4338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:13.783660 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:13.783663 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:13.783696 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:13.786284 (+ 2588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:13.787251 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:13.787255 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:13.787257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:13.787387 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:13.787875 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:13.787878 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:13.787880 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:13.788125 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:13.788233 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:13.789197 (+ 964us) server_negotiation.cc:299] Negotiation successful
0808 02:31:13.789362 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":246,"threads_started":1}
I20260808 02:31:13.791134 31997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:13.771776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:38897 (local address 127.24.116.194:41595)
0808 02:31:13.772539 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:13.772578 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:13.774238 (+ 1660us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:13.774978 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:13.774986 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:13.775508 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:13.776058 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:13.776074 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:13.777187 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:13.777192 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:13.778489 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:13.778511 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:13.779450 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:13.779460 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:13.779679 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:13.780555 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:13.780590 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:13.783415 (+ 2825us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:13.786443 (+ 3028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:13.786455 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:13.786474 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:13.787139 (+ 665us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:13.787501 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:13.787508 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:13.787514 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:13.787766 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:13.788251 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:13.788262 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:13.788777 (+ 515us) client_negotiation.cc:769] Sending connection context
0808 02:31:13.789102 (+ 325us) client_negotiation.cc:240] Negotiation successful
0808 02:31:13.789687 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":287,"threads_started":1}
I20260808 02:31:13.792600 31994 heartbeater.cc:347] Connected to a master server at 127.24.116.254:38897
I20260808 02:31:13.792915 31994 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:13.793551 31994 heartbeater.cc:511] Master 127.24.116.254:38897 requested a full tablet report, sending...
I20260808 02:31:13.794983 31472 ts_manager.cc:194] Registered new tserver with Master: 8bf97e87964c44aea344da67047a4331 (127.24.116.194:35107)
I20260808 02:31:13.795780 31472 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.194@KRBTEST.COM'} at 127.24.116.194:41595
WARNING: no policy specified for kudu/127.24.116.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
I20260808 02:31:13.833513 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:38897
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:45247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:14.168630 32002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:14.168951 32002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:14.169121 32002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:14.176215 32002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:14.176393 32002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:14.176594 32002 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:31:14.186342 32002 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:45247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:38897
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:14.187731 32002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:14.189074 32002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:14.201992 32009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:14.201932 32011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:14.202016 32008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:14.202814 32002 server_base.cc:1034] running on GCE node
I20260808 02:31:14.203431 32002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:14.204411 32002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:14.205643 32002 hybrid_clock.cc:648] HybridClock initialized: now 1786156274205581 us; error 53 us; skew 500 ppm
I20260808 02:31:14.205914 32002 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:14 dist-test-slave-45dx krb5kdc[31400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156274, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:14.208967 32002 init.cc:377] Logged in from keytab as kudu/127.24.116.195@KRBTEST.COM (short username kudu)
I20260808 02:31:14.210110 32002 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:14.210227 32002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:14.210572 32002 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:14.213516 32002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "e2a3d6fea5dc4a948c3f9c5a3be01936"
format_stamp: "Formatted at 2026-08-08 02:31:14 on dist-test-slave-45dx"
server_key: "ea520c3c5a934aaf8c165935ab7c10f1"
server_key_iv: "ed0eb5dc04a9e5dcb58602363b297995"
server_key_version: "encryptionkey@0"
I20260808 02:31:14.214313 32002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "e2a3d6fea5dc4a948c3f9c5a3be01936"
format_stamp: "Formatted at 2026-08-08 02:31:14 on dist-test-slave-45dx"
server_key: "ea520c3c5a934aaf8c165935ab7c10f1"
server_key_iv: "ed0eb5dc04a9e5dcb58602363b297995"
server_key_version: "encryptionkey@0"
I20260808 02:31:14.219295 32002 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 02:31:14.222656 32019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:14.223889 32002 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 02:31:14.224069 32002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "e2a3d6fea5dc4a948c3f9c5a3be01936"
format_stamp: "Formatted at 2026-08-08 02:31:14 on dist-test-slave-45dx"
server_key: "ea520c3c5a934aaf8c165935ab7c10f1"
server_key_iv: "ed0eb5dc04a9e5dcb58602363b297995"
server_key_version: "encryptionkey@0"
I20260808 02:31:14.224292 32002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:14.246533 32002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:14.250836 32002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:14.251137 32002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:14.252106 32002 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:14.253456 32002 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:14.253564 32002 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:14.253702 32002 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:14.253793 32002 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:14.263808 31793 heartbeater.cc:503] Master 127.24.116.254:38897 was elected leader, sending a full tablet report...
I20260808 02:31:14.291280 32002 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:41881
I20260808 02:31:14.291379 32203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:41881 every 8 connection(s)
I20260808 02:31:14.292210 32002 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:31:14.295753 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 32002
I20260808 02:31:14.295980 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:31:14.296613 25043 external_mini_cluster.cc:1428] Setting key c078261670b96085a63c731f81563adb
Aug 08 02:31:14 dist-test-slave-45dx krb5kdc[31400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156274, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:31:14.313217 32207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:14.294816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:36939 (local address 127.24.116.254:38897)
0808 02:31:14.295275 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:14.295279 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:14.296367 (+ 1088us) server_negotiation.cc:407] Connection header received
0808 02:31:14.298991 (+ 2624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:14.298997 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:14.299085 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:14.299200 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:14.300983 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.301774 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.303245 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.303653 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.303776 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:14.307064 (+ 3288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:14.307069 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:14.307072 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:14.307105 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:14.309809 (+ 2704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:14.310722 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:14.310729 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:14.310736 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:14.310867 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:14.311390 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:14.311394 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:14.311396 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:14.311757 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:14.311930 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:14.312760 (+ 830us) server_negotiation.cc:299] Negotiation successful
0808 02:31:14.312945 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":217,"threads_started":1}
I20260808 02:31:14.314204 32209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:14.295347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:38897 (local address 127.24.116.195:36939)
0808 02:31:14.296175 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:14.296224 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:14.298654 (+ 2430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:14.299424 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:14.299445 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:14.300204 (+ 759us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:14.300825 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:14.300843 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.301910 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.301914 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:14.303125 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:14.303137 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.303867 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.303872 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:14.304057 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:14.304714 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:14.304736 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:14.306859 (+ 2123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:14.309948 (+ 3089us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:14.309956 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:14.309969 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:14.310590 (+ 621us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:14.311006 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:14.311009 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:14.311011 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:14.311269 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:14.311908 (+ 639us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:14.311914 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:14.312366 (+ 452us) client_negotiation.cc:769] Sending connection context
0808 02:31:14.312643 (+ 277us) client_negotiation.cc:240] Negotiation successful
0808 02:31:14.313033 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":326,"threads_started":1}
I20260808 02:31:14.315667 32204 heartbeater.cc:347] Connected to a master server at 127.24.116.254:38897
I20260808 02:31:14.315982 32204 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:14.316668 32204 heartbeater.cc:511] Master 127.24.116.254:38897 requested a full tablet report, sending...
I20260808 02:31:14.318045 31472 ts_manager.cc:194] Registered new tserver with Master: e2a3d6fea5dc4a948c3f9c5a3be01936 (127.24.116.195:41881)
I20260808 02:31:14.318878 31472 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.195@KRBTEST.COM'} at 127.24.116.195:36939
I20260808 02:31:14.324292 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:31:14.342028 32207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:14.329289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55192 (local address 127.24.116.254:38897)
0808 02:31:14.329456 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:14.329461 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:14.330062 (+ 601us) server_negotiation.cc:407] Connection header received
0808 02:31:14.330258 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:14.330263 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:14.330338 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:14.330457 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:14.331885 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.332701 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.333946 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.334383 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.334532 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:14.336895 (+ 2363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:14.336901 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:14.336913 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:14.336947 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:14.339326 (+ 2379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:14.339991 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:14.339997 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:14.340001 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:14.340135 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:14.340570 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:14.340576 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:14.340579 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:14.340889 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:14.341157 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:14.341474 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 02:31:14.341703 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 02:31:14.345950 31472 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55192:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:31:14.353000 31472 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:31:14.386777 32227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:14.366016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41818 (local address 127.24.116.195:41881)
0808 02:31:14.377638 (+ 11622us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:14.377649 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:14.378252 (+ 603us) server_negotiation.cc:407] Connection header received
0808 02:31:14.378410 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:14.378420 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:14.378634 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:14.378852 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:14.379940 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.381162 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.384556 (+ 3394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.385519 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.385738 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:14.385926 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:14.386219 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 02:31:14.386395 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11425,"thread_start_us":11248,"threads_started":1}
I20260808 02:31:14.386848 32226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:14.365837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:41881 (local address 127.0.0.1:41818)
0808 02:31:14.378107 (+ 12270us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:14.378125 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:14.378253 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:14.378847 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:14.378852 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:14.378883 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:14.379681 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:14.379694 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.381319 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.381324 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:14.384404 (+ 3080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:14.384424 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.385735 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.385742 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:14.385936 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:14.385993 (+ 57us) client_negotiation.cc:769] Sending connection context
0808 02:31:14.386173 (+ 180us) client_negotiation.cc:240] Negotiation successful
0808 02:31:14.386394 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12141,"mutex_wait_us":280,"thread_start_us":12040,"threads_started":1}
I20260808 02:31:14.387291 32224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:14.364971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52280 (local address 127.24.116.193:37647)
0808 02:31:14.377821 (+ 12850us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:14.377829 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:14.377860 (+ 31us) server_negotiation.cc:407] Connection header received
0808 02:31:14.377977 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:14.377987 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:14.378276 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:14.378494 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:14.379453 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.381252 (+ 1799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.384178 (+ 2926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.385665 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.385862 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:14.386007 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:14.386796 (+ 789us) server_negotiation.cc:299] Negotiation successful
0808 02:31:14.386950 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12647,"thread_start_us":12504,"threads_started":1}
I20260808 02:31:14.387881 32230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:14.366391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37726 (local address 127.24.116.194:35107)
0808 02:31:14.377934 (+ 11543us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:14.377942 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:14.377971 (+ 29us) server_negotiation.cc:407] Connection header received
0808 02:31:14.378081 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:14.378090 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:14.378326 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:14.378556 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:14.380223 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.381692 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.384085 (+ 2393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.385665 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.385846 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:14.386007 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:14.387365 (+ 1358us) server_negotiation.cc:299] Negotiation successful
0808 02:31:14.387535 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11353,"thread_start_us":11277,"threads_started":1}
I20260808 02:31:14.388212 32223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:14.364838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:37647 (local address 127.0.0.1:52280)
0808 02:31:14.374879 (+ 10041us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:14.374938 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:14.375130 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:14.378519 (+ 3389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:14.378528 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:14.378558 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:14.379230 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:14.379250 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.381374 (+ 2124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.381380 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:14.384030 (+ 2650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:14.384045 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.386264 (+ 2219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.386270 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:14.386518 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:14.386553 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 02:31:14.386626 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 02:31:14.387787 (+ 1161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9740,"mutex_wait_us":1158,"thread_start_us":10481,"threads_started":1}
I20260808 02:31:14.388535 32225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:14.365031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:35107 (local address 127.0.0.1:37726)
0808 02:31:14.377063 (+ 12032us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:14.377084 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:14.377208 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:14.378812 (+ 1604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:14.378819 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:14.378847 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:14.380017 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:14.380034 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.381855 (+ 1821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.381866 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:14.383927 (+ 2061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:14.383939 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.386211 (+ 2272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.386220 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:14.386431 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:14.386510 (+ 79us) client_negotiation.cc:769] Sending connection context
0808 02:31:14.386605 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 02:31:14.386767 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11880,"mutex_wait_us":235,"thread_start_us":11856,"threads_started":1}
I20260808 02:31:14.391084 32090 tablet_service.cc:1467] Processing CreateTablet for tablet a1b402c49ab04a8d8cdc5c416fff60d7 (DEFAULT_TABLE table=test-table [id=24d1b6f1acaa4a81a459687a9bced1ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:31:14.391688 31676 tablet_service.cc:1467] Processing CreateTablet for tablet a1b402c49ab04a8d8cdc5c416fff60d7 (DEFAULT_TABLE table=test-table [id=24d1b6f1acaa4a81a459687a9bced1ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:31:14.392622 32090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1b402c49ab04a8d8cdc5c416fff60d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:14.393081 31676 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1b402c49ab04a8d8cdc5c416fff60d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:14.392652 31896 tablet_service.cc:1467] Processing CreateTablet for tablet a1b402c49ab04a8d8cdc5c416fff60d7 (DEFAULT_TABLE table=test-table [id=24d1b6f1acaa4a81a459687a9bced1ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:31:14.393921 31896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1b402c49ab04a8d8cdc5c416fff60d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:14.406085 32231 tablet_bootstrap.cc:492] T a1b402c49ab04a8d8cdc5c416fff60d7 P e2a3d6fea5dc4a948c3f9c5a3be01936: Bootstrap starting.
I20260808 02:31:14.407989 32233 tablet_bootstrap.cc:492] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e: Bootstrap starting.
I20260808 02:31:14.409789 32235 tablet_bootstrap.cc:492] T a1b402c49ab04a8d8cdc5c416fff60d7 P 8bf97e87964c44aea344da67047a4331: Bootstrap starting.
I20260808 02:31:14.410043 32231 tablet_bootstrap.cc:654] T a1b402c49ab04a8d8cdc5c416fff60d7 P e2a3d6fea5dc4a948c3f9c5a3be01936: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:14.411475 32231 log.cc:824] T a1b402c49ab04a8d8cdc5c416fff60d7 P e2a3d6fea5dc4a948c3f9c5a3be01936: Log is configured to *not* fsync() on all Append() calls
I20260808 02:31:14.411679 32233 tablet_bootstrap.cc:654] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:14.412849 32233 log.cc:824] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e: Log is configured to *not* fsync() on all Append() calls
I20260808 02:31:14.413072 32235 tablet_bootstrap.cc:654] T a1b402c49ab04a8d8cdc5c416fff60d7 P 8bf97e87964c44aea344da67047a4331: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:14.414338 32235 log.cc:824] T a1b402c49ab04a8d8cdc5c416fff60d7 P 8bf97e87964c44aea344da67047a4331: Log is configured to *not* fsync() on all Append() calls
I20260808 02:31:14.414897 32231 tablet_bootstrap.cc:492] T a1b402c49ab04a8d8cdc5c416fff60d7 P e2a3d6fea5dc4a948c3f9c5a3be01936: No bootstrap required, opened a new log
I20260808 02:31:14.415261 32231 ts_tablet_manager.cc:1397] T a1b402c49ab04a8d8cdc5c416fff60d7 P e2a3d6fea5dc4a948c3f9c5a3be01936: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260808 02:31:14.416592 32233 tablet_bootstrap.cc:492] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e: No bootstrap required, opened a new log
I20260808 02:31:14.416905 32233 ts_tablet_manager.cc:1397] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.002s
I20260808 02:31:14.418306 32235 tablet_bootstrap.cc:492] T a1b402c49ab04a8d8cdc5c416fff60d7 P 8bf97e87964c44aea344da67047a4331: No bootstrap required, opened a new log
I20260808 02:31:14.418565 32235 ts_tablet_manager.cc:1397] T a1b402c49ab04a8d8cdc5c416fff60d7 P 8bf97e87964c44aea344da67047a4331: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.002s
I20260808 02:31:14.425477 32235 raft_consensus.cc:348] T a1b402c49ab04a8d8cdc5c416fff60d7 P 8bf97e87964c44aea344da67047a4331 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76b63f8811646b7ba86be5b66d3c10e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37647 } } peers { permanent_uuid: "8bf97e87964c44aea344da67047a4331" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35107 } } peers { permanent_uuid: "e2a3d6fea5dc4a948c3f9c5a3be01936" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 41881 } }
I20260808 02:31:14.426092 32235 raft_consensus.cc:374] T a1b402c49ab04a8d8cdc5c416fff60d7 P 8bf97e87964c44aea344da67047a4331 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:14.426232 32235 raft_consensus.cc:729] T a1b402c49ab04a8d8cdc5c416fff60d7 P 8bf97e87964c44aea344da67047a4331 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf97e87964c44aea344da67047a4331, State: Initialized, Role: FOLLOWER
I20260808 02:31:14.426317 32231 raft_consensus.cc:348] T a1b402c49ab04a8d8cdc5c416fff60d7 P e2a3d6fea5dc4a948c3f9c5a3be01936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76b63f8811646b7ba86be5b66d3c10e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37647 } } peers { permanent_uuid: "8bf97e87964c44aea344da67047a4331" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35107 } } peers { permanent_uuid: "e2a3d6fea5dc4a948c3f9c5a3be01936" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 41881 } }
I20260808 02:31:14.426795 32231 raft_consensus.cc:374] T a1b402c49ab04a8d8cdc5c416fff60d7 P e2a3d6fea5dc4a948c3f9c5a3be01936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:14.426970 32231 raft_consensus.cc:729] T a1b402c49ab04a8d8cdc5c416fff60d7 P e2a3d6fea5dc4a948c3f9c5a3be01936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a3d6fea5dc4a948c3f9c5a3be01936, State: Initialized, Role: FOLLOWER
I20260808 02:31:14.427050 32235 consensus_queue.cc:260] T a1b402c49ab04a8d8cdc5c416fff60d7 P 8bf97e87964c44aea344da67047a4331 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76b63f8811646b7ba86be5b66d3c10e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37647 } } peers { permanent_uuid: "8bf97e87964c44aea344da67047a4331" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35107 } } peers { permanent_uuid: "e2a3d6fea5dc4a948c3f9c5a3be01936" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 41881 } }
I20260808 02:31:14.427603 32231 consensus_queue.cc:260] T a1b402c49ab04a8d8cdc5c416fff60d7 P e2a3d6fea5dc4a948c3f9c5a3be01936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76b63f8811646b7ba86be5b66d3c10e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37647 } } peers { permanent_uuid: "8bf97e87964c44aea344da67047a4331" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35107 } } peers { permanent_uuid: "e2a3d6fea5dc4a948c3f9c5a3be01936" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 41881 } }
I20260808 02:31:14.428618 31994 heartbeater.cc:503] Master 127.24.116.254:38897 was elected leader, sending a full tablet report...
I20260808 02:31:14.429194 32235 ts_tablet_manager.cc:1428] T a1b402c49ab04a8d8cdc5c416fff60d7 P 8bf97e87964c44aea344da67047a4331: Time spent starting tablet: real 0.011s user 0.009s sys 0.002s
I20260808 02:31:14.427938 32233 raft_consensus.cc:348] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76b63f8811646b7ba86be5b66d3c10e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37647 } } peers { permanent_uuid: "8bf97e87964c44aea344da67047a4331" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35107 } } peers { permanent_uuid: "e2a3d6fea5dc4a948c3f9c5a3be01936" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 41881 } }
I20260808 02:31:14.430233 32233 raft_consensus.cc:374] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:14.430411 32233 raft_consensus.cc:729] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a76b63f8811646b7ba86be5b66d3c10e, State: Initialized, Role: FOLLOWER
I20260808 02:31:14.431118 32233 consensus_queue.cc:260] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76b63f8811646b7ba86be5b66d3c10e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37647 } } peers { permanent_uuid: "8bf97e87964c44aea344da67047a4331" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35107 } } peers { permanent_uuid: "e2a3d6fea5dc4a948c3f9c5a3be01936" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 41881 } }
I20260808 02:31:14.434178 32233 ts_tablet_manager.cc:1428] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e: Time spent starting tablet: real 0.017s user 0.003s sys 0.011s
I20260808 02:31:14.434821 32204 heartbeater.cc:503] Master 127.24.116.254:38897 was elected leader, sending a full tablet report...
I20260808 02:31:14.435794 32231 ts_tablet_manager.cc:1428] T a1b402c49ab04a8d8cdc5c416fff60d7 P e2a3d6fea5dc4a948c3f9c5a3be01936: Time spent starting tablet: real 0.020s user 0.015s sys 0.004s
W20260808 02:31:14.484670 31795 tablet.cc:2369] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:31:14.520936 31995 tablet.cc:2369] T a1b402c49ab04a8d8cdc5c416fff60d7 P 8bf97e87964c44aea344da67047a4331: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:31:14.543757 32205 tablet.cc:2369] T a1b402c49ab04a8d8cdc5c416fff60d7 P e2a3d6fea5dc4a948c3f9c5a3be01936: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:31:14.562820 32243 raft_consensus.cc:482] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:31:14.563215 32243 raft_consensus.cc:504] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76b63f8811646b7ba86be5b66d3c10e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37647 } } peers { permanent_uuid: "8bf97e87964c44aea344da67047a4331" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35107 } } peers { permanent_uuid: "e2a3d6fea5dc4a948c3f9c5a3be01936" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 41881 } }
I20260808 02:31:14.565758 32243 leader_election.cc:288] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bf97e87964c44aea344da67047a4331 (127.24.116.194:35107), e2a3d6fea5dc4a948c3f9c5a3be01936 (127.24.116.195:41881)
I20260808 02:31:14.573383 32230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:14.566421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:59451 (local address 127.24.116.194:35107)
0808 02:31:14.566655 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:14.566662 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:14.567359 (+ 697us) server_negotiation.cc:407] Connection header received
0808 02:31:14.567607 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:14.567613 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:14.567698 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:14.567806 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:14.568652 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.569534 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.571454 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.572316 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.572481 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:14.572533 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:14.572977 (+ 444us) server_negotiation.cc:299] Negotiation successful
0808 02:31:14.573123 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 02:31:14.573418 32245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:14.566204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:35107 (local address 127.24.116.193:59451)
0808 02:31:14.567183 (+ 979us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:14.567213 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:14.567411 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:14.567978 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:14.567983 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:14.568017 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:14.568470 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:14.568490 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.569668 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.569674 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:14.571286 (+ 1612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:14.571299 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.572568 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.572575 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:14.572782 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:14.572828 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 02:31:14.572906 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 02:31:14.573006 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":823,"thread_start_us":539,"threads_started":1}
I20260808 02:31:14.573527 32227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:14.566347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:47399 (local address 127.24.116.195:41881)
0808 02:31:14.566610 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:14.566617 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:14.567977 (+ 1360us) server_negotiation.cc:407] Connection header received
0808 02:31:14.568129 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:14.568137 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:14.568218 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:14.568358 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:14.569033 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.569886 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.571650 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.572549 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.572713 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:14.572785 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:14.573119 (+ 334us) server_negotiation.cc:299] Negotiation successful
0808 02:31:14.573261 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260808 02:31:14.573917 32246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:14.567016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:41881 (local address 127.24.116.193:47399)
0808 02:31:14.567835 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:14.567854 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:14.567982 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:14.568370 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:14.568375 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:14.568428 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:14.568865 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:14.568878 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.570045 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.570049 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:14.571495 (+ 1446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:14.571511 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.572770 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.572775 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:14.572935 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:14.572969 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 02:31:14.573081 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 02:31:14.573202 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":669,"mutex_wait_us":24,"thread_start_us":425,"threads_started":1}
I20260808 02:31:14.574581 31929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1b402c49ab04a8d8cdc5c416fff60d7" candidate_uuid: "a76b63f8811646b7ba86be5b66d3c10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf97e87964c44aea344da67047a4331" is_pre_election: true
I20260808 02:31:14.574978 32124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1b402c49ab04a8d8cdc5c416fff60d7" candidate_uuid: "a76b63f8811646b7ba86be5b66d3c10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a3d6fea5dc4a948c3f9c5a3be01936" is_pre_election: true
I20260808 02:31:14.575138 31929 raft_consensus.cc:2454] T a1b402c49ab04a8d8cdc5c416fff60d7 P 8bf97e87964c44aea344da67047a4331 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a76b63f8811646b7ba86be5b66d3c10e in term 0.
I20260808 02:31:14.575475 32124 raft_consensus.cc:2454] T a1b402c49ab04a8d8cdc5c416fff60d7 P e2a3d6fea5dc4a948c3f9c5a3be01936 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a76b63f8811646b7ba86be5b66d3c10e in term 0.
I20260808 02:31:14.575855 31607 leader_election.cc:302] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf97e87964c44aea344da67047a4331, a76b63f8811646b7ba86be5b66d3c10e; no voters:
I20260808 02:31:14.576263 32243 raft_consensus.cc:2781] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:31:14.576493 32243 raft_consensus.cc:482] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:31:14.576610 32243 raft_consensus.cc:3037] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:14.578823 32243 raft_consensus.cc:504] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76b63f8811646b7ba86be5b66d3c10e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37647 } } peers { permanent_uuid: "8bf97e87964c44aea344da67047a4331" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35107 } } peers { permanent_uuid: "e2a3d6fea5dc4a948c3f9c5a3be01936" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 41881 } }
I20260808 02:31:14.579442 32243 leader_election.cc:288] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e [CANDIDATE]: Term 1 election: Requested vote from peers 8bf97e87964c44aea344da67047a4331 (127.24.116.194:35107), e2a3d6fea5dc4a948c3f9c5a3be01936 (127.24.116.195:41881)
I20260808 02:31:14.579955 31929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1b402c49ab04a8d8cdc5c416fff60d7" candidate_uuid: "a76b63f8811646b7ba86be5b66d3c10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf97e87964c44aea344da67047a4331"
I20260808 02:31:14.579967 32124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1b402c49ab04a8d8cdc5c416fff60d7" candidate_uuid: "a76b63f8811646b7ba86be5b66d3c10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a3d6fea5dc4a948c3f9c5a3be01936"
I20260808 02:31:14.580168 32124 raft_consensus.cc:3037] T a1b402c49ab04a8d8cdc5c416fff60d7 P e2a3d6fea5dc4a948c3f9c5a3be01936 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:14.580161 31929 raft_consensus.cc:3037] T a1b402c49ab04a8d8cdc5c416fff60d7 P 8bf97e87964c44aea344da67047a4331 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:14.582408 32124 raft_consensus.cc:2454] T a1b402c49ab04a8d8cdc5c416fff60d7 P e2a3d6fea5dc4a948c3f9c5a3be01936 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a76b63f8811646b7ba86be5b66d3c10e in term 1.
I20260808 02:31:14.582459 31929 raft_consensus.cc:2454] T a1b402c49ab04a8d8cdc5c416fff60d7 P 8bf97e87964c44aea344da67047a4331 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a76b63f8811646b7ba86be5b66d3c10e in term 1.
I20260808 02:31:14.582861 31605 leader_election.cc:302] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a76b63f8811646b7ba86be5b66d3c10e, e2a3d6fea5dc4a948c3f9c5a3be01936; no voters:
I20260808 02:31:14.583204 32243 raft_consensus.cc:2781] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:31:14.583724 32243 raft_consensus.cc:686] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e [term 1 LEADER]: Becoming Leader. State: Replica: a76b63f8811646b7ba86be5b66d3c10e, State: Running, Role: LEADER
I20260808 02:31:14.584362 32243 consensus_queue.cc:237] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76b63f8811646b7ba86be5b66d3c10e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37647 } } peers { permanent_uuid: "8bf97e87964c44aea344da67047a4331" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35107 } } peers { permanent_uuid: "e2a3d6fea5dc4a948c3f9c5a3be01936" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 41881 } }
I20260808 02:31:14.589107 31472 catalog_manager.cc:5495] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e reported cstate change: term changed from 0 to 1, leader changed from <none> to a76b63f8811646b7ba86be5b66d3c10e (127.24.116.193). New cstate: current_term: 1 leader_uuid: "a76b63f8811646b7ba86be5b66d3c10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76b63f8811646b7ba86be5b66d3c10e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bf97e87964c44aea344da67047a4331" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a3d6fea5dc4a948c3f9c5a3be01936" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 41881 } health_report { overall_health: UNKNOWN } } }
I20260808 02:31:14.623972 32224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:14.619197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52286 (local address 127.24.116.193:37647)
0808 02:31:14.619402 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:14.619407 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:14.619425 (+ 18us) server_negotiation.cc:407] Connection header received
0808 02:31:14.619517 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:14.619520 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:14.619596 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:14.619724 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:31:14.620059 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.620848 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.622137 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.622528 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.622617 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:14.623029 (+ 412us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:31:14.623519 (+ 490us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:31:14.623633 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:14.623712 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 02:31:14.623775 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 02:31:14.632890 32124 raft_consensus.cc:1261] T a1b402c49ab04a8d8cdc5c416fff60d7 P e2a3d6fea5dc4a948c3f9c5a3be01936 [term 1 FOLLOWER]: Refusing update from remote peer a76b63f8811646b7ba86be5b66d3c10e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:31:14.633955 32248 consensus_queue.cc:1035] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a3d6fea5dc4a948c3f9c5a3be01936" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 41881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:31:14.634296 31929 raft_consensus.cc:1261] T a1b402c49ab04a8d8cdc5c416fff60d7 P 8bf97e87964c44aea344da67047a4331 [term 1 FOLLOWER]: Refusing update from remote peer a76b63f8811646b7ba86be5b66d3c10e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:31:14.635107 32248 consensus_queue.cc:1035] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf97e87964c44aea344da67047a4331" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:31:14.645893 32251 mvcc.cc:205] Tried to move back new op lower bound from 7316096100885270528 to 7316096100701638656. Current Snapshot: MvccSnapshot[applied={T|T < 7316096100885270528}]
I20260808 02:31:14.650405 32252 mvcc.cc:205] Tried to move back new op lower bound from 7316096100885270528 to 7316096100701638656. Current Snapshot: MvccSnapshot[applied={T|T < 7316096100885270528}]
I20260808 02:31:14.652009 32253 mvcc.cc:205] Tried to move back new op lower bound from 7316096100885270528 to 7316096100701638656. Current Snapshot: MvccSnapshot[applied={T|T < 7316096100885270528}]
I20260808 02:31:14.660053 31472 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55192:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:31:14.660354 31472 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55192:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:31:14.664397 31472 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fc0e8739fb2f4f0a959649e13801a8a2: Sending DeleteTablet for 3 replicas of tablet a1b402c49ab04a8d8cdc5c416fff60d7
I20260808 02:31:14.665670 31676 tablet_service.cc:1514] Processing DeleteTablet for tablet a1b402c49ab04a8d8cdc5c416fff60d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:14 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:52280
I20260808 02:31:14.665764 31896 tablet_service.cc:1514] Processing DeleteTablet for tablet a1b402c49ab04a8d8cdc5c416fff60d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:14 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:37726
I20260808 02:31:14.665817 32090 tablet_service.cc:1514] Processing DeleteTablet for tablet a1b402c49ab04a8d8cdc5c416fff60d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:14 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:41818
I20260808 02:31:14.672636 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 31570
I20260808 02:31:14.681561 32271 tablet_replica.cc:330] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e: stopping tablet replica
I20260808 02:31:14.682196 32271 raft_consensus.cc:2229] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:31:14.683080 32271 raft_consensus.cc:2258] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:14.687201 32271 ts_tablet_manager.cc:1905] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:14.692706 32273 tablet_replica.cc:330] T a1b402c49ab04a8d8cdc5c416fff60d7 P e2a3d6fea5dc4a948c3f9c5a3be01936: stopping tablet replica
I20260808 02:31:14.693138 32273 raft_consensus.cc:2229] T a1b402c49ab04a8d8cdc5c416fff60d7 P e2a3d6fea5dc4a948c3f9c5a3be01936 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:31:14.693638 32273 raft_consensus.cc:2258] T a1b402c49ab04a8d8cdc5c416fff60d7 P e2a3d6fea5dc4a948c3f9c5a3be01936 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:14.694463 32272 tablet_replica.cc:330] T a1b402c49ab04a8d8cdc5c416fff60d7 P 8bf97e87964c44aea344da67047a4331: stopping tablet replica
I20260808 02:31:14.694881 32272 raft_consensus.cc:2229] T a1b402c49ab04a8d8cdc5c416fff60d7 P 8bf97e87964c44aea344da67047a4331 [term 1 FOLLOWER]: Raft consensus shutting down.
Aug 08 02:31:14 dist-test-slave-45dx krb5kdc[31400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156272, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.193@KRBTEST.COM
I20260808 02:31:14.695418 32272 raft_consensus.cc:2258] T a1b402c49ab04a8d8cdc5c416fff60d7 P 8bf97e87964c44aea344da67047a4331 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:14.697016 32273 ts_tablet_manager.cc:1905] T a1b402c49ab04a8d8cdc5c416fff60d7 P e2a3d6fea5dc4a948c3f9c5a3be01936: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:14.697466 32272 ts_tablet_manager.cc:1905] T a1b402c49ab04a8d8cdc5c416fff60d7 P 8bf97e87964c44aea344da67047a4331: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:14.700766 32271 ts_tablet_manager.cc:1918] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:31:14.700971 32271 log.cc:1196] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/a1b402c49ab04a8d8cdc5c416fff60d7
I20260808 02:31:14.701608 32271 ts_tablet_manager.cc:1939] T a1b402c49ab04a8d8cdc5c416fff60d7 P a76b63f8811646b7ba86be5b66d3c10e: Deleting consensus metadata
I20260808 02:31:14.703657 31445 catalog_manager.cc:4841] TS a76b63f8811646b7ba86be5b66d3c10e (127.24.116.193:37647): tablet a1b402c49ab04a8d8cdc5c416fff60d7 (table test-table [id=24d1b6f1acaa4a81a459687a9bced1ca]) successfully deleted
I20260808 02:31:14.704707 32272 ts_tablet_manager.cc:1918] T a1b402c49ab04a8d8cdc5c416fff60d7 P 8bf97e87964c44aea344da67047a4331: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:31:14.704876 32272 log.cc:1196] T a1b402c49ab04a8d8cdc5c416fff60d7 P 8bf97e87964c44aea344da67047a4331: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/a1b402c49ab04a8d8cdc5c416fff60d7
I20260808 02:31:14.705284 32273 ts_tablet_manager.cc:1918] T a1b402c49ab04a8d8cdc5c416fff60d7 P e2a3d6fea5dc4a948c3f9c5a3be01936: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:31:14.705448 32272 ts_tablet_manager.cc:1939] T a1b402c49ab04a8d8cdc5c416fff60d7 P 8bf97e87964c44aea344da67047a4331: Deleting consensus metadata
I20260808 02:31:14.705564 32273 log.cc:1196] T a1b402c49ab04a8d8cdc5c416fff60d7 P e2a3d6fea5dc4a948c3f9c5a3be01936: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/a1b402c49ab04a8d8cdc5c416fff60d7
I20260808 02:31:14.706200 32273 ts_tablet_manager.cc:1939] T a1b402c49ab04a8d8cdc5c416fff60d7 P e2a3d6fea5dc4a948c3f9c5a3be01936: Deleting consensus metadata
I20260808 02:31:14.707255 31450 catalog_manager.cc:4841] TS 8bf97e87964c44aea344da67047a4331 (127.24.116.194:35107): tablet a1b402c49ab04a8d8cdc5c416fff60d7 (table test-table [id=24d1b6f1acaa4a81a459687a9bced1ca]) successfully deleted
I20260808 02:31:14.708165 31446 catalog_manager.cc:4841] TS e2a3d6fea5dc4a948c3f9c5a3be01936 (127.24.116.195:41881): tablet a1b402c49ab04a8d8cdc5c416fff60d7 (table test-table [id=24d1b6f1acaa4a81a459687a9bced1ca]) successfully deleted
I20260808 02:31:14.712531 32224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:14.674421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52288 (local address 127.24.116.193:37647)
0808 02:31:14.674613 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:14.674619 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:14.684153 (+ 9534us) server_negotiation.cc:407] Connection header received
0808 02:31:14.684785 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:14.684792 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:14.684916 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:14.685031 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:14.686934 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.688186 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.690109 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.690848 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.690949 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:14.705218 (+ 14269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:14.705238 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:14.705270 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:14.705323 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:14.709427 (+ 4104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:14.710357 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:14.710365 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:14.710368 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:14.710512 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:14.710953 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:14.710956 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:14.710962 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:14.711350 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:14.711574 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:14.711941 (+ 367us) server_negotiation.cc:299] Negotiation successful
0808 02:31:14.712120 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 02:31:14.713438 31787 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:14.822830 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 31570
I20260808 02:31:14.847914 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 31801
Aug 08 02:31:14 dist-test-slave-45dx krb5kdc[31400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156272, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.194@KRBTEST.COM
I20260808 02:31:14.863235 32230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:14.848832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37738 (local address 127.24.116.194:35107)
0808 02:31:14.849008 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:14.849018 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:14.849038 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:31:14.849149 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:14.849154 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:14.849216 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:14.849303 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:14.850645 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.851478 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.852890 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.853297 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.853405 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:14.857557 (+ 4152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:14.857573 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:14.857591 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:14.857626 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:14.860556 (+ 2930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:14.861190 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:14.861198 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:14.861200 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:14.861350 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:14.861707 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:14.861711 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:14.861713 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:14.862184 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:14.862427 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:14.862647 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 02:31:14.862908 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 02:31:14.863970 31988 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:14.954010 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 31801
I20260808 02:31:14.977968 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 32002
Aug 08 02:31:14 dist-test-slave-45dx krb5kdc[31400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156272, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.195@KRBTEST.COM
I20260808 02:31:14.993013 32227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:14.978788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41832 (local address 127.24.116.195:41881)
0808 02:31:14.978976 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:14.978984 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:14.979010 (+ 26us) server_negotiation.cc:407] Connection header received
0808 02:31:14.979233 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:14.979237 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:14.979315 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:14.979441 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:14.981121 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.981843 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.983070 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:14.983443 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:14.983534 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:14.987776 (+ 4242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:14.987792 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:14.987809 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:14.987844 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:14.990417 (+ 2573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:14.991005 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:14.991012 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:14.991014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:14.991157 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:14.991511 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:14.991515 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:14.991518 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:14.991895 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:14.992139 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:14.992539 (+ 400us) server_negotiation.cc:299] Negotiation successful
0808 02:31:14.992747 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 02:31:14.993641 32195 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:15.082949 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 32002
I20260808 02:31:15.108924 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 31422
I20260808 02:31:15.110095 31519 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:15.220268 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 31422
2026-08-08T02:31:15Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4662 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T02:31:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:31:15Z Disabled control of system clock
I20260808 02:31:15.307746 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:42789
--webserver_interface=127.24.116.254
--webserver_port=0
--builtin_ntp_servers=127.24.116.212:36715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:42789
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 02:31:15.647859 32287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:15.648146 32287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:15.648231 32287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:15.655473 32287 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:31:15.655594 32287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:15.655635 32287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:15.655706 32287 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:31:15.655751 32287 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:31:15.664904 32287 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:36715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:42789
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:42789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:15.666189 32287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:15.667991 32287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:15.680665 32301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:15.680655 32298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:15.681008 32297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:15.681468 32287 server_base.cc:1034] running on GCE node
I20260808 02:31:15.682337 32287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:15.683888 32287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:15.685138 32287 hybrid_clock.cc:648] HybridClock initialized: now 1786156275685080 us; error 49 us; skew 500 ppm
I20260808 02:31:15.685519 32287 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:31:15.687857 32287 webserver.cc:460] Webserver started at http://127.24.116.254:39105/ using document root <none> and password file <none>
I20260808 02:31:15.688756 32287 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:15.688915 32287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:15.689272 32287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:15.692364 32287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "d3264dcce6f64b7aba65a19f7e71a5fe"
format_stamp: "Formatted at 2026-08-08 02:31:15 on dist-test-slave-45dx"
server_key: "a07716c41ae77248383e936b82096de4"
server_key_iv: "0618fe68eba009fc366df5385479abc3"
server_key_version: "encryptionkey@0"
I20260808 02:31:15.693233 32287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "d3264dcce6f64b7aba65a19f7e71a5fe"
format_stamp: "Formatted at 2026-08-08 02:31:15 on dist-test-slave-45dx"
server_key: "a07716c41ae77248383e936b82096de4"
server_key_iv: "0618fe68eba009fc366df5385479abc3"
server_key_version: "encryptionkey@0"
I20260808 02:31:15.698437 32287 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 02:31:15.702064 32311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:15.703327 32287 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 02:31:15.703512 32287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "d3264dcce6f64b7aba65a19f7e71a5fe"
format_stamp: "Formatted at 2026-08-08 02:31:15 on dist-test-slave-45dx"
server_key: "a07716c41ae77248383e936b82096de4"
server_key_iv: "0618fe68eba009fc366df5385479abc3"
server_key_version: "encryptionkey@0"
I20260808 02:31:15.703734 32287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:15.709511 32287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:15.710361 32287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:15.710686 32287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:15.729420 32287 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:42789
I20260808 02:31:15.729466 32392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:42789 every 8 connection(s)
I20260808 02:31:15.730849 32287 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:31:15.734516 32396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:15.741143 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 32287
I20260808 02:31:15.741461 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:31:15.742614 25043 external_mini_cluster.cc:1428] Setting key 8a5d3cee30cd58621214b941a82347ce
I20260808 02:31:15.749969 32396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3264dcce6f64b7aba65a19f7e71a5fe: Bootstrap starting.
I20260808 02:31:15.753407 32400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:15.745955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54206 (local address 127.24.116.254:42789)
0808 02:31:15.747566 (+ 1611us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:15.747582 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:15.747633 (+ 51us) server_negotiation.cc:407] Connection header received
0808 02:31:15.749451 (+ 1818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:15.749478 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:15.749925 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:15.750429 (+ 504us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:15.751598 (+ 1169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:15.751605 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:15.751621 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:31:15.751637 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:15.751707 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:31:15.751724 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:15.751987 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:15.752140 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 02:31:15.752462 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":989,"thread_start_us":744,"threads_started":1}
I20260808 02:31:15.753633 32396 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3264dcce6f64b7aba65a19f7e71a5fe: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:15.754827 32396 log.cc:824] T 00000000000000000000000000000000 P d3264dcce6f64b7aba65a19f7e71a5fe: Log is configured to *not* fsync() on all Append() calls
I20260808 02:31:15.758157 32396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3264dcce6f64b7aba65a19f7e71a5fe: No bootstrap required, opened a new log
I20260808 02:31:15.766405 32396 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3264dcce6f64b7aba65a19f7e71a5fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3264dcce6f64b7aba65a19f7e71a5fe" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42789 } }
I20260808 02:31:15.766848 32396 raft_consensus.cc:374] T 00000000000000000000000000000000 P d3264dcce6f64b7aba65a19f7e71a5fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:15.766979 32396 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3264dcce6f64b7aba65a19f7e71a5fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3264dcce6f64b7aba65a19f7e71a5fe, State: Initialized, Role: FOLLOWER
I20260808 02:31:15.767633 32396 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3264dcce6f64b7aba65a19f7e71a5fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3264dcce6f64b7aba65a19f7e71a5fe" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42789 } }
I20260808 02:31:15.767848 32396 raft_consensus.cc:388] T 00000000000000000000000000000000 P d3264dcce6f64b7aba65a19f7e71a5fe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:31:15.767952 32396 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3264dcce6f64b7aba65a19f7e71a5fe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:31:15.768074 32396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3264dcce6f64b7aba65a19f7e71a5fe [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:15.770251 32396 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3264dcce6f64b7aba65a19f7e71a5fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3264dcce6f64b7aba65a19f7e71a5fe" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42789 } }
I20260808 02:31:15.770709 32396 leader_election.cc:302] T 00000000000000000000000000000000 P d3264dcce6f64b7aba65a19f7e71a5fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3264dcce6f64b7aba65a19f7e71a5fe; no voters:
I20260808 02:31:15.771262 32396 leader_election.cc:288] T 00000000000000000000000000000000 P d3264dcce6f64b7aba65a19f7e71a5fe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:31:15.771416 32403 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3264dcce6f64b7aba65a19f7e71a5fe [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:31:15.772169 32403 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3264dcce6f64b7aba65a19f7e71a5fe [term 1 LEADER]: Becoming Leader. State: Replica: d3264dcce6f64b7aba65a19f7e71a5fe, State: Running, Role: LEADER
I20260808 02:31:15.772740 32403 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3264dcce6f64b7aba65a19f7e71a5fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3264dcce6f64b7aba65a19f7e71a5fe" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42789 } }
I20260808 02:31:15.773511 32396 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3264dcce6f64b7aba65a19f7e71a5fe [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:31:15.775607 32405 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3264dcce6f64b7aba65a19f7e71a5fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3264dcce6f64b7aba65a19f7e71a5fe. Latest consensus state: current_term: 1 leader_uuid: "d3264dcce6f64b7aba65a19f7e71a5fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3264dcce6f64b7aba65a19f7e71a5fe" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42789 } } }
I20260808 02:31:15.776003 32405 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3264dcce6f64b7aba65a19f7e71a5fe [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:15.775717 32404 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3264dcce6f64b7aba65a19f7e71a5fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d3264dcce6f64b7aba65a19f7e71a5fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3264dcce6f64b7aba65a19f7e71a5fe" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42789 } } }
I20260808 02:31:15.776166 32404 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3264dcce6f64b7aba65a19f7e71a5fe [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:15.777992 32410 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:31:15.783609 32410 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:31:15.792143 32410 catalog_manager.cc:1347] Generated new cluster ID: 8d0cdde5ba3d47bdb01141355df1f77a
I20260808 02:31:15.792323 32410 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:31:15.816843 32410 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:31:15.817276 32410 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:31:15.828157 32410 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d3264dcce6f64b7aba65a19f7e71a5fe: Generated new TSK 0
I20260808 02:31:15.828992 32410 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:31:15.843817 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:42789
--builtin_ntp_servers=127.24.116.212:36715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 02:31:16.182235 32435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:16.182515 32435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:16.182680 32435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:16.190040 32435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:16.190140 32435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:16.190308 32435 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:31:16.199236 32435 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:36715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:42789
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:16.200533 32435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:16.202337 32435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:16.215746 32449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:16.215787 32448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:16.215749 32452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:16.216691 32435 server_base.cc:1034] running on GCE node
I20260808 02:31:16.217314 32435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:16.218333 32435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:16.219568 32435 hybrid_clock.cc:648] HybridClock initialized: now 1786156276219514 us; error 50 us; skew 500 ppm
I20260808 02:31:16.219951 32435 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:31:16.222249 32435 webserver.cc:460] Webserver started at http://127.24.116.193:45545/ using document root <none> and password file <none>
I20260808 02:31:16.222975 32435 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:16.223109 32435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:16.223462 32435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:16.226394 32435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "d221c739cf4e4003accb930b90eec9d8"
format_stamp: "Formatted at 2026-08-08 02:31:16 on dist-test-slave-45dx"
server_key: "0e6c9e0af5fde83bf0aee2bd9e77663a"
server_key_iv: "164fbdd9713aa16a12f8fd4bf634a3bc"
server_key_version: "encryptionkey@0"
I20260808 02:31:16.227206 32435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "d221c739cf4e4003accb930b90eec9d8"
format_stamp: "Formatted at 2026-08-08 02:31:16 on dist-test-slave-45dx"
server_key: "0e6c9e0af5fde83bf0aee2bd9e77663a"
server_key_iv: "164fbdd9713aa16a12f8fd4bf634a3bc"
server_key_version: "encryptionkey@0"
I20260808 02:31:16.232448 32435 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 02:31:16.235942 32463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:16.237386 32435 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:31:16.237568 32435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "d221c739cf4e4003accb930b90eec9d8"
format_stamp: "Formatted at 2026-08-08 02:31:16 on dist-test-slave-45dx"
server_key: "0e6c9e0af5fde83bf0aee2bd9e77663a"
server_key_iv: "164fbdd9713aa16a12f8fd4bf634a3bc"
server_key_version: "encryptionkey@0"
I20260808 02:31:16.237812 32435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:16.243443 32435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:16.244239 32435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:16.244539 32435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:16.245491 32435 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:16.246917 32435 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:16.247041 32435 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:16.247184 32435 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:16.247277 32435 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:16.285197 32435 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:41385
I20260808 02:31:16.285300 32638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:41385 every 8 connection(s)
I20260808 02:31:16.286602 32435 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:31:16.289907 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 32435
I20260808 02:31:16.290102 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:31:16.290810 25043 external_mini_cluster.cc:1428] Setting key 2446b420dfd7c211da84c897b45d4c10
I20260808 02:31:16.294008 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:42789
--builtin_ntp_servers=127.24.116.212:36715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 02:31:16.295817 32641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:16.289313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:59147 (local address 127.24.116.254:42789)
0808 02:31:16.289830 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:16.289838 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:16.291255 (+ 1417us) server_negotiation.cc:407] Connection header received
0808 02:31:16.293424 (+ 2169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:16.293429 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:16.293490 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:16.293609 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:16.294957 (+ 1348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:16.294966 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:16.294974 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:31:16.294998 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:16.295062 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:31:16.295082 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:16.295221 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:16.295386 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 02:31:16.295453 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":241,"threads_started":1}
I20260808 02:31:16.296546 32642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:16.289927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:42789 (local address 127.24.116.193:59147)
0808 02:31:16.291073 (+ 1146us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:16.291126 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:16.293171 (+ 2045us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:16.293802 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:16.293810 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:16.293905 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:16.294659 (+ 754us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:31:16.294662 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:16.294699 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:31:16.294782 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:16.295196 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:16.295204 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:16.295209 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 02:31:16.295412 (+ 203us) client_negotiation.cc:240] Negotiation successful
0808 02:31:16.295588 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"thread_start_us":383,"threads_started":1}
I20260808 02:31:16.298002 32639 heartbeater.cc:347] Connected to a master server at 127.24.116.254:42789
I20260808 02:31:16.298302 32639 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:16.298869 32639 heartbeater.cc:511] Master 127.24.116.254:42789 requested a full tablet report, sending...
I20260808 02:31:16.300936 32338 ts_manager.cc:194] Registered new tserver with Master: d221c739cf4e4003accb930b90eec9d8 (127.24.116.193:41385)
W20260808 02:31:16.644110 32643 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:16.644582 32643 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:16.644812 32643 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:16.652155 32643 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:16.652251 32643 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:16.652470 32643 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:31:16.661777 32643 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:36715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:42789
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:16.663107 32643 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:16.665030 32643 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:16.678663 32651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:16.678687 32654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:16.678620 32652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:16.679414 32643 server_base.cc:1034] running on GCE node
I20260808 02:31:16.680037 32643 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:16.681046 32643 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:16.682281 32643 hybrid_clock.cc:648] HybridClock initialized: now 1786156276682233 us; error 57 us; skew 500 ppm
I20260808 02:31:16.682618 32643 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:31:16.685127 32643 webserver.cc:460] Webserver started at http://127.24.116.194:44903/ using document root <none> and password file <none>
I20260808 02:31:16.685860 32643 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:16.686003 32643 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:16.686434 32643 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:16.689386 32643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "f5d3e05ed34c4b4da2b28b6b6463d0d7"
format_stamp: "Formatted at 2026-08-08 02:31:16 on dist-test-slave-45dx"
server_key: "53d55e64da0ba74d2735afbce4c85e20"
server_key_iv: "eceb9ab2c8c7177b83358068671b7124"
server_key_version: "encryptionkey@0"
I20260808 02:31:16.690228 32643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "f5d3e05ed34c4b4da2b28b6b6463d0d7"
format_stamp: "Formatted at 2026-08-08 02:31:16 on dist-test-slave-45dx"
server_key: "53d55e64da0ba74d2735afbce4c85e20"
server_key_iv: "eceb9ab2c8c7177b83358068671b7124"
server_key_version: "encryptionkey@0"
I20260808 02:31:16.695544 32643 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 02:31:16.699204 32662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:16.700805 32643 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 02:31:16.700987 32643 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "f5d3e05ed34c4b4da2b28b6b6463d0d7"
format_stamp: "Formatted at 2026-08-08 02:31:16 on dist-test-slave-45dx"
server_key: "53d55e64da0ba74d2735afbce4c85e20"
server_key_iv: "eceb9ab2c8c7177b83358068671b7124"
server_key_version: "encryptionkey@0"
I20260808 02:31:16.701227 32643 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:16.706980 32643 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:16.707901 32643 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:16.708190 32643 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:16.709194 32643 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:16.710686 32643 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:16.710813 32643 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:16.710956 32643 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:16.711051 32643 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:16.758024 32643 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:40127
I20260808 02:31:16.758057 371 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:40127 every 8 connection(s)
I20260808 02:31:16.759521 32643 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:31:16.759927 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 32643
I20260808 02:31:16.760113 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:31:16.760840 25043 external_mini_cluster.cc:1428] Setting key 79ff744ef0218d670d1f8596cee2740a
I20260808 02:31:16.764168 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:42789
--builtin_ntp_servers=127.24.116.212:36715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 02:31:16.768378 32641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:16.762444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:40983 (local address 127.24.116.254:42789)
0808 02:31:16.762651 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:16.762658 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:16.764186 (+ 1528us) server_negotiation.cc:407] Connection header received
0808 02:31:16.766007 (+ 1821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:16.766012 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:16.766090 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:16.766214 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:16.767603 (+ 1389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:16.767609 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:16.767614 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:31:16.767633 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:16.767675 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:31:16.767686 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:16.767828 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:16.768029 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 02:31:16.768097 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 02:31:16.769294 374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:16.763083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:42789 (local address 127.24.116.194:40983)
0808 02:31:16.764028 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:16.764068 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:16.765744 (+ 1676us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:16.766457 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:16.766465 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:16.766553 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:16.767306 (+ 753us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:31:16.767309 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:16.767348 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:31:16.767433 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:16.767785 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:16.767797 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:16.767806 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 02:31:16.768098 (+ 292us) client_negotiation.cc:240] Negotiation successful
0808 02:31:16.768384 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":315,"threads_started":1}
I20260808 02:31:16.770680 372 heartbeater.cc:347] Connected to a master server at 127.24.116.254:42789
I20260808 02:31:16.770998 372 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:16.771565 372 heartbeater.cc:511] Master 127.24.116.254:42789 requested a full tablet report, sending...
I20260808 02:31:16.773036 32338 ts_manager.cc:194] Registered new tserver with Master: f5d3e05ed34c4b4da2b28b6b6463d0d7 (127.24.116.194:40127)
W20260808 02:31:17.104990 380 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:17.105265 380 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:17.105360 380 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:17.112521 380 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:17.112619 380 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:17.112725 380 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:31:17.121420 380 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:36715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:42789
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:17.122650 380 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:17.124379 380 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:17.137408 389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:17.137485 393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:17.137516 387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:17.138438 380 server_base.cc:1034] running on GCE node
I20260808 02:31:17.139102 380 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:17.140152 380 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:17.141398 380 hybrid_clock.cc:648] HybridClock initialized: now 1786156277141351 us; error 59 us; skew 500 ppm
I20260808 02:31:17.141758 380 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:31:17.144057 380 webserver.cc:460] Webserver started at http://127.24.116.195:32829/ using document root <none> and password file <none>
I20260808 02:31:17.144856 380 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:17.144992 380 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:17.145342 380 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:17.148404 380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "7794a76739bf42cd85a3e7efe2080017"
format_stamp: "Formatted at 2026-08-08 02:31:17 on dist-test-slave-45dx"
server_key: "217542958f91d061b89ee6cdeefdcc9c"
server_key_iv: "a88dadfabfd3a5b4ba2dc5adc049dbad"
server_key_version: "encryptionkey@0"
I20260808 02:31:17.149230 380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "7794a76739bf42cd85a3e7efe2080017"
format_stamp: "Formatted at 2026-08-08 02:31:17 on dist-test-slave-45dx"
server_key: "217542958f91d061b89ee6cdeefdcc9c"
server_key_iv: "a88dadfabfd3a5b4ba2dc5adc049dbad"
server_key_version: "encryptionkey@0"
I20260808 02:31:17.154315 380 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 02:31:17.157745 401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:17.159046 380 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 02:31:17.159240 380 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "7794a76739bf42cd85a3e7efe2080017"
format_stamp: "Formatted at 2026-08-08 02:31:17 on dist-test-slave-45dx"
server_key: "217542958f91d061b89ee6cdeefdcc9c"
server_key_iv: "a88dadfabfd3a5b4ba2dc5adc049dbad"
server_key_version: "encryptionkey@0"
I20260808 02:31:17.159469 380 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:17.165113 380 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:17.165892 380 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:17.166191 380 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:17.167079 380 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:17.168551 380 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:17.168674 380 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:17.168814 380 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:17.168906 380 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:17.203071 380 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:33887
I20260808 02:31:17.203118 573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:33887 every 8 connection(s)
I20260808 02:31:17.204533 380 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:31:17.209225 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 380
I20260808 02:31:17.209431 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:31:17.209892 25043 external_mini_cluster.cc:1428] Setting key 0b5f68bfa5bbfa4b92b4cce7c4d7e6b6
I20260808 02:31:17.213281 32641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.207274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:57687 (local address 127.24.116.254:42789)
0808 02:31:17.207458 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:17.207463 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:17.208945 (+ 1482us) server_negotiation.cc:407] Connection header received
0808 02:31:17.210826 (+ 1881us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:17.210831 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:17.210904 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:17.211024 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:17.212368 (+ 1344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:17.212376 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:17.212380 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:31:17.212412 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:17.212448 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:31:17.212483 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:17.212615 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:17.212954 (+ 339us) server_negotiation.cc:299] Negotiation successful
0808 02:31:17.213020 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 02:31:17.214102 577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.207782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:42789 (local address 127.24.116.195:57687)
0808 02:31:17.208769 (+ 987us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:17.208803 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:17.210572 (+ 1769us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:17.211252 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:17.211259 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:17.211343 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:17.212036 (+ 693us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:31:17.212039 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:17.212100 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:31:17.212182 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:17.212687 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:17.212700 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:17.212710 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 02:31:17.212998 (+ 288us) client_negotiation.cc:240] Negotiation successful
0808 02:31:17.213180 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":320,"threads_started":1}
I20260808 02:31:17.215358 574 heartbeater.cc:347] Connected to a master server at 127.24.116.254:42789
I20260808 02:31:17.215647 574 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:17.216192 574 heartbeater.cc:511] Master 127.24.116.254:42789 requested a full tablet report, sending...
I20260808 02:31:17.217564 32338 ts_manager.cc:194] Registered new tserver with Master: 7794a76739bf42cd85a3e7efe2080017 (127.24.116.195:33887)
I20260808 02:31:17.225236 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:31:17.232450 32641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.229720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54218 (local address 127.24.116.254:42789)
0808 02:31:17.229897 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:17.229901 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:17.230466 (+ 565us) server_negotiation.cc:407] Connection header received
0808 02:31:17.230667 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:17.230673 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:17.230732 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:17.230841 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:17.231736 (+ 895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:17.231742 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:17.231747 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:31:17.231767 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:17.231804 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:31:17.231816 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:17.231971 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:17.232060 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 02:31:17.232121 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 02:31:17.236464 32338 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54218:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:31:17.243242 32338 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:31:17.277704 606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.256737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54160 (local address 127.24.116.194:40127)
0808 02:31:17.272697 (+ 15960us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:17.272710 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:17.274424 (+ 1714us) server_negotiation.cc:407] Connection header received
0808 02:31:17.274504 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:17.274511 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:17.274701 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:17.274847 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:17.276724 (+ 1877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:17.276733 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:17.276754 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:31:17.276777 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:17.276824 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:31:17.276841 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:17.276987 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:17.277308 (+ 321us) server_negotiation.cc:299] Negotiation successful
0808 02:31:17.277406 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15772,"thread_start_us":15644,"threads_started":1}
I20260808 02:31:17.277750 605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.256177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:33887 (local address 127.0.0.1:48040)
0808 02:31:17.274245 (+ 18068us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:17.274264 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:17.274503 (+ 239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:17.275107 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:17.275114 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:17.275209 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:17.276528 (+ 1319us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:31:17.276531 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:17.276544 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:31:17.276581 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:17.277053 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:17.277060 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:17.277067 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 02:31:17.277190 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 02:31:17.277248 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17914,"thread_start_us":17743,"threads_started":1}
I20260808 02:31:17.278379 608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.256914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48040 (local address 127.24.116.195:33887)
0808 02:31:17.273722 (+ 16808us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:17.273735 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:17.274468 (+ 733us) server_negotiation.cc:407] Connection header received
0808 02:31:17.274678 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:17.274687 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:17.274923 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:17.275134 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:17.276772 (+ 1638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:17.276784 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:17.276799 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:31:17.276823 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:17.276890 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:31:17.276917 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:17.277091 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:17.277172 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 02:31:17.277278 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16598,"thread_start_us":16420,"threads_started":1}
I20260808 02:31:17.278843 603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.255775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52034 (local address 127.24.116.193:41385)
0808 02:31:17.274099 (+ 18324us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:17.274108 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:17.274142 (+ 34us) server_negotiation.cc:407] Connection header received
0808 02:31:17.274250 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:17.274258 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:17.274526 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:17.275913 (+ 1387us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:17.277301 (+ 1388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:17.277307 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:17.277317 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:31:17.277340 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:17.277387 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:31:17.277405 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:17.278344 (+ 939us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:17.278417 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 02:31:17.278532 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18172,"thread_start_us":18037,"threads_started":1}
I20260808 02:31:17.279505 602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.255602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:41385 (local address 127.0.0.1:52034)
0808 02:31:17.270133 (+ 14531us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:17.270202 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:17.270375 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:17.275435 (+ 5060us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:17.275442 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:17.275474 (+ 32us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:17.276203 (+ 729us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:31:17.276207 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:17.276240 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:31:17.276369 (+ 129us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:17.277548 (+ 1179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:17.277553 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:17.277559 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 02:31:17.277716 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 02:31:17.277772 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14171,"thread_start_us":14905,"threads_started":1}
I20260808 02:31:17.280159 604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.255842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:40127 (local address 127.0.0.1:54160)
0808 02:31:17.274154 (+ 18312us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:17.274173 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:17.274293 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:17.275842 (+ 1549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:17.275846 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:17.275867 (+ 21us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:17.276509 (+ 642us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:31:17.276512 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:17.276527 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:31:17.276564 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:17.276943 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:17.276954 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:17.276962 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 02:31:17.277139 (+ 177us) client_negotiation.cc:240] Negotiation successful
0808 02:31:17.278166 (+ 1027us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17233,"mutex_wait_us":923,"thread_start_us":17067,"threads_started":1}
I20260808 02:31:17.282279 478 tablet_service.cc:1467] Processing CreateTablet for tablet be834e57cc294ed7bf5cd09f14f7af9d (DEFAULT_TABLE table=test-table [id=417db132c80a40c39a7cbebe0a77d659]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:31:17.283067 32539 tablet_service.cc:1467] Processing CreateTablet for tablet be834e57cc294ed7bf5cd09f14f7af9d (DEFAULT_TABLE table=test-table [id=417db132c80a40c39a7cbebe0a77d659]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:31:17.283746 478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be834e57cc294ed7bf5cd09f14f7af9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:17.283624 32740 tablet_service.cc:1467] Processing CreateTablet for tablet be834e57cc294ed7bf5cd09f14f7af9d (DEFAULT_TABLE table=test-table [id=417db132c80a40c39a7cbebe0a77d659]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:31:17.284466 32539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be834e57cc294ed7bf5cd09f14f7af9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:17.285017 32740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be834e57cc294ed7bf5cd09f14f7af9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:17.298153 609 tablet_bootstrap.cc:492] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017: Bootstrap starting.
I20260808 02:31:17.299995 611 tablet_bootstrap.cc:492] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7: Bootstrap starting.
I20260808 02:31:17.302214 609 tablet_bootstrap.cc:654] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:17.303213 609 log.cc:824] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017: Log is configured to *not* fsync() on all Append() calls
I20260808 02:31:17.303563 32639 heartbeater.cc:503] Master 127.24.116.254:42789 was elected leader, sending a full tablet report...
I20260808 02:31:17.304425 611 tablet_bootstrap.cc:654] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:17.306387 611 log.cc:824] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7: Log is configured to *not* fsync() on all Append() calls
I20260808 02:31:17.306538 609 tablet_bootstrap.cc:492] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017: No bootstrap required, opened a new log
I20260808 02:31:17.306815 609 ts_tablet_manager.cc:1397] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.008s
I20260808 02:31:17.308542 613 tablet_bootstrap.cc:492] T be834e57cc294ed7bf5cd09f14f7af9d P d221c739cf4e4003accb930b90eec9d8: Bootstrap starting.
I20260808 02:31:17.309767 611 tablet_bootstrap.cc:492] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7: No bootstrap required, opened a new log
I20260808 02:31:17.310139 611 ts_tablet_manager.cc:1397] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.006s
I20260808 02:31:17.312122 613 tablet_bootstrap.cc:654] T be834e57cc294ed7bf5cd09f14f7af9d P d221c739cf4e4003accb930b90eec9d8: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:17.313401 613 log.cc:824] T be834e57cc294ed7bf5cd09f14f7af9d P d221c739cf4e4003accb930b90eec9d8: Log is configured to *not* fsync() on all Append() calls
I20260808 02:31:17.316490 613 tablet_bootstrap.cc:492] T be834e57cc294ed7bf5cd09f14f7af9d P d221c739cf4e4003accb930b90eec9d8: No bootstrap required, opened a new log
I20260808 02:31:17.316212 609 raft_consensus.cc:348] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d221c739cf4e4003accb930b90eec9d8" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41385 } } peers { permanent_uuid: "f5d3e05ed34c4b4da2b28b6b6463d0d7" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 40127 } } peers { permanent_uuid: "7794a76739bf42cd85a3e7efe2080017" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33887 } }
I20260808 02:31:17.316658 609 raft_consensus.cc:374] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:17.316761 613 ts_tablet_manager.cc:1397] T be834e57cc294ed7bf5cd09f14f7af9d P d221c739cf4e4003accb930b90eec9d8: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.005s
I20260808 02:31:17.316795 609 raft_consensus.cc:729] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7794a76739bf42cd85a3e7efe2080017, State: Initialized, Role: FOLLOWER
I20260808 02:31:17.317435 609 consensus_queue.cc:260] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d221c739cf4e4003accb930b90eec9d8" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41385 } } peers { permanent_uuid: "f5d3e05ed34c4b4da2b28b6b6463d0d7" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 40127 } } peers { permanent_uuid: "7794a76739bf42cd85a3e7efe2080017" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33887 } }
I20260808 02:31:17.318596 574 heartbeater.cc:503] Master 127.24.116.254:42789 was elected leader, sending a full tablet report...
I20260808 02:31:17.319087 609 ts_tablet_manager.cc:1428] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017: Time spent starting tablet: real 0.012s user 0.009s sys 0.002s
I20260808 02:31:17.322145 611 raft_consensus.cc:348] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d221c739cf4e4003accb930b90eec9d8" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41385 } } peers { permanent_uuid: "f5d3e05ed34c4b4da2b28b6b6463d0d7" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 40127 } } peers { permanent_uuid: "7794a76739bf42cd85a3e7efe2080017" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33887 } }
I20260808 02:31:17.322667 611 raft_consensus.cc:374] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:17.323546 611 raft_consensus.cc:729] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d3e05ed34c4b4da2b28b6b6463d0d7, State: Initialized, Role: FOLLOWER
I20260808 02:31:17.324261 611 consensus_queue.cc:260] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d221c739cf4e4003accb930b90eec9d8" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41385 } } peers { permanent_uuid: "f5d3e05ed34c4b4da2b28b6b6463d0d7" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 40127 } } peers { permanent_uuid: "7794a76739bf42cd85a3e7efe2080017" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33887 } }
I20260808 02:31:17.328524 613 raft_consensus.cc:348] T be834e57cc294ed7bf5cd09f14f7af9d P d221c739cf4e4003accb930b90eec9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d221c739cf4e4003accb930b90eec9d8" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41385 } } peers { permanent_uuid: "f5d3e05ed34c4b4da2b28b6b6463d0d7" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 40127 } } peers { permanent_uuid: "7794a76739bf42cd85a3e7efe2080017" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33887 } }
I20260808 02:31:17.329003 372 heartbeater.cc:503] Master 127.24.116.254:42789 was elected leader, sending a full tablet report...
I20260808 02:31:17.329013 613 raft_consensus.cc:374] T be834e57cc294ed7bf5cd09f14f7af9d P d221c739cf4e4003accb930b90eec9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:17.329111 613 raft_consensus.cc:729] T be834e57cc294ed7bf5cd09f14f7af9d P d221c739cf4e4003accb930b90eec9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d221c739cf4e4003accb930b90eec9d8, State: Initialized, Role: FOLLOWER
I20260808 02:31:17.329829 611 ts_tablet_manager.cc:1428] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7: Time spent starting tablet: real 0.020s user 0.010s sys 0.006s
I20260808 02:31:17.329797 613 consensus_queue.cc:260] T be834e57cc294ed7bf5cd09f14f7af9d P d221c739cf4e4003accb930b90eec9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d221c739cf4e4003accb930b90eec9d8" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41385 } } peers { permanent_uuid: "f5d3e05ed34c4b4da2b28b6b6463d0d7" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 40127 } } peers { permanent_uuid: "7794a76739bf42cd85a3e7efe2080017" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33887 } }
I20260808 02:31:17.331776 613 ts_tablet_manager.cc:1428] T be834e57cc294ed7bf5cd09f14f7af9d P d221c739cf4e4003accb930b90eec9d8: Time spent starting tablet: real 0.015s user 0.011s sys 0.003s
I20260808 02:31:17.429759 617 raft_consensus.cc:482] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:31:17.430133 617 raft_consensus.cc:504] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d221c739cf4e4003accb930b90eec9d8" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41385 } } peers { permanent_uuid: "f5d3e05ed34c4b4da2b28b6b6463d0d7" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 40127 } } peers { permanent_uuid: "7794a76739bf42cd85a3e7efe2080017" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33887 } }
I20260808 02:31:17.430907 616 raft_consensus.cc:482] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:31:17.431202 616 raft_consensus.cc:504] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d221c739cf4e4003accb930b90eec9d8" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41385 } } peers { permanent_uuid: "f5d3e05ed34c4b4da2b28b6b6463d0d7" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 40127 } } peers { permanent_uuid: "7794a76739bf42cd85a3e7efe2080017" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33887 } }
I20260808 02:31:17.432467 617 leader_election.cc:288] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d221c739cf4e4003accb930b90eec9d8 (127.24.116.193:41385), 7794a76739bf42cd85a3e7efe2080017 (127.24.116.195:33887)
I20260808 02:31:17.433139 616 leader_election.cc:288] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d221c739cf4e4003accb930b90eec9d8 (127.24.116.193:41385), f5d3e05ed34c4b4da2b28b6b6463d0d7 (127.24.116.194:40127)
I20260808 02:31:17.437170 577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.433470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:40127 (local address 127.24.116.195:43079)
0808 02:31:17.433982 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:17.434001 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:17.434110 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:17.435359 (+ 1249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:17.435366 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:17.435391 (+ 25us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:17.436349 (+ 958us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:31:17.436355 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:17.436376 (+ 21us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:31:17.436442 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:17.436729 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:17.436734 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:17.436738 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 02:31:17.436844 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 02:31:17.436901 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372}
I20260808 02:31:17.437268 606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.434824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:43079 (local address 127.24.116.194:40127)
0808 02:31:17.434987 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:17.434995 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:17.435011 (+ 16us) server_negotiation.cc:407] Connection header received
0808 02:31:17.435054 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:17.435060 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:17.435107 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:17.435192 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:17.436574 (+ 1382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:17.436579 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:17.436583 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:31:17.436602 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:17.436630 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:31:17.436644 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:17.436752 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:17.436924 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 02:31:17.436996 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 02:31:17.437897 603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.433147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:33929 (local address 127.24.116.193:41385)
0808 02:31:17.433329 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:17.433337 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:17.434404 (+ 1067us) server_negotiation.cc:407] Connection header received
0808 02:31:17.434698 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:17.434707 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:17.434784 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:17.434862 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:17.437109 (+ 2247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:17.437115 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:17.437119 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:31:17.437140 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:17.437180 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:31:17.437198 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:17.437289 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:17.437561 (+ 272us) server_negotiation.cc:299] Negotiation successful
0808 02:31:17.437619 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 02:31:17.438427 32764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be834e57cc294ed7bf5cd09f14f7af9d" candidate_uuid: "7794a76739bf42cd85a3e7efe2080017" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d3e05ed34c4b4da2b28b6b6463d0d7" is_pre_election: true
I20260808 02:31:17.438782 620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.432714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:41385 (local address 127.24.116.194:33929)
0808 02:31:17.434277 (+ 1563us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:17.434303 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:17.434529 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:17.435119 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:17.435126 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:17.435168 (+ 42us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:17.436866 (+ 1698us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:31:17.436869 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:17.436883 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:31:17.436932 (+ 49us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:17.437397 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:17.437404 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:17.437410 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 02:31:17.438211 (+ 801us) client_negotiation.cc:240] Negotiation successful
0808 02:31:17.438268 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1364,"thread_start_us":1861,"threads_started":1}
I20260808 02:31:17.438999 608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.434426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:52783 (local address 127.24.116.195:33887)
0808 02:31:17.434585 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:17.434593 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:17.434675 (+ 82us) server_negotiation.cc:407] Connection header received
0808 02:31:17.434891 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:17.434898 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:17.434953 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:17.435025 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:17.438245 (+ 3220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:17.438250 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:17.438255 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:31:17.438275 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:17.438304 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:31:17.438316 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:17.438415 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:17.438689 (+ 274us) server_negotiation.cc:299] Negotiation successful
0808 02:31:17.438744 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 02:31:17.438977 32764 raft_consensus.cc:2454] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7794a76739bf42cd85a3e7efe2080017 in term 0.
I20260808 02:31:17.439586 622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.433961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:34493 (local address 127.24.116.193:41385)
0808 02:31:17.437052 (+ 3091us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:17.437057 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:17.437078 (+ 21us) server_negotiation.cc:407] Connection header received
0808 02:31:17.437129 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:17.437134 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:17.437180 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:17.437284 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:17.438470 (+ 1186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:17.438475 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:17.438479 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:31:17.438497 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:17.438542 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:31:17.438558 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:17.438691 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:17.439067 (+ 376us) server_negotiation.cc:299] Negotiation successful
0808 02:31:17.439123 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2940,"thread_start_us":2702,"threads_started":1}
I20260808 02:31:17.439731 619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.432854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:33887 (local address 127.24.116.194:52783)
0808 02:31:17.434581 (+ 1727us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:17.434600 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:17.434754 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:17.435210 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:17.435215 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:17.435235 (+ 20us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:17.436573 (+ 1338us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:31:17.436577 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:17.436595 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:31:17.436636 (+ 41us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:17.438521 (+ 1885us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:17.438525 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:17.438529 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 02:31:17.439218 (+ 689us) client_negotiation.cc:240] Negotiation successful
0808 02:31:17.439268 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1602,"thread_start_us":1034,"threads_started":1}
I20260808 02:31:17.439780 403 leader_election.cc:302] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7794a76739bf42cd85a3e7efe2080017, f5d3e05ed34c4b4da2b28b6b6463d0d7; no voters:
I20260808 02:31:17.440337 621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.433521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:41385 (local address 127.24.116.195:34493)
0808 02:31:17.436090 (+ 2569us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:17.436104 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:17.436215 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:17.437581 (+ 1366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:17.437584 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:17.437603 (+ 19us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:17.438264 (+ 661us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:31:17.438268 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:17.438283 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:31:17.438317 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:17.438739 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:17.438743 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:17.438747 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 02:31:17.438856 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 02:31:17.438898 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2427,"thread_start_us":2233,"threads_started":1}
I20260808 02:31:17.440253 616 raft_consensus.cc:2781] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:31:17.440584 616 raft_consensus.cc:482] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:31:17.440392 32572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be834e57cc294ed7bf5cd09f14f7af9d" candidate_uuid: "f5d3e05ed34c4b4da2b28b6b6463d0d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d221c739cf4e4003accb930b90eec9d8" is_pre_election: true
I20260808 02:31:17.440716 616 raft_consensus.cc:3037] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:17.441020 32572 raft_consensus.cc:2454] T be834e57cc294ed7bf5cd09f14f7af9d P d221c739cf4e4003accb930b90eec9d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d3e05ed34c4b4da2b28b6b6463d0d7 in term 0.
I20260808 02:31:17.441208 32570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be834e57cc294ed7bf5cd09f14f7af9d" candidate_uuid: "7794a76739bf42cd85a3e7efe2080017" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d221c739cf4e4003accb930b90eec9d8" is_pre_election: true
I20260808 02:31:17.441576 32570 raft_consensus.cc:2454] T be834e57cc294ed7bf5cd09f14f7af9d P d221c739cf4e4003accb930b90eec9d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7794a76739bf42cd85a3e7efe2080017 in term 0.
I20260808 02:31:17.441854 32664 leader_election.cc:302] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d221c739cf4e4003accb930b90eec9d8, f5d3e05ed34c4b4da2b28b6b6463d0d7; no voters:
I20260808 02:31:17.441771 509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be834e57cc294ed7bf5cd09f14f7af9d" candidate_uuid: "f5d3e05ed34c4b4da2b28b6b6463d0d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7794a76739bf42cd85a3e7efe2080017" is_pre_election: true
I20260808 02:31:17.442366 617 raft_consensus.cc:2781] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:31:17.442517 617 raft_consensus.cc:482] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:31:17.442646 617 raft_consensus.cc:3037] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:17.443789 616 raft_consensus.cc:504] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d221c739cf4e4003accb930b90eec9d8" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41385 } } peers { permanent_uuid: "f5d3e05ed34c4b4da2b28b6b6463d0d7" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 40127 } } peers { permanent_uuid: "7794a76739bf42cd85a3e7efe2080017" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33887 } }
I20260808 02:31:17.444243 509 raft_consensus.cc:2379] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5d3e05ed34c4b4da2b28b6b6463d0d7 in current term 1: Already voted for candidate 7794a76739bf42cd85a3e7efe2080017 in this term.
I20260808 02:31:17.444691 616 leader_election.cc:288] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017 [CANDIDATE]: Term 1 election: Requested vote from peers d221c739cf4e4003accb930b90eec9d8 (127.24.116.193:41385), f5d3e05ed34c4b4da2b28b6b6463d0d7 (127.24.116.194:40127)
I20260808 02:31:17.445048 32570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be834e57cc294ed7bf5cd09f14f7af9d" candidate_uuid: "7794a76739bf42cd85a3e7efe2080017" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d221c739cf4e4003accb930b90eec9d8"
I20260808 02:31:17.445264 32570 raft_consensus.cc:3037] T be834e57cc294ed7bf5cd09f14f7af9d P d221c739cf4e4003accb930b90eec9d8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:17.445254 32764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be834e57cc294ed7bf5cd09f14f7af9d" candidate_uuid: "7794a76739bf42cd85a3e7efe2080017" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d3e05ed34c4b4da2b28b6b6463d0d7"
I20260808 02:31:17.445597 617 raft_consensus.cc:504] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d221c739cf4e4003accb930b90eec9d8" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41385 } } peers { permanent_uuid: "f5d3e05ed34c4b4da2b28b6b6463d0d7" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 40127 } } peers { permanent_uuid: "7794a76739bf42cd85a3e7efe2080017" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33887 } }
I20260808 02:31:17.446373 617 leader_election.cc:288] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7 [CANDIDATE]: Term 1 election: Requested vote from peers d221c739cf4e4003accb930b90eec9d8 (127.24.116.193:41385), 7794a76739bf42cd85a3e7efe2080017 (127.24.116.195:33887)
I20260808 02:31:17.446699 32764 raft_consensus.cc:2379] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7794a76739bf42cd85a3e7efe2080017 in current term 1: Already voted for candidate f5d3e05ed34c4b4da2b28b6b6463d0d7 in this term.
I20260808 02:31:17.446760 32572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be834e57cc294ed7bf5cd09f14f7af9d" candidate_uuid: "f5d3e05ed34c4b4da2b28b6b6463d0d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d221c739cf4e4003accb930b90eec9d8"
I20260808 02:31:17.446911 509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be834e57cc294ed7bf5cd09f14f7af9d" candidate_uuid: "f5d3e05ed34c4b4da2b28b6b6463d0d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7794a76739bf42cd85a3e7efe2080017"
I20260808 02:31:17.447160 509 raft_consensus.cc:2379] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f5d3e05ed34c4b4da2b28b6b6463d0d7 in current term 1: Already voted for candidate 7794a76739bf42cd85a3e7efe2080017 in this term.
I20260808 02:31:17.447698 32665 leader_election.cc:302] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d3e05ed34c4b4da2b28b6b6463d0d7; no voters: 7794a76739bf42cd85a3e7efe2080017, d221c739cf4e4003accb930b90eec9d8
I20260808 02:31:17.448114 617 raft_consensus.cc:2726] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260808 02:31:17.448282 32570 raft_consensus.cc:2454] T be834e57cc294ed7bf5cd09f14f7af9d P d221c739cf4e4003accb930b90eec9d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7794a76739bf42cd85a3e7efe2080017 in term 1.
I20260808 02:31:17.448668 404 leader_election.cc:302] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7794a76739bf42cd85a3e7efe2080017, d221c739cf4e4003accb930b90eec9d8; no voters: f5d3e05ed34c4b4da2b28b6b6463d0d7
I20260808 02:31:17.448999 616 raft_consensus.cc:2781] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:31:17.449482 616 raft_consensus.cc:686] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017 [term 1 LEADER]: Becoming Leader. State: Replica: 7794a76739bf42cd85a3e7efe2080017, State: Running, Role: LEADER
I20260808 02:31:17.449949 616 consensus_queue.cc:237] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d221c739cf4e4003accb930b90eec9d8" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41385 } } peers { permanent_uuid: "f5d3e05ed34c4b4da2b28b6b6463d0d7" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 40127 } } peers { permanent_uuid: "7794a76739bf42cd85a3e7efe2080017" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33887 } }
I20260808 02:31:17.454282 32337 catalog_manager.cc:5495] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7794a76739bf42cd85a3e7efe2080017 (127.24.116.195). New cstate: current_term: 1 leader_uuid: "7794a76739bf42cd85a3e7efe2080017" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d221c739cf4e4003accb930b90eec9d8" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d3e05ed34c4b4da2b28b6b6463d0d7" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 40127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7794a76739bf42cd85a3e7efe2080017" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33887 } health_report { overall_health: HEALTHY } } }
W20260808 02:31:17.456238 576 tablet.cc:2369] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:31:17.471644 608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.469446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48052 (local address 127.24.116.195:33887)
0808 02:31:17.469652 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:17.469661 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:17.469903 (+ 242us) server_negotiation.cc:407] Connection header received
0808 02:31:17.470094 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:17.470098 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:17.470198 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:17.470281 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:17.471116 (+ 835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:17.471120 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:17.471123 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:31:17.471136 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:17.471164 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:31:17.471175 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:17.471272 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:17.471394 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 02:31:17.471438 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 02:31:17.479704 32570 raft_consensus.cc:1261] T be834e57cc294ed7bf5cd09f14f7af9d P d221c739cf4e4003accb930b90eec9d8 [term 1 FOLLOWER]: Refusing update from remote peer 7794a76739bf42cd85a3e7efe2080017: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:31:17.479822 32764 raft_consensus.cc:1261] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7 [term 1 FOLLOWER]: Refusing update from remote peer 7794a76739bf42cd85a3e7efe2080017: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:31:17.480607 623 consensus_queue.cc:1035] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d221c739cf4e4003accb930b90eec9d8" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:31:17.480963 616 consensus_queue.cc:1035] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d3e05ed34c4b4da2b28b6b6463d0d7" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 40127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:31:17.507915 32337 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54218:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:31:17.508225 32337 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54218:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:31:17.512240 32337 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d3264dcce6f64b7aba65a19f7e71a5fe: Sending DeleteTablet for 3 replicas of tablet be834e57cc294ed7bf5cd09f14f7af9d
I20260808 02:31:17.513589 32539 tablet_service.cc:1514] Processing DeleteTablet for tablet be834e57cc294ed7bf5cd09f14f7af9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:17 UTC) from {username='slave'} at 127.0.0.1:52034
I20260808 02:31:17.513620 32740 tablet_service.cc:1514] Processing DeleteTablet for tablet be834e57cc294ed7bf5cd09f14f7af9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:17 UTC) from {username='slave'} at 127.0.0.1:54160
I20260808 02:31:17.514309 478 tablet_service.cc:1514] Processing DeleteTablet for tablet be834e57cc294ed7bf5cd09f14f7af9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:17 UTC) from {username='slave'} at 127.0.0.1:48040
I20260808 02:31:17.514635 644 tablet_replica.cc:330] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7: stopping tablet replica
I20260808 02:31:17.516497 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 32435
I20260808 02:31:17.524528 643 tablet_replica.cc:330] T be834e57cc294ed7bf5cd09f14f7af9d P d221c739cf4e4003accb930b90eec9d8: stopping tablet replica
I20260808 02:31:17.525095 643 raft_consensus.cc:2229] T be834e57cc294ed7bf5cd09f14f7af9d P d221c739cf4e4003accb930b90eec9d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:31:17.515154 644 raft_consensus.cc:2229] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:31:17.525864 644 raft_consensus.cc:2258] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:17.526427 643 raft_consensus.cc:2258] T be834e57cc294ed7bf5cd09f14f7af9d P d221c739cf4e4003accb930b90eec9d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:17.526829 622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.518582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52040 (local address 127.24.116.193:41385)
0808 02:31:17.518816 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:17.518825 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:17.524177 (+ 5352us) server_negotiation.cc:407] Connection header received
0808 02:31:17.524615 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:17.524622 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:17.524726 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:17.524823 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:17.526050 (+ 1227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:17.526056 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:17.526060 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:31:17.526082 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:17.526130 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:31:17.526159 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:17.526244 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:17.526510 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 02:31:17.526576 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 02:31:17.527957 645 tablet_replica.cc:330] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017: stopping tablet replica
I20260808 02:31:17.528265 32631 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:17.528467 645 raft_consensus.cc:2229] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:31:17.529217 645 raft_consensus.cc:2258] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:17.530843 645 ts_tablet_manager.cc:1905] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:17.533529 644 ts_tablet_manager.cc:1905] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:17.538149 645 ts_tablet_manager.cc:1918] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:31:17.538403 645 log.cc:1196] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/be834e57cc294ed7bf5cd09f14f7af9d
I20260808 02:31:17.539212 645 ts_tablet_manager.cc:1939] T be834e57cc294ed7bf5cd09f14f7af9d P 7794a76739bf42cd85a3e7efe2080017: Deleting consensus metadata
I20260808 02:31:17.540654 644 ts_tablet_manager.cc:1918] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:31:17.540907 644 log.cc:1196] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/be834e57cc294ed7bf5cd09f14f7af9d
I20260808 02:31:17.541304 32317 catalog_manager.cc:4841] TS 7794a76739bf42cd85a3e7efe2080017 (127.24.116.195:33887): tablet be834e57cc294ed7bf5cd09f14f7af9d (table test-table [id=417db132c80a40c39a7cbebe0a77d659]) successfully deleted
I20260808 02:31:17.541636 644 ts_tablet_manager.cc:1939] T be834e57cc294ed7bf5cd09f14f7af9d P f5d3e05ed34c4b4da2b28b6b6463d0d7: Deleting consensus metadata
I20260808 02:31:17.543560 32313 catalog_manager.cc:4841] TS f5d3e05ed34c4b4da2b28b6b6463d0d7 (127.24.116.194:40127): tablet be834e57cc294ed7bf5cd09f14f7af9d (table test-table [id=417db132c80a40c39a7cbebe0a77d659]) successfully deleted
I20260808 02:31:17.529546 643 ts_tablet_manager.cc:1905] T be834e57cc294ed7bf5cd09f14f7af9d P d221c739cf4e4003accb930b90eec9d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:17.632781 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 32435
W20260808 02:31:17.665462 32314 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.116.193:41385 (error 108)
I20260808 02:31:17.665632 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 32643
I20260808 02:31:17.667623 604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.667129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:41385 (local address 127.0.0.1:52052)
0808 02:31:17.667319 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:17.667471 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.193:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260808 02:31:17.667851 32314 catalog_manager.cc:4584] TS d221c739cf4e4003accb930b90eec9d8 (127.24.116.193:41385): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet be834e57cc294ed7bf5cd09f14f7af9d: Network error: Client connection negotiation failed: client connection to 127.24.116.193:41385: connect: Connection refused (error 111)
I20260808 02:31:17.668990 606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.666504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54176 (local address 127.24.116.194:40127)
0808 02:31:17.666690 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:17.666696 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:17.666884 (+ 188us) server_negotiation.cc:407] Connection header received
0808 02:31:17.667100 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:17.667106 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:17.667237 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:17.667352 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:17.668366 (+ 1014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:17.668378 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:17.668382 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:31:17.668397 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:17.668427 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:31:17.668438 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:17.668570 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:17.668659 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 02:31:17.668718 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 02:31:17.669591 358 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:17.721603 604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.721116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:41385 (local address 127.0.0.1:52054)
0808 02:31:17.721332 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:17.721443 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.193:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260808 02:31:17.722702 604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.722338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:41385 (local address 127.0.0.1:52062)
0808 02:31:17.722508 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:17.722586 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.193:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260808 02:31:17.783161 604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.782674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:41385 (local address 127.0.0.1:52064)
0808 02:31:17.782905 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:17.783005 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.193:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260808 02:31:17.784406 604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.783965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:41385 (local address 127.0.0.1:52078)
0808 02:31:17.784146 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:17.784220 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.193:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 02:31:17.822363 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 32643
I20260808 02:31:17.852447 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 380
I20260808 02:31:17.855556 608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.853307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48060 (local address 127.24.116.195:33887)
0808 02:31:17.853502 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:17.853508 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:17.853552 (+ 44us) server_negotiation.cc:407] Connection header received
0808 02:31:17.853770 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:17.853776 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:17.853842 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:17.853977 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:17.854911 (+ 934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:17.854917 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:17.854922 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:31:17.854943 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:17.854981 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:31:17.854993 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:17.855130 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:17.855215 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 02:31:17.855280 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 02:31:17.856520 569 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:17.865716 604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.865245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:41385 (local address 127.0.0.1:52090)
0808 02:31:17.865469 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:17.865558 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.193:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260808 02:31:17.866876 604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:17.866461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:41385 (local address 127.0.0.1:52106)
0808 02:31:17.866671 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:17.866738 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.193:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260808 02:31:17.979764 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 380
I20260808 02:31:18.004345 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 32287
I20260808 02:31:18.005615 32387 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:18.114748 604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:18.114187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:41385 (local address 127.0.0.1:52120)
0808 02:31:18.114404 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:18.114512 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.193:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 02:31:18.115208 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 32287
2026-08-08T02:31:18Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2894 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 02:31:18.168887 25043 mini_oidc.cc:152] Starting JWKS server
I20260808 02:31:18.171657 25043 webserver.cc:460] Webserver started at https://127.0.0.1:39609/ using document root <none> and password file <none>
I20260808 02:31:18.171996 25043 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 02:31:18.172749 25043 webserver.cc:460] Webserver started at http://127.0.0.1:35057/ using document root <none> and password file <none>
2026-08-08T02:31:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:31:18Z Disabled control of system clock
I20260808 02:31:18.208637 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:44871
--webserver_interface=127.24.116.254
--webserver_port=0
--builtin_ntp_servers=127.24.116.212:33307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:44871
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39609/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156232048520-25043-0/testchainca.cert with env {}
W20260808 02:31:18.548317 663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:18.548657 663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:18.548812 663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:18.555881 663 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:31:18.556031 663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:18.556103 663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:18.556188 663 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:31:18.556252 663 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 02:31:18.556365 663 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 02:31:18.556434 663 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39609/jwks.json
I20260808 02:31:18.566293 663 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:33307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:44871
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:44871
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39609/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156232048520-25043-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:18.567608 663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:18.568982 663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:18.581015 672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:18.580976 673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:18.581261 675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:18.581979 663 server_base.cc:1034] running on GCE node
I20260808 02:31:18.582746 663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:18.584056 663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:18.585287 663 hybrid_clock.cc:648] HybridClock initialized: now 1786156278585220 us; error 78 us; skew 500 ppm
I20260808 02:31:18.585640 663 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:31:18.592945 663 webserver.cc:460] Webserver started at http://127.24.116.254:44151/ using document root <none> and password file <none>
I20260808 02:31:18.593667 663 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:18.593814 663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:18.594133 663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:18.597075 663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "eeac27741a6e4e1683e56dc386622514"
format_stamp: "Formatted at 2026-08-08 02:31:18 on dist-test-slave-45dx"
server_key: "8c3d24ad434cfedf5d08a0fdf08f1d5a"
server_key_iv: "c0088ad9e1d7734a1c387cd3f7e7576c"
server_key_version: "encryptionkey@0"
I20260808 02:31:18.597880 663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "eeac27741a6e4e1683e56dc386622514"
format_stamp: "Formatted at 2026-08-08 02:31:18 on dist-test-slave-45dx"
server_key: "8c3d24ad434cfedf5d08a0fdf08f1d5a"
server_key_iv: "c0088ad9e1d7734a1c387cd3f7e7576c"
server_key_version: "encryptionkey@0"
I20260808 02:31:18.602869 663 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260808 02:31:18.606215 683 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:18.607457 663 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 02:31:18.607635 663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "eeac27741a6e4e1683e56dc386622514"
format_stamp: "Formatted at 2026-08-08 02:31:18 on dist-test-slave-45dx"
server_key: "8c3d24ad434cfedf5d08a0fdf08f1d5a"
server_key_iv: "c0088ad9e1d7734a1c387cd3f7e7576c"
server_key_version: "encryptionkey@0"
I20260808 02:31:18.607853 663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:18.620234 663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:18.621109 663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:18.621436 663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:18.639654 663 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:44871
I20260808 02:31:18.639667 764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:44871 every 8 connection(s)
I20260808 02:31:18.641132 663 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:31:18.641876 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 663
I20260808 02:31:18.642182 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:31:18.642985 25043 external_mini_cluster.cc:1428] Setting key a6170e876966d4f577228ad7daa53770
I20260808 02:31:18.646248 765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:18.658697 769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:18.645059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51080 (local address 127.24.116.254:44871)
0808 02:31:18.646078 (+ 1019us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:18.646089 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:18.646130 (+ 41us) server_negotiation.cc:407] Connection header received
0808 02:31:18.647771 (+ 1641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:18.647793 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:18.648235 (+ 442us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:18.648713 (+ 478us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:18.649345 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:18.651575 (+ 2230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:18.653819 (+ 2244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:18.654496 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:18.654640 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:18.656089 (+ 1449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:18.656097 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:18.656115 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:31:18.656809 (+ 694us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:18.656887 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:31:18.656908 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:18.657005 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:18.657261 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 02:31:18.657628 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":590,"thread_start_us":355,"threads_started":1}
I20260808 02:31:18.660460 765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eeac27741a6e4e1683e56dc386622514: Bootstrap starting.
I20260808 02:31:18.662809 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:31:18.663964 765 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eeac27741a6e4e1683e56dc386622514: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:18.665148 765 log.cc:824] T 00000000000000000000000000000000 P eeac27741a6e4e1683e56dc386622514: Log is configured to *not* fsync() on all Append() calls
I20260808 02:31:18.668082 765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eeac27741a6e4e1683e56dc386622514: No bootstrap required, opened a new log
I20260808 02:31:18.675670 765 raft_consensus.cc:348] T 00000000000000000000000000000000 P eeac27741a6e4e1683e56dc386622514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eeac27741a6e4e1683e56dc386622514" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 44871 } }
I20260808 02:31:18.676054 765 raft_consensus.cc:374] T 00000000000000000000000000000000 P eeac27741a6e4e1683e56dc386622514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:18.676178 765 raft_consensus.cc:729] T 00000000000000000000000000000000 P eeac27741a6e4e1683e56dc386622514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeac27741a6e4e1683e56dc386622514, State: Initialized, Role: FOLLOWER
I20260808 02:31:18.676776 765 consensus_queue.cc:260] T 00000000000000000000000000000000 P eeac27741a6e4e1683e56dc386622514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eeac27741a6e4e1683e56dc386622514" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 44871 } }
I20260808 02:31:18.677021 765 raft_consensus.cc:388] T 00000000000000000000000000000000 P eeac27741a6e4e1683e56dc386622514 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:31:18.677165 765 raft_consensus.cc:482] T 00000000000000000000000000000000 P eeac27741a6e4e1683e56dc386622514 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:31:18.677342 765 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eeac27741a6e4e1683e56dc386622514 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:18.679731 765 raft_consensus.cc:504] T 00000000000000000000000000000000 P eeac27741a6e4e1683e56dc386622514 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eeac27741a6e4e1683e56dc386622514" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 44871 } }
I20260808 02:31:18.680248 765 leader_election.cc:302] T 00000000000000000000000000000000 P eeac27741a6e4e1683e56dc386622514 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eeac27741a6e4e1683e56dc386622514; no voters:
I20260808 02:31:18.680907 765 leader_election.cc:288] T 00000000000000000000000000000000 P eeac27741a6e4e1683e56dc386622514 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:31:18.681068 771 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eeac27741a6e4e1683e56dc386622514 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:31:18.682686 765 sys_catalog.cc:564] T 00000000000000000000000000000000 P eeac27741a6e4e1683e56dc386622514 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:31:18.684634 771 raft_consensus.cc:686] T 00000000000000000000000000000000 P eeac27741a6e4e1683e56dc386622514 [term 1 LEADER]: Becoming Leader. State: Replica: eeac27741a6e4e1683e56dc386622514, State: Running, Role: LEADER
I20260808 02:31:18.685254 771 consensus_queue.cc:237] T 00000000000000000000000000000000 P eeac27741a6e4e1683e56dc386622514 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eeac27741a6e4e1683e56dc386622514" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 44871 } }
I20260808 02:31:18.688897 773 sys_catalog.cc:455] T 00000000000000000000000000000000 P eeac27741a6e4e1683e56dc386622514 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eeac27741a6e4e1683e56dc386622514. Latest consensus state: current_term: 1 leader_uuid: "eeac27741a6e4e1683e56dc386622514" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eeac27741a6e4e1683e56dc386622514" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 44871 } } }
I20260808 02:31:18.689648 773 sys_catalog.cc:458] T 00000000000000000000000000000000 P eeac27741a6e4e1683e56dc386622514 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:18.688860 772 sys_catalog.cc:455] T 00000000000000000000000000000000 P eeac27741a6e4e1683e56dc386622514 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eeac27741a6e4e1683e56dc386622514" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eeac27741a6e4e1683e56dc386622514" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 44871 } } }
I20260808 02:31:18.690289 772 sys_catalog.cc:458] T 00000000000000000000000000000000 P eeac27741a6e4e1683e56dc386622514 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:18.692000 786 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:31:18.696352 786 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:31:18.704336 786 catalog_manager.cc:1347] Generated new cluster ID: 86f99688fef14af49de5e9c688b6a1ff
I20260808 02:31:18.704457 786 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:31:18.736557 786 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:31:18.738442 786 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:31:18.750644 786 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eeac27741a6e4e1683e56dc386622514: Generated new TSK 0
I20260808 02:31:18.751698 786 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 02:31:18.793855 808 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 02:31:18.794103 808 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 02:31:18.795301 769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:18.771775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51090 (local address 127.24.116.254:44871)
0808 02:31:18.771979 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:18.771986 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:18.772647 (+ 661us) server_negotiation.cc:407] Connection header received
0808 02:31:18.773067 (+ 420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:18.773073 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:18.773162 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:18.773329 (+ 167us) server_negotiation.cc:226] Negotiated authn=JWT
0808 02:31:18.773963 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:18.775176 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:18.776746 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:18.777495 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:18.777632 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:18.778130 (+ 498us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 02:31:18.794562 (+ 16432us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39609/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 02:31:18.794951 (+ 389us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51090: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39609/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":68}
W20260808 02:31:18.795456 769 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51090: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39609/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 02:31:18.797358 807 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:18.771785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:44871 (local address 127.0.0.1:51090)
0808 02:31:18.772537 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:18.772557 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:18.772717 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:18.773388 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:18.773392 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:18.773403 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0808 02:31:18.773790 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:18.773799 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:18.775355 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:18.775361 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:18.776607 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:18.776620 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:18.777669 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:18.777673 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:18.777796 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:18.777853 (+ 57us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 02:31:18.794879 (+ 17026us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39609/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 02:31:18.795155 (+ 276us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.24.116.254:44871: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39609/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":371,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.24.116.254:44871: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39609/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 02:31:18.799129 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 663
I20260808 02:31:18.800449 755 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:18.897934 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 663
2026-08-08T02:31:18Z chronyd exiting
I20260808 02:31:18.957502 25043 test_util.cc:175] -----------------------------------------------
I20260808 02:31:18.957648 25043 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156232048520-25043-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (794 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 02:31:18.961411 25043 mini_oidc.cc:152] Starting JWKS server
I20260808 02:31:18.963282 25043 webserver.cc:460] Webserver started at https://127.0.0.1:35231/ using document root <none> and password file <none>
I20260808 02:31:18.963519 25043 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 02:31:18.964174 25043 webserver.cc:460] Webserver started at http://127.0.0.1:46623/ using document root <none> and password file <none>
2026-08-08T02:31:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:31:18Z Disabled control of system clock
I20260808 02:31:18.999370 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:39353
--webserver_interface=127.24.116.254
--webserver_port=0
--builtin_ntp_servers=127.24.116.212:35975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:39353
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35231/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156232048520-25043-0/testchainca.cert with env {}
W20260808 02:31:19.340127 815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:19.340519 815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:19.340694 815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:19.347993 815 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:31:19.348133 815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:19.348228 815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:19.348351 815 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:31:19.348435 815 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 02:31:19.348531 815 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 02:31:19.348603 815 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35231/jwks.json
I20260808 02:31:19.358505 815 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:35975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:39353
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:39353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35231/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156232048520-25043-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:19.359871 815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:19.361258 815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:19.373415 823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:19.373474 827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:19.373500 824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:19.374351 815 server_base.cc:1034] running on GCE node
I20260808 02:31:19.375221 815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:19.376752 815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:19.378006 815 hybrid_clock.cc:648] HybridClock initialized: now 1786156279377972 us; error 42 us; skew 500 ppm
I20260808 02:31:19.378422 815 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:31:19.381031 815 webserver.cc:460] Webserver started at http://127.24.116.254:41003/ using document root <none> and password file <none>
I20260808 02:31:19.381807 815 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:19.381953 815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:19.382301 815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:19.385347 815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "14473c910ac9434f8f1ef56ed72667b6"
format_stamp: "Formatted at 2026-08-08 02:31:19 on dist-test-slave-45dx"
server_key: "e576d455ab7f0fdfeab88294fbf965fa"
server_key_iv: "6b2739a88a2ce52fa8d2866602c9104a"
server_key_version: "encryptionkey@0"
I20260808 02:31:19.386209 815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "14473c910ac9434f8f1ef56ed72667b6"
format_stamp: "Formatted at 2026-08-08 02:31:19 on dist-test-slave-45dx"
server_key: "e576d455ab7f0fdfeab88294fbf965fa"
server_key_iv: "6b2739a88a2ce52fa8d2866602c9104a"
server_key_version: "encryptionkey@0"
I20260808 02:31:19.391701 815 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 02:31:19.395444 836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:19.396958 815 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:31:19.397167 815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "14473c910ac9434f8f1ef56ed72667b6"
format_stamp: "Formatted at 2026-08-08 02:31:19 on dist-test-slave-45dx"
server_key: "e576d455ab7f0fdfeab88294fbf965fa"
server_key_iv: "6b2739a88a2ce52fa8d2866602c9104a"
server_key_version: "encryptionkey@0"
I20260808 02:31:19.397408 815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:19.422966 815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:19.423902 815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:19.424247 815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:19.444684 815 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:39353
I20260808 02:31:19.444707 915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:39353 every 8 connection(s)
I20260808 02:31:19.446177 815 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:31:19.450124 918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:19.452360 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 815
I20260808 02:31:19.452581 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:31:19.453262 25043 external_mini_cluster.cc:1428] Setting key cf5cfe7f815525f5c092a8bed1d34fd0
I20260808 02:31:19.462132 918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14473c910ac9434f8f1ef56ed72667b6: Bootstrap starting.
I20260808 02:31:19.466029 918 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 14473c910ac9434f8f1ef56ed72667b6: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:19.467149 918 log.cc:824] T 00000000000000000000000000000000 P 14473c910ac9434f8f1ef56ed72667b6: Log is configured to *not* fsync() on all Append() calls
I20260808 02:31:19.467402 922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:19.455347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51374 (local address 127.24.116.254:39353)
0808 02:31:19.456444 (+ 1097us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:19.456454 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:19.456496 (+ 42us) server_negotiation.cc:407] Connection header received
0808 02:31:19.458186 (+ 1690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:19.458210 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:19.458681 (+ 471us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:19.459010 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:19.459636 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:19.461013 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:19.462841 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:19.463493 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:19.463624 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:19.465059 (+ 1435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:19.465066 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:19.465079 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:31:19.465596 (+ 517us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:19.465685 (+ 89us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:31:19.465705 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:19.465790 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:19.466059 (+ 269us) server_negotiation.cc:299] Negotiation successful
0808 02:31:19.466416 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":653,"thread_start_us":404,"threads_started":1}
I20260808 02:31:19.470260 918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14473c910ac9434f8f1ef56ed72667b6: No bootstrap required, opened a new log
I20260808 02:31:19.471238 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:31:19.478633 918 raft_consensus.cc:348] T 00000000000000000000000000000000 P 14473c910ac9434f8f1ef56ed72667b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14473c910ac9434f8f1ef56ed72667b6" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39353 } }
I20260808 02:31:19.479067 918 raft_consensus.cc:374] T 00000000000000000000000000000000 P 14473c910ac9434f8f1ef56ed72667b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:19.479183 918 raft_consensus.cc:729] T 00000000000000000000000000000000 P 14473c910ac9434f8f1ef56ed72667b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14473c910ac9434f8f1ef56ed72667b6, State: Initialized, Role: FOLLOWER
I20260808 02:31:19.479875 918 consensus_queue.cc:260] T 00000000000000000000000000000000 P 14473c910ac9434f8f1ef56ed72667b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14473c910ac9434f8f1ef56ed72667b6" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39353 } }
I20260808 02:31:19.480172 918 raft_consensus.cc:388] T 00000000000000000000000000000000 P 14473c910ac9434f8f1ef56ed72667b6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:31:19.480355 918 raft_consensus.cc:482] T 00000000000000000000000000000000 P 14473c910ac9434f8f1ef56ed72667b6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:31:19.480556 918 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 14473c910ac9434f8f1ef56ed72667b6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:19.482861 918 raft_consensus.cc:504] T 00000000000000000000000000000000 P 14473c910ac9434f8f1ef56ed72667b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14473c910ac9434f8f1ef56ed72667b6" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39353 } }
I20260808 02:31:19.483428 918 leader_election.cc:302] T 00000000000000000000000000000000 P 14473c910ac9434f8f1ef56ed72667b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 14473c910ac9434f8f1ef56ed72667b6; no voters:
I20260808 02:31:19.484062 918 leader_election.cc:288] T 00000000000000000000000000000000 P 14473c910ac9434f8f1ef56ed72667b6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:31:19.484251 925 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 14473c910ac9434f8f1ef56ed72667b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:31:19.485024 925 raft_consensus.cc:686] T 00000000000000000000000000000000 P 14473c910ac9434f8f1ef56ed72667b6 [term 1 LEADER]: Becoming Leader. State: Replica: 14473c910ac9434f8f1ef56ed72667b6, State: Running, Role: LEADER
I20260808 02:31:19.485625 925 consensus_queue.cc:237] T 00000000000000000000000000000000 P 14473c910ac9434f8f1ef56ed72667b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14473c910ac9434f8f1ef56ed72667b6" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39353 } }
I20260808 02:31:19.486363 918 sys_catalog.cc:564] T 00000000000000000000000000000000 P 14473c910ac9434f8f1ef56ed72667b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:31:19.488742 926 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14473c910ac9434f8f1ef56ed72667b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "14473c910ac9434f8f1ef56ed72667b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14473c910ac9434f8f1ef56ed72667b6" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39353 } } }
I20260808 02:31:19.488778 927 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14473c910ac9434f8f1ef56ed72667b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 14473c910ac9434f8f1ef56ed72667b6. Latest consensus state: current_term: 1 leader_uuid: "14473c910ac9434f8f1ef56ed72667b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14473c910ac9434f8f1ef56ed72667b6" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39353 } } }
I20260808 02:31:19.489157 926 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14473c910ac9434f8f1ef56ed72667b6 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:19.489177 927 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14473c910ac9434f8f1ef56ed72667b6 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:19.491415 932 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:31:19.496695 932 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:31:19.505729 932 catalog_manager.cc:1347] Generated new cluster ID: 512768239c1747ca9bb57a26f8c20267
I20260808 02:31:19.505897 932 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:31:19.526345 932 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:31:19.528292 932 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:31:19.538035 932 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 14473c910ac9434f8f1ef56ed72667b6: Generated new TSK 0
I20260808 02:31:19.538924 932 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 02:31:19.576866 956 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 02:31:19.577018 956 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 02:31:19.578403 922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:19.558648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51376 (local address 127.24.116.254:39353)
0808 02:31:19.558848 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:19.558856 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:19.559255 (+ 399us) server_negotiation.cc:407] Connection header received
0808 02:31:19.559536 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:19.559540 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:19.559611 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:19.559777 (+ 166us) server_negotiation.cc:226] Negotiated authn=JWT
0808 02:31:19.560288 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:19.561077 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:19.562516 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:19.562957 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:19.563096 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:19.563593 (+ 497us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 02:31:19.577591 (+ 13998us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35231/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 02:31:19.578069 (+ 478us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51376: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35231/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":56}
W20260808 02:31:19.578559 922 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51376: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35231/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260808 02:31:19.578598 955 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:19.558537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:39353 (local address 127.0.0.1:51376)
0808 02:31:19.559151 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:19.559167 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:19.559330 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:19.559792 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:19.559797 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:19.559810 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0808 02:31:19.560100 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:19.560109 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:19.561223 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:19.561232 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:19.562324 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:19.562336 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:19.563124 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:19.563130 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:19.563292 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:19.563324 (+ 32us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 02:31:19.577878 (+ 14554us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35231/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 02:31:19.578155 (+ 277us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.24.116.254:39353: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35231/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":355,"threads_started":1}
I20260808 02:31:19.580148 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 815
I20260808 02:31:19.581403 906 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:19.677479 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 815
2026-08-08T02:31:19Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (780 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 02:31:19.742573 25043 mini_oidc.cc:152] Starting JWKS server
I20260808 02:31:19.744750 25043 webserver.cc:460] Webserver started at https://127.0.0.1:42137/ using document root <none> and password file <none>
I20260808 02:31:19.745047 25043 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 02:31:19.745735 25043 webserver.cc:460] Webserver started at http://127.0.0.1:40903/ using document root <none> and password file <none>
2026-08-08T02:31:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:31:19Z Disabled control of system clock
I20260808 02:31:19.786163 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:42643
--webserver_interface=127.24.116.254
--webserver_port=0
--builtin_ntp_servers=127.24.116.212:41613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:42643
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42137/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 02:31:20.122298 967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:20.122704 967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:20.122884 967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:20.130373 967 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:31:20.130546 967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:20.130647 967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:20.130766 967 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:31:20.130868 967 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 02:31:20.130970 967 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 02:31:20.131049 967 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42137/jwks.json
I20260808 02:31:20.140403 967 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:41613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:42643
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:42643
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42137/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:20.141845 967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:20.143814 967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:20.156031 978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:20.156127 977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:20.156103 980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:20.157406 967 server_base.cc:1034] running on GCE node
I20260808 02:31:20.158288 967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:20.159699 967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:20.160918 967 hybrid_clock.cc:648] HybridClock initialized: now 1786156280160828 us; error 79 us; skew 500 ppm
I20260808 02:31:20.161278 967 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:31:20.163501 967 webserver.cc:460] Webserver started at http://127.24.116.254:45815/ using document root <none> and password file <none>
I20260808 02:31:20.164197 967 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:20.164350 967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:20.164717 967 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:20.167567 967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "e705d5e0b2d64e5f8136366829433d9f"
format_stamp: "Formatted at 2026-08-08 02:31:20 on dist-test-slave-45dx"
server_key: "675e656a493f35dafec6c2b877f2e90f"
server_key_iv: "fbdb6b64089d7204125d2478885ce1ca"
server_key_version: "encryptionkey@0"
I20260808 02:31:20.168422 967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "e705d5e0b2d64e5f8136366829433d9f"
format_stamp: "Formatted at 2026-08-08 02:31:20 on dist-test-slave-45dx"
server_key: "675e656a493f35dafec6c2b877f2e90f"
server_key_iv: "fbdb6b64089d7204125d2478885ce1ca"
server_key_version: "encryptionkey@0"
I20260808 02:31:20.173597 967 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260808 02:31:20.177124 987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:20.178489 967 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:31:20.178684 967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "e705d5e0b2d64e5f8136366829433d9f"
format_stamp: "Formatted at 2026-08-08 02:31:20 on dist-test-slave-45dx"
server_key: "675e656a493f35dafec6c2b877f2e90f"
server_key_iv: "fbdb6b64089d7204125d2478885ce1ca"
server_key_version: "encryptionkey@0"
I20260808 02:31:20.178910 967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:20.200155 967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:20.201352 967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:20.201736 967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:20.231192 967 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:42643
I20260808 02:31:20.231256 1062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:42643 every 8 connection(s)
I20260808 02:31:20.233254 967 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:31:20.241168 1065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:20.241870 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 967
I20260808 02:31:20.242115 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:31:20.242969 25043 external_mini_cluster.cc:1428] Setting key 4d744f4063151ff0d4ece8925dd8c325
I20260808 02:31:20.254612 1065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e705d5e0b2d64e5f8136366829433d9f: Bootstrap starting.
I20260808 02:31:20.258502 1065 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e705d5e0b2d64e5f8136366829433d9f: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:20.259725 1065 log.cc:824] T 00000000000000000000000000000000 P e705d5e0b2d64e5f8136366829433d9f: Log is configured to *not* fsync() on all Append() calls
I20260808 02:31:20.263736 1069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:20.245629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59922 (local address 127.24.116.254:42643)
0808 02:31:20.247885 (+ 2256us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:20.247911 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:20.247991 (+ 80us) server_negotiation.cc:407] Connection header received
0808 02:31:20.250450 (+ 2459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:20.250478 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:20.250986 (+ 508us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:20.251453 (+ 467us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:20.252094 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:20.254212 (+ 2118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:20.256576 (+ 2364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:20.257608 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:20.257828 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:20.259246 (+ 1418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:20.259262 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:20.259316 (+ 54us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:31:20.260795 (+ 1479us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:20.260909 (+ 114us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:31:20.260940 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:20.261111 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:20.261875 (+ 764us) server_negotiation.cc:299] Negotiation successful
0808 02:31:20.262282 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1448,"thread_start_us":1179,"threads_started":1}
I20260808 02:31:20.264353 1065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e705d5e0b2d64e5f8136366829433d9f: No bootstrap required, opened a new log
I20260808 02:31:20.268608 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:31:20.275440 1065 raft_consensus.cc:348] T 00000000000000000000000000000000 P e705d5e0b2d64e5f8136366829433d9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e705d5e0b2d64e5f8136366829433d9f" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42643 } }
I20260808 02:31:20.275840 1065 raft_consensus.cc:374] T 00000000000000000000000000000000 P e705d5e0b2d64e5f8136366829433d9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:20.275961 1065 raft_consensus.cc:729] T 00000000000000000000000000000000 P e705d5e0b2d64e5f8136366829433d9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e705d5e0b2d64e5f8136366829433d9f, State: Initialized, Role: FOLLOWER
I20260808 02:31:20.276600 1065 consensus_queue.cc:260] T 00000000000000000000000000000000 P e705d5e0b2d64e5f8136366829433d9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e705d5e0b2d64e5f8136366829433d9f" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42643 } }
I20260808 02:31:20.276849 1065 raft_consensus.cc:388] T 00000000000000000000000000000000 P e705d5e0b2d64e5f8136366829433d9f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:31:20.277024 1065 raft_consensus.cc:482] T 00000000000000000000000000000000 P e705d5e0b2d64e5f8136366829433d9f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:31:20.277238 1065 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e705d5e0b2d64e5f8136366829433d9f [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:20.279513 1065 raft_consensus.cc:504] T 00000000000000000000000000000000 P e705d5e0b2d64e5f8136366829433d9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e705d5e0b2d64e5f8136366829433d9f" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42643 } }
I20260808 02:31:20.280130 1065 leader_election.cc:302] T 00000000000000000000000000000000 P e705d5e0b2d64e5f8136366829433d9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e705d5e0b2d64e5f8136366829433d9f; no voters:
I20260808 02:31:20.281576 1065 leader_election.cc:288] T 00000000000000000000000000000000 P e705d5e0b2d64e5f8136366829433d9f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:31:20.281745 1074 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e705d5e0b2d64e5f8136366829433d9f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:31:20.283880 1065 sys_catalog.cc:564] T 00000000000000000000000000000000 P e705d5e0b2d64e5f8136366829433d9f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:31:20.288924 1074 raft_consensus.cc:686] T 00000000000000000000000000000000 P e705d5e0b2d64e5f8136366829433d9f [term 1 LEADER]: Becoming Leader. State: Replica: e705d5e0b2d64e5f8136366829433d9f, State: Running, Role: LEADER
I20260808 02:31:20.289424 1074 consensus_queue.cc:237] T 00000000000000000000000000000000 P e705d5e0b2d64e5f8136366829433d9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e705d5e0b2d64e5f8136366829433d9f" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42643 } }
I20260808 02:31:20.292243 1076 sys_catalog.cc:455] T 00000000000000000000000000000000 P e705d5e0b2d64e5f8136366829433d9f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e705d5e0b2d64e5f8136366829433d9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e705d5e0b2d64e5f8136366829433d9f" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42643 } } }
I20260808 02:31:20.292709 1076 sys_catalog.cc:458] T 00000000000000000000000000000000 P e705d5e0b2d64e5f8136366829433d9f [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:20.292572 1077 sys_catalog.cc:455] T 00000000000000000000000000000000 P e705d5e0b2d64e5f8136366829433d9f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e705d5e0b2d64e5f8136366829433d9f. Latest consensus state: current_term: 1 leader_uuid: "e705d5e0b2d64e5f8136366829433d9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e705d5e0b2d64e5f8136366829433d9f" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42643 } } }
I20260808 02:31:20.292989 1077 sys_catalog.cc:458] T 00000000000000000000000000000000 P e705d5e0b2d64e5f8136366829433d9f [sys.catalog]: This master's current role is: LEADER
W20260808 02:31:20.298532 1092 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e705d5e0b2d64e5f8136366829433d9f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 02:31:20.298642 1092 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 02:31:20.298789 1094 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:31:20.300361 1094 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:31:20.308292 1094 catalog_manager.cc:1347] Generated new cluster ID: bdde71f7beed449bad63e873808e0707
I20260808 02:31:20.308429 1094 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:31:20.319088 1094 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:31:20.320997 1094 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:31:20.329582 1094 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e705d5e0b2d64e5f8136366829433d9f: Generated new TSK 0
I20260808 02:31:20.330461 1094 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:31:20.365028 1069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:20.355556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59930 (local address 127.24.116.254:42643)
0808 02:31:20.355780 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:20.355786 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:20.356134 (+ 348us) server_negotiation.cc:407] Connection header received
0808 02:31:20.356379 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:20.356385 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:20.356481 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:20.356654 (+ 173us) server_negotiation.cc:226] Negotiated authn=JWT
0808 02:31:20.357138 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:20.358340 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:20.359692 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:20.360486 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:20.360585 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:20.361263 (+ 678us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 02:31:20.364130 (+ 2867us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42137/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 02:31:20.364587 (+ 457us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59930: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42137/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":80}
W20260808 02:31:20.365195 1069 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59930: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42137/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260808 02:31:20.365127 1112 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:20.355389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:42643 (local address 127.0.0.1:59930)
0808 02:31:20.356026 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:20.356043 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:20.356165 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:20.356677 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:20.356681 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:20.356690 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0808 02:31:20.356962 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:20.356970 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:20.358491 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:20.358495 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:20.359549 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:20.359560 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:20.360693 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:20.360701 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:20.360905 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:20.360951 (+ 46us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 02:31:20.364411 (+ 3460us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42137/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 02:31:20.364684 (+ 273us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.24.116.254:42643: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42137/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":344,"threads_started":1}
I20260808 02:31:20.367491 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 967
I20260808 02:31:20.368798 1058 generic_service.cc:196] Checking for leaks (request via RPC)
E20260808 02:31:20.379545 1113 webserver.cc:533] Webserver: sslize failed:
E20260808 02:31:20.379637 1113 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 02:31:20.461618 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 967
2026-08-08T02:31:20Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (786 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T02:31:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:31:20Z Disabled control of system clock
I20260808 02:31:20.565253 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:39471
--webserver_interface=127.24.116.254
--webserver_port=0
--builtin_ntp_servers=127.24.116.212:42505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:39471
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156232048520-25043-0/testchainca.cert with env {}
W20260808 02:31:20.906301 1120 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:20.906625 1120 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:20.906816 1120 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:20.914225 1120 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:31:20.914340 1120 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:20.914379 1120 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:20.914465 1120 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:31:20.914541 1120 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 02:31:20.914659 1120 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 02:31:20.914716 1120 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 02:31:20.924894 1120 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:42505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:39471
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:39471
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156232048520-25043-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:20.926366 1120 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:20.927836 1120 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:20.940248 1127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:20.940248 1128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:20.940570 1133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:20.941188 1120 server_base.cc:1034] running on GCE node
I20260808 02:31:20.942020 1120 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:20.943482 1120 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:20.944722 1120 hybrid_clock.cc:648] HybridClock initialized: now 1786156280944689 us; error 63 us; skew 500 ppm
I20260808 02:31:20.945113 1120 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:31:20.947602 1120 webserver.cc:460] Webserver started at http://127.24.116.254:39755/ using document root <none> and password file <none>
I20260808 02:31:20.948426 1120 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:20.948532 1120 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:20.948802 1120 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:20.951748 1120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "1d775d4348c740c0ad767691992d480a"
format_stamp: "Formatted at 2026-08-08 02:31:20 on dist-test-slave-45dx"
server_key: "799a4077f91204be1753de08d9f4d8ab"
server_key_iv: "67cbae47b7f55ac9fba53661633db8f8"
server_key_version: "encryptionkey@0"
I20260808 02:31:20.952602 1120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "1d775d4348c740c0ad767691992d480a"
format_stamp: "Formatted at 2026-08-08 02:31:20 on dist-test-slave-45dx"
server_key: "799a4077f91204be1753de08d9f4d8ab"
server_key_iv: "67cbae47b7f55ac9fba53661633db8f8"
server_key_version: "encryptionkey@0"
I20260808 02:31:20.957986 1120 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 02:31:20.961541 1139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:20.962985 1120 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:31:20.963186 1120 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "1d775d4348c740c0ad767691992d480a"
format_stamp: "Formatted at 2026-08-08 02:31:20 on dist-test-slave-45dx"
server_key: "799a4077f91204be1753de08d9f4d8ab"
server_key_iv: "67cbae47b7f55ac9fba53661633db8f8"
server_key_version: "encryptionkey@0"
I20260808 02:31:20.963420 1120 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:20.980021 1120 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:20.980988 1120 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:20.981297 1120 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:21.000558 1120 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:39471
I20260808 02:31:21.000577 1234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:39471 every 8 connection(s)
I20260808 02:31:21.002017 1120 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:31:21.006060 1235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:21.009413 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 1120
I20260808 02:31:21.009632 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:31:21.010512 25043 external_mini_cluster.cc:1428] Setting key 53b06a5dd3382e943d79f422f3def281
I20260808 02:31:21.019019 1235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d775d4348c740c0ad767691992d480a: Bootstrap starting.
I20260808 02:31:21.022418 1235 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d775d4348c740c0ad767691992d480a: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:21.023674 1235 log.cc:824] T 00000000000000000000000000000000 P 1d775d4348c740c0ad767691992d480a: Log is configured to *not* fsync() on all Append() calls
I20260808 02:31:21.024709 1238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:21.012808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60440 (local address 127.24.116.254:39471)
0808 02:31:21.013827 (+ 1019us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:21.013840 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:21.013883 (+ 43us) server_negotiation.cc:407] Connection header received
0808 02:31:21.015586 (+ 1703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:21.015609 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:21.016111 (+ 502us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:21.016564 (+ 453us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:21.017172 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:21.018393 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:21.019762 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:21.020532 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:21.020744 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:21.022036 (+ 1292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:21.022044 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:21.022058 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:31:21.022656 (+ 598us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:21.022764 (+ 108us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:31:21.022796 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:21.022948 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:21.023169 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 02:31:21.023476 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":340,"threads_started":1}
I20260808 02:31:21.026768 1235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d775d4348c740c0ad767691992d480a: No bootstrap required, opened a new log
I20260808 02:31:21.028776 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:31:21.035295 1235 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d775d4348c740c0ad767691992d480a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d775d4348c740c0ad767691992d480a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39471 } }
I20260808 02:31:21.035728 1235 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d775d4348c740c0ad767691992d480a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:21.035864 1235 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d775d4348c740c0ad767691992d480a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d775d4348c740c0ad767691992d480a, State: Initialized, Role: FOLLOWER
I20260808 02:31:21.036526 1235 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d775d4348c740c0ad767691992d480a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d775d4348c740c0ad767691992d480a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39471 } }
I20260808 02:31:21.036775 1235 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d775d4348c740c0ad767691992d480a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:31:21.036935 1235 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d775d4348c740c0ad767691992d480a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:31:21.037115 1235 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d775d4348c740c0ad767691992d480a [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:21.039378 1235 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d775d4348c740c0ad767691992d480a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d775d4348c740c0ad767691992d480a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39471 } }
I20260808 02:31:21.039893 1235 leader_election.cc:302] T 00000000000000000000000000000000 P 1d775d4348c740c0ad767691992d480a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d775d4348c740c0ad767691992d480a; no voters:
I20260808 02:31:21.040570 1235 leader_election.cc:288] T 00000000000000000000000000000000 P 1d775d4348c740c0ad767691992d480a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:31:21.040700 1240 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d775d4348c740c0ad767691992d480a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:31:21.041495 1240 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d775d4348c740c0ad767691992d480a [term 1 LEADER]: Becoming Leader. State: Replica: 1d775d4348c740c0ad767691992d480a, State: Running, Role: LEADER
I20260808 02:31:21.042090 1240 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d775d4348c740c0ad767691992d480a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d775d4348c740c0ad767691992d480a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39471 } }
I20260808 02:31:21.042825 1235 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d775d4348c740c0ad767691992d480a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:31:21.045193 1241 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d775d4348c740c0ad767691992d480a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d775d4348c740c0ad767691992d480a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d775d4348c740c0ad767691992d480a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39471 } } }
I20260808 02:31:21.046114 1241 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d775d4348c740c0ad767691992d480a [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:21.046730 1242 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d775d4348c740c0ad767691992d480a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d775d4348c740c0ad767691992d480a. Latest consensus state: current_term: 1 leader_uuid: "1d775d4348c740c0ad767691992d480a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d775d4348c740c0ad767691992d480a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39471 } } }
I20260808 02:31:21.048868 1242 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d775d4348c740c0ad767691992d480a [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:21.056666 1253 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:31:21.062589 1253 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:31:21.071161 1253 catalog_manager.cc:1347] Generated new cluster ID: 2ca85f91697c485093df9930f642dbdf
I20260808 02:31:21.071291 1253 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:31:21.085111 1253 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:31:21.087101 1253 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:31:21.096450 1253 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d775d4348c740c0ad767691992d480a: Generated new TSK 0
I20260808 02:31:21.097635 1253 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:31:21.360348 1238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:21.122643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60456 (local address 127.24.116.254:39471)
0808 02:31:21.122906 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:21.122916 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:21.123402 (+ 486us) server_negotiation.cc:407] Connection header received
0808 02:31:21.123658 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:21.123663 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:21.123735 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:21.123883 (+ 148us) server_negotiation.cc:226] Negotiated authn=JWT
0808 02:31:21.124445 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:21.125178 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:21.127346 (+ 2168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:21.127801 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:21.127916 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:21.128550 (+ 634us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 02:31:21.359469 (+230919us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 02:31:21.359958 (+ 489us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60456: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":70}
W20260808 02:31:21.360522 1238 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60456: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 02:31:21.360538 1276 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:21.122618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:39471 (local address 127.0.0.1:60456)
0808 02:31:21.123282 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:21.123304 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:21.123476 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:21.123927 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:21.123933 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:21.123946 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0808 02:31:21.124264 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:21.124276 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:21.125339 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:21.125346 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:21.127186 (+ 1840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:21.127204 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:21.127990 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:21.127997 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:21.128192 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:21.128239 (+ 47us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 02:31:21.359828 (+231589us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 02:31:21.360107 (+ 279us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.24.116.254:39471: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":348,"threads_started":1}
I20260808 02:31:21.361814 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 1120
I20260808 02:31:21.363296 1221 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:21.476884 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 1120
2026-08-08T02:31:21Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (994 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (440 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (443 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:31:22 dist-test-slave-45dx krb5kdc[1301](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:31:22 dist-test-slave-45dx krb5kdc[1301](info): set up 2 sockets
Aug 08 02:31:22 dist-test-slave-45dx krb5kdc[1301](info): commencing operation
krb5kdc: starting...
W20260808 02:31:23.681022 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.007s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:31:23 dist-test-slave-45dx krb5kdc[1301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:31:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:31:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:31:23.943868 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:34567
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:39953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:34567
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:24.284029 1317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:24.284403 1317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:24.284518 1317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:24.291827 1317 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:31:24.291940 1317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:24.291988 1317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:24.292047 1317 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:31:24.292091 1317 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:31:24.302232 1317 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:39953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:34567
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:34567
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:24.303560 1317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:24.304883 1317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:24.316727 1322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:24.316856 1324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:24.316920 1329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:24.317562 1317 server_base.cc:1034] running on GCE node
I20260808 02:31:24.318440 1317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:24.319878 1317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:24.321100 1317 hybrid_clock.cc:648] HybridClock initialized: now 1786156284321053 us; error 38 us; skew 500 ppm
I20260808 02:31:24.321480 1317 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:24 dist-test-slave-45dx krb5kdc[1301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156284, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:24.327723 1317 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:31:24.329201 1317 webserver.cc:460] Webserver started at http://127.24.116.254:42543/ using document root <none> and password file <none>
I20260808 02:31:24.329919 1317 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:24.330057 1317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:24.330407 1317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:24.333407 1317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "fd03873916514623b0911156c9ccae31"
format_stamp: "Formatted at 2026-08-08 02:31:24 on dist-test-slave-45dx"
server_key: "5ee8aff15542f53577d3dea3e73ee822"
server_key_iv: "7c4648ac9406eb47bb461970253be3c4"
server_key_version: "encryptionkey@0"
I20260808 02:31:24.334178 1317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "fd03873916514623b0911156c9ccae31"
format_stamp: "Formatted at 2026-08-08 02:31:24 on dist-test-slave-45dx"
server_key: "5ee8aff15542f53577d3dea3e73ee822"
server_key_iv: "7c4648ac9406eb47bb461970253be3c4"
server_key_version: "encryptionkey@0"
I20260808 02:31:24.339298 1317 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 02:31:24.342953 1341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:24.344441 1317 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:31:24.344623 1317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "fd03873916514623b0911156c9ccae31"
format_stamp: "Formatted at 2026-08-08 02:31:24 on dist-test-slave-45dx"
server_key: "5ee8aff15542f53577d3dea3e73ee822"
server_key_iv: "7c4648ac9406eb47bb461970253be3c4"
server_key_version: "encryptionkey@0"
I20260808 02:31:24.344822 1317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:24.379638 1317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:24.383927 1317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:24.384250 1317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:24.403401 1317 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:34567
I20260808 02:31:24.403435 1426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:34567 every 8 connection(s)
I20260808 02:31:24.404925 1317 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:31:24.408865 1428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:24.411137 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 1317
I20260808 02:31:24.411362 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:31:24.412027 25043 external_mini_cluster.cc:1428] Setting key 74c285db7f68df1f5df9f489cd14c208
I20260808 02:31:24.420955 1428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd03873916514623b0911156c9ccae31: Bootstrap starting.
I20260808 02:31:24.424844 1428 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd03873916514623b0911156c9ccae31: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:24.426198 1428 log.cc:824] T 00000000000000000000000000000000 P fd03873916514623b0911156c9ccae31: Log is configured to *not* fsync() on all Append() calls
Aug 08 02:31:24 dist-test-slave-45dx krb5kdc[1301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:31:24.429503 1428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd03873916514623b0911156c9ccae31: No bootstrap required, opened a new log
I20260808 02:31:24.435628 1433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:24.414110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46662 (local address 127.24.116.254:34567)
0808 02:31:24.414904 (+ 794us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:24.414916 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:24.414957 (+ 41us) server_negotiation.cc:407] Connection header received
0808 02:31:24.416714 (+ 1757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:24.416736 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:24.417112 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:24.417433 (+ 321us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:24.419214 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:24.420566 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:24.422335 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:24.422996 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:24.423130 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:24.428260 (+ 5130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:24.428268 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:24.428282 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:24.428378 (+ 96us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:24.431506 (+ 3128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:24.432299 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:24.432368 (+ 69us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:24.432374 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:24.432539 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:24.432945 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:24.432948 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:24.432950 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:24.433484 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:24.433708 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:24.434150 (+ 442us) server_negotiation.cc:299] Negotiation successful
0808 02:31:24.434556 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":372,"threads_started":1}
I20260808 02:31:24.438886 1428 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd03873916514623b0911156c9ccae31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd03873916514623b0911156c9ccae31" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34567 } }
I20260808 02:31:24.439258 1428 raft_consensus.cc:374] T 00000000000000000000000000000000 P fd03873916514623b0911156c9ccae31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:24.439365 1428 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd03873916514623b0911156c9ccae31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd03873916514623b0911156c9ccae31, State: Initialized, Role: FOLLOWER
I20260808 02:31:24.439954 1428 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd03873916514623b0911156c9ccae31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd03873916514623b0911156c9ccae31" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34567 } }
I20260808 02:31:24.440261 1428 raft_consensus.cc:388] T 00000000000000000000000000000000 P fd03873916514623b0911156c9ccae31 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:31:24.440455 1428 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd03873916514623b0911156c9ccae31 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:31:24.440651 1428 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd03873916514623b0911156c9ccae31 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:24.442808 1428 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd03873916514623b0911156c9ccae31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd03873916514623b0911156c9ccae31" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34567 } }
I20260808 02:31:24.443307 1428 leader_election.cc:302] T 00000000000000000000000000000000 P fd03873916514623b0911156c9ccae31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd03873916514623b0911156c9ccae31; no voters:
I20260808 02:31:24.443872 1428 leader_election.cc:288] T 00000000000000000000000000000000 P fd03873916514623b0911156c9ccae31 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:31:24.444025 1435 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd03873916514623b0911156c9ccae31 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:31:24.444756 1435 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd03873916514623b0911156c9ccae31 [term 1 LEADER]: Becoming Leader. State: Replica: fd03873916514623b0911156c9ccae31, State: Running, Role: LEADER
I20260808 02:31:24.445338 1435 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd03873916514623b0911156c9ccae31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd03873916514623b0911156c9ccae31" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34567 } }
I20260808 02:31:24.445957 1428 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd03873916514623b0911156c9ccae31 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:31:24.448493 1437 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd03873916514623b0911156c9ccae31 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd03873916514623b0911156c9ccae31. Latest consensus state: current_term: 1 leader_uuid: "fd03873916514623b0911156c9ccae31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd03873916514623b0911156c9ccae31" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34567 } } }
I20260808 02:31:24.448946 1437 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd03873916514623b0911156c9ccae31 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:24.448805 1436 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd03873916514623b0911156c9ccae31 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd03873916514623b0911156c9ccae31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd03873916514623b0911156c9ccae31" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34567 } } }
I20260808 02:31:24.449425 1436 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd03873916514623b0911156c9ccae31 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:24.453011 1448 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:31:24.458420 1448 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:31:24.467118 1448 catalog_manager.cc:1347] Generated new cluster ID: 009b1fbd251f4836a78e71592f1aefe3
I20260808 02:31:24.467269 1448 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:31:24.493155 1448 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:31:24.494529 1448 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:31:24.510525 1448 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd03873916514623b0911156c9ccae31: Generated new TSK 0
I20260808 02:31:24.511610 1448 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.116.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
I20260808 02:31:24.584084 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:34567
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:39953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:24.929657 1467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:24.929965 1467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:24.930063 1467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:24.937453 1467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:24.937579 1467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:24.937695 1467 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:31:24.948635 1467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:39953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:34567
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:24.950049 1467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:24.951366 1467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:24.964582 1472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:24.964665 1475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:24.964665 1473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:24.965469 1467 server_base.cc:1034] running on GCE node
I20260808 02:31:24.966078 1467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:24.967083 1467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:24.968291 1467 hybrid_clock.cc:648] HybridClock initialized: now 1786156284968259 us; error 47 us; skew 500 ppm
I20260808 02:31:24.968647 1467 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:24 dist-test-slave-45dx krb5kdc[1301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156284, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:24.971895 1467 init.cc:377] Logged in from keytab as kudu/127.24.116.193@KRBTEST.COM (short username kudu)
I20260808 02:31:24.973407 1467 webserver.cc:460] Webserver started at http://127.24.116.193:46869/ using document root <none> and password file <none>
I20260808 02:31:24.974066 1467 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:24.974170 1467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:24.974439 1467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:24.977356 1467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "e422436da61a49bb9e4dcf21ca88b092"
format_stamp: "Formatted at 2026-08-08 02:31:24 on dist-test-slave-45dx"
server_key: "ced4bd823fc1398536bf42dd41d11484"
server_key_iv: "babfc569ddb6afd8bf40dac9a5408317"
server_key_version: "encryptionkey@0"
I20260808 02:31:24.978091 1467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "e422436da61a49bb9e4dcf21ca88b092"
format_stamp: "Formatted at 2026-08-08 02:31:24 on dist-test-slave-45dx"
server_key: "ced4bd823fc1398536bf42dd41d11484"
server_key_iv: "babfc569ddb6afd8bf40dac9a5408317"
server_key_version: "encryptionkey@0"
I20260808 02:31:24.983191 1467 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 02:31:24.986532 1487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:24.987810 1467 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 02:31:24.987943 1467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "e422436da61a49bb9e4dcf21ca88b092"
format_stamp: "Formatted at 2026-08-08 02:31:24 on dist-test-slave-45dx"
server_key: "ced4bd823fc1398536bf42dd41d11484"
server_key_iv: "babfc569ddb6afd8bf40dac9a5408317"
server_key_version: "encryptionkey@0"
I20260808 02:31:24.988107 1467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:25.013330 1467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:25.017546 1467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:25.017794 1467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:25.018708 1467 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:25.020069 1467 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:25.020150 1467 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:25.020236 1467 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:25.020279 1467 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:25.054520 1467 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:33013
I20260808 02:31:25.054611 1661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:33013 every 8 connection(s)
I20260808 02:31:25.055855 1467 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:31:25.061055 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 1467
I20260808 02:31:25.061269 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:31:25.062011 25043 external_mini_cluster.cc:1428] Setting key e4fe97a815eb13af1c9568f76bfb3eae
Aug 08 02:31:25 dist-test-slave-45dx krb5kdc[1301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156284, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:31:25.077992 1665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:25.058499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:40867 (local address 127.24.116.254:34567)
0808 02:31:25.058993 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:25.059000 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:25.059956 (+ 956us) server_negotiation.cc:407] Connection header received
0808 02:31:25.061957 (+ 2001us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:25.061963 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:25.062062 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:25.062197 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:25.063815 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:25.064706 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:25.067241 (+ 2535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:25.067648 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:25.067748 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:25.072018 (+ 4270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:25.072023 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:25.072026 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:25.072060 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:25.074797 (+ 2737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:25.075552 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:25.075558 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:25.075562 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:25.075692 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:25.076147 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:25.076153 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:25.076157 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:25.076501 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:25.076658 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:25.077362 (+ 704us) server_negotiation.cc:299] Negotiation successful
0808 02:31:25.077604 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":231,"threads_started":1}
I20260808 02:31:25.079010 1666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:25.059080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:34567 (local address 127.24.116.193:40867)
0808 02:31:25.059802 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:25.059839 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:25.061666 (+ 1827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:25.062375 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:25.062383 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:25.063004 (+ 621us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:25.063604 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:25.063650 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:25.064871 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:25.064879 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:25.067097 (+ 2218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:25.067116 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:25.067882 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:25.067892 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:25.068225 (+ 333us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:25.069030 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:25.069065 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:25.071782 (+ 2717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:25.074951 (+ 3169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:25.074960 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:25.074979 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:25.075428 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:25.075809 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:25.075814 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:25.075818 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:25.076029 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:25.076640 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:25.076649 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:25.076997 (+ 348us) client_negotiation.cc:769] Sending connection context
0808 02:31:25.077273 (+ 276us) client_negotiation.cc:240] Negotiation successful
0808 02:31:25.077823 (+ 550us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":292,"threads_started":1}
I20260808 02:31:25.080821 1663 heartbeater.cc:347] Connected to a master server at 127.24.116.254:34567
I20260808 02:31:25.081140 1663 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:25.081887 1663 heartbeater.cc:511] Master 127.24.116.254:34567 requested a full tablet report, sending...
I20260808 02:31:25.084000 1365 ts_manager.cc:194] Registered new tserver with Master: e422436da61a49bb9e4dcf21ca88b092 (127.24.116.193:33013)
I20260808 02:31:25.085525 1365 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.193@KRBTEST.COM'} at 127.24.116.193:40867
WARNING: no policy specified for kudu/127.24.116.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
I20260808 02:31:25.121863 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:34567
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:39953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:25.464537 1669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:25.464905 1669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:25.465085 1669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:25.473054 1669 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:25.473228 1669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:25.473412 1669 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:31:25.483433 1669 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:39953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:34567
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:25.484843 1669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:25.486341 1669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:25.499979 1682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:25.500077 1678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:25.500056 1677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:25.501335 1669 server_base.cc:1034] running on GCE node
I20260808 02:31:25.502020 1669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:25.503002 1669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:25.504251 1669 hybrid_clock.cc:648] HybridClock initialized: now 1786156285504209 us; error 49 us; skew 500 ppm
I20260808 02:31:25.504633 1669 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:25 dist-test-slave-45dx krb5kdc[1301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156285, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:25.507992 1669 init.cc:377] Logged in from keytab as kudu/127.24.116.194@KRBTEST.COM (short username kudu)
I20260808 02:31:25.509680 1669 webserver.cc:460] Webserver started at http://127.24.116.194:35605/ using document root <none> and password file <none>
I20260808 02:31:25.510429 1669 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:25.510583 1669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:25.510914 1669 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:25.514195 1669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "858e4c13d190497d9266a133a0bb3bb0"
format_stamp: "Formatted at 2026-08-08 02:31:25 on dist-test-slave-45dx"
server_key: "2fcb22c8839e006ef8061537175aa386"
server_key_iv: "0d5c0c60828010c4ca6dac15e09bc76b"
server_key_version: "encryptionkey@0"
I20260808 02:31:25.515027 1669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "858e4c13d190497d9266a133a0bb3bb0"
format_stamp: "Formatted at 2026-08-08 02:31:25 on dist-test-slave-45dx"
server_key: "2fcb22c8839e006ef8061537175aa386"
server_key_iv: "0d5c0c60828010c4ca6dac15e09bc76b"
server_key_version: "encryptionkey@0"
I20260808 02:31:25.520299 1669 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 02:31:25.523798 1692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:25.525146 1669 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:31:25.525329 1669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "858e4c13d190497d9266a133a0bb3bb0"
format_stamp: "Formatted at 2026-08-08 02:31:25 on dist-test-slave-45dx"
server_key: "2fcb22c8839e006ef8061537175aa386"
server_key_iv: "0d5c0c60828010c4ca6dac15e09bc76b"
server_key_version: "encryptionkey@0"
I20260808 02:31:25.525545 1669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:25.550318 1669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:25.554683 1669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:25.554975 1669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:25.555933 1669 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:25.557392 1669 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:25.557507 1669 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:25.557657 1669 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:25.557732 1669 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:25.590590 1669 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:41133
I20260808 02:31:25.590646 1857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:41133 every 8 connection(s)
I20260808 02:31:25.591856 1669 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:31:25.598013 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 1669
I20260808 02:31:25.598201 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:31:25.598662 25043 external_mini_cluster.cc:1428] Setting key 05e108e2a9b42a44d22c3f1d3d7089ac
Aug 08 02:31:25 dist-test-slave-45dx krb5kdc[1301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156285, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:31:25.614104 1861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:25.594485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:34905 (local address 127.24.116.254:34567)
0808 02:31:25.594941 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:25.594945 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:25.595920 (+ 975us) server_negotiation.cc:407] Connection header received
0808 02:31:25.597858 (+ 1938us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:25.597864 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:25.597959 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:25.598081 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:25.599837 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:25.600816 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:25.602367 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:25.603147 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:25.603293 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:25.607193 (+ 3900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:25.607202 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:25.607210 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:25.607254 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:25.610848 (+ 3594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:25.611774 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:25.611778 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:25.611780 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:25.611904 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:25.612428 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:25.612432 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:25.612435 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:25.612684 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:25.612795 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:25.613656 (+ 861us) server_negotiation.cc:299] Negotiation successful
0808 02:31:25.613820 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":222,"threads_started":1}
I20260808 02:31:25.615649 1865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:25.595055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:34567 (local address 127.24.116.194:34905)
0808 02:31:25.595747 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:25.595785 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:25.597575 (+ 1790us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:25.598366 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:25.598375 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:25.598948 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:25.599665 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:25.599692 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:25.600977 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:25.600982 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:25.602212 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:25.602228 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:25.603353 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:25.603358 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:25.603551 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:25.604265 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:25.604287 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:25.606953 (+ 2666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:25.610990 (+ 4037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:25.611001 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:25.611021 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:25.611663 (+ 642us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:25.612031 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:25.612038 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:25.612042 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:25.612297 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:25.612813 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:25.612824 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:25.613269 (+ 445us) client_negotiation.cc:769] Sending connection context
0808 02:31:25.613577 (+ 308us) client_negotiation.cc:240] Negotiation successful
0808 02:31:25.614159 (+ 582us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":290,"threads_started":1}
I20260808 02:31:25.617215 1859 heartbeater.cc:347] Connected to a master server at 127.24.116.254:34567
I20260808 02:31:25.617537 1859 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:25.618257 1859 heartbeater.cc:511] Master 127.24.116.254:34567 requested a full tablet report, sending...
I20260808 02:31:25.619771 1365 ts_manager.cc:194] Registered new tserver with Master: 858e4c13d190497d9266a133a0bb3bb0 (127.24.116.194:41133)
I20260808 02:31:25.621116 1365 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.194@KRBTEST.COM'} at 127.24.116.194:34905
WARNING: no policy specified for kudu/127.24.116.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
I20260808 02:31:25.659439 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:34567
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:39953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:26.001948 1869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:26.002238 1869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:26.002332 1869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:26.009960 1869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:26.010087 1869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:26.010205 1869 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:31:26.020154 1869 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:39953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:34567
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:26.021471 1869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:26.022773 1869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:26.036545 1874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:26.036469 1877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:26.036504 1879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:26.037056 1869 server_base.cc:1034] running on GCE node
I20260808 02:31:26.037771 1869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:26.038712 1869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:26.039942 1869 hybrid_clock.cc:648] HybridClock initialized: now 1786156286039886 us; error 64 us; skew 500 ppm
I20260808 02:31:26.040263 1869 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:26 dist-test-slave-45dx krb5kdc[1301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156286, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:26.043334 1869 init.cc:377] Logged in from keytab as kudu/127.24.116.195@KRBTEST.COM (short username kudu)
I20260808 02:31:26.044842 1869 webserver.cc:460] Webserver started at http://127.24.116.195:43887/ using document root <none> and password file <none>
I20260808 02:31:26.045594 1869 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:26.045742 1869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:26.046074 1869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:26.049182 1869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "cfb7ae36f01c4d6088e6a373ab229a70"
format_stamp: "Formatted at 2026-08-08 02:31:26 on dist-test-slave-45dx"
server_key: "e808dd1d0508dba357f940b9e37694eb"
server_key_iv: "ebc8b0a785ef23f50c6c5b9036f15bf9"
server_key_version: "encryptionkey@0"
I20260808 02:31:26.050019 1869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "cfb7ae36f01c4d6088e6a373ab229a70"
format_stamp: "Formatted at 2026-08-08 02:31:26 on dist-test-slave-45dx"
server_key: "e808dd1d0508dba357f940b9e37694eb"
server_key_iv: "ebc8b0a785ef23f50c6c5b9036f15bf9"
server_key_version: "encryptionkey@0"
I20260808 02:31:26.055837 1869 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 02:31:26.060253 1890 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:26.061571 1869 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:31:26.061699 1869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "cfb7ae36f01c4d6088e6a373ab229a70"
format_stamp: "Formatted at 2026-08-08 02:31:26 on dist-test-slave-45dx"
server_key: "e808dd1d0508dba357f940b9e37694eb"
server_key_iv: "ebc8b0a785ef23f50c6c5b9036f15bf9"
server_key_version: "encryptionkey@0"
I20260808 02:31:26.061902 1869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:26.083021 1869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:26.087178 1869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:26.087450 1869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:26.088554 1869 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:26.088519 1663 heartbeater.cc:503] Master 127.24.116.254:34567 was elected leader, sending a full tablet report...
I20260808 02:31:26.090132 1869 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:26.090250 1869 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:26.090404 1869 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:26.090493 1869 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:26.124826 1869 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:42071
I20260808 02:31:26.124918 2064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:42071 every 8 connection(s)
I20260808 02:31:26.126142 1869 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:31:26.135959 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 1869
I20260808 02:31:26.136137 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:31:26.136667 25043 external_mini_cluster.cc:1428] Setting key c222f7372f22f1897dd36a93c95cbec1
Aug 08 02:31:26 dist-test-slave-45dx krb5kdc[1301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156286, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:31:26.146072 2069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:26.128866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:37099 (local address 127.24.116.254:34567)
0808 02:31:26.129462 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:26.129472 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:26.130313 (+ 841us) server_negotiation.cc:407] Connection header received
0808 02:31:26.132158 (+ 1845us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:26.132163 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:26.132247 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:26.132419 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:26.133885 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:26.134648 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:26.136205 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:26.136704 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:26.136851 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:26.140777 (+ 3926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:26.140782 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:26.140786 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:26.140816 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:26.143310 (+ 2494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:26.143987 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:26.143991 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:26.143993 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:26.144114 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:26.144546 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:26.144549 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:26.144551 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:26.144805 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:26.144915 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:26.145556 (+ 641us) server_negotiation.cc:299] Negotiation successful
0808 02:31:26.145718 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":257,"threads_started":1}
I20260808 02:31:26.147084 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:26.129301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:34567 (local address 127.24.116.195:37099)
0808 02:31:26.130158 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:26.130204 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:26.131892 (+ 1688us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:26.132650 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:26.132657 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:26.133168 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:26.133710 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:26.133726 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:26.134812 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:26.134816 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:26.136013 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:26.136052 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:26.136951 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:26.136958 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:26.137191 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:26.138026 (+ 835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:26.138063 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:26.140597 (+ 2534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:26.143441 (+ 2844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:26.143448 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:26.143460 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:26.143879 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:26.144208 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:26.144211 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:26.144213 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:26.144450 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:26.144911 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:26.144917 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:26.145233 (+ 316us) client_negotiation.cc:769] Sending connection context
0808 02:31:26.145481 (+ 248us) client_negotiation.cc:240] Negotiation successful
0808 02:31:26.145930 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":290,"threads_started":1}
I20260808 02:31:26.148561 2066 heartbeater.cc:347] Connected to a master server at 127.24.116.254:34567
I20260808 02:31:26.148877 2066 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:26.149585 2066 heartbeater.cc:511] Master 127.24.116.254:34567 requested a full tablet report, sending...
I20260808 02:31:26.151206 1365 ts_manager.cc:194] Registered new tserver with Master: cfb7ae36f01c4d6088e6a373ab229a70 (127.24.116.195:42071)
I20260808 02:31:26.152061 1365 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.195@KRBTEST.COM'} at 127.24.116.195:37099
I20260808 02:31:26.152245 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/test-admin.keytab.
Aug 08 02:31:26 dist-test-slave-45dx krb5kdc[1301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:26.186733 25043 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 02:31:26.192323 2076 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:26.189717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44466 (local address 127.24.116.193:33013)
0808 02:31:26.190329 (+ 612us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:26.190336 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:26.190363 (+ 27us) server_negotiation.cc:407] Connection header received
0808 02:31:26.190431 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:26.190437 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:26.190631 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:26.190797 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:26.191898 (+ 1101us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44466: BlockingRecv error: recv got EOF from 127.0.0.1:44466 (error 108)
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":323,"threads_started":1}
W20260808 02:31:26.192902 25043 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/krb5cc' of type FILE
Aug 08 02:31:26 dist-test-slave-45dx krb5kdc[1301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:26.194789 25043 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 02:31:26 dist-test-slave-45dx krb5kdc[1301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:26.196174 25043 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 02:31:26 dist-test-slave-45dx krb5kdc[1301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.193@KRBTEST.COM
I20260808 02:31:26.212085 2076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:26.198071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44468 (local address 127.24.116.193:33013)
0808 02:31:26.198280 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:26.198287 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:26.198458 (+ 171us) server_negotiation.cc:407] Connection header received
0808 02:31:26.198605 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:26.198609 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:26.198672 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:26.198756 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:26.199708 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:26.200759 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:26.201970 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:26.202528 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:26.202629 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:26.206517 (+ 3888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:26.206529 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:26.206544 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:26.206583 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:26.209295 (+ 2712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:26.209975 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:26.209987 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:26.209989 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:26.210113 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:26.210485 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:26.210490 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:26.210496 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:26.210857 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:26.211184 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:26.211522 (+ 338us) server_negotiation.cc:299] Negotiation successful
0808 02:31:26.211778 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
W20260808 02:31:26.217998 2076 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:26.216210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44476 (local address 127.24.116.193:33013)
0808 02:31:26.216471 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:26.216476 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:26.216639 (+ 163us) server_negotiation.cc:407] Connection header received
0808 02:31:26.216821 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:26.216826 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:26.216897 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:26.217001 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:26.217743 (+ 742us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44476: BlockingRecv error: recv got EOF from 127.0.0.1:44476 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260808 02:31:26.218218 25043 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/krb5cc' of type FILE
Aug 08 02:31:26 dist-test-slave-45dx krb5kdc[1301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:26.219803 25043 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 02:31:26 dist-test-slave-45dx krb5kdc[1301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:26.221153 25043 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 02:31:26 dist-test-slave-45dx krb5kdc[1301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.193@KRBTEST.COM
I20260808 02:31:26.235318 2076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:26.222439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44482 (local address 127.24.116.193:33013)
0808 02:31:26.222663 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:26.222671 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:26.222948 (+ 277us) server_negotiation.cc:407] Connection header received
0808 02:31:26.223115 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:26.223121 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:26.223194 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:26.223297 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:26.224255 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:26.225015 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:26.226239 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:26.226683 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:26.226840 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:26.230602 (+ 3762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:26.230607 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:26.230610 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:26.230641 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:26.233206 (+ 2565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:26.233794 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:26.233798 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:26.233800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:26.233918 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:26.234251 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:26.234255 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:26.234257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:26.234509 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:26.234705 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:26.234940 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 02:31:26.235097 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260808 02:31:26.239864 2076 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:26.238234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44488 (local address 127.24.116.193:33013)
0808 02:31:26.238471 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:26.238477 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:26.238710 (+ 233us) server_negotiation.cc:407] Connection header received
0808 02:31:26.238821 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:26.238824 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:26.238889 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:26.238967 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:26.239643 (+ 676us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44488: BlockingRecv error: recv got EOF from 127.0.0.1:44488 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260808 02:31:26.240528 25043 init.cc:244] Error while opening credential cache '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/krb5cc' of type FILE: Runtime error: Bad format in credentials cache (filename: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156232048520-25043-0/krb5kdc/krb5cc)
Aug 08 02:31:26 dist-test-slave-45dx krb5kdc[1301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:26.242164 25043 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 02:31:26 dist-test-slave-45dx krb5kdc[1301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:26.243458 25043 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 02:31:26 dist-test-slave-45dx krb5kdc[1301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.193@KRBTEST.COM
I20260808 02:31:26.257694 2076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:26.244789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44498 (local address 127.24.116.193:33013)
0808 02:31:26.245003 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:26.245012 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:26.245316 (+ 304us) server_negotiation.cc:407] Connection header received
0808 02:31:26.245460 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:26.245464 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:26.245520 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:26.245598 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:26.246734 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:26.247579 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:26.248889 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:26.249312 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:26.249403 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:26.252983 (+ 3580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:26.252987 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:26.252990 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:26.253021 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:26.255416 (+ 2395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:26.255983 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:26.255986 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:26.255989 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:26.256134 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:26.256520 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:26.256523 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:26.256525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:26.256774 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:26.257011 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:26.257175 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 02:31:26.257367 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 02:31:26.259215 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 1467
I20260808 02:31:26.272564 2076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:26.259869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44502 (local address 127.24.116.193:33013)
0808 02:31:26.260058 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:26.260067 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:26.260427 (+ 360us) server_negotiation.cc:407] Connection header received
0808 02:31:26.260542 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:26.260546 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:26.260599 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:26.260674 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:26.261648 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:26.262322 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:26.263507 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:26.263922 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:26.264053 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:26.266318 (+ 2265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:26.266323 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:26.266326 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:26.266355 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:26.269586 (+ 3231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:26.270268 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:26.270274 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:26.270277 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:26.270441 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:26.270869 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:26.270875 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:26.270878 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:26.271250 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:26.271524 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:26.271912 (+ 388us) server_negotiation.cc:299] Negotiation successful
0808 02:31:26.272153 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 02:31:26.273172 1654 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:26.359149 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 1467
I20260808 02:31:26.384788 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 1669
Aug 08 02:31:26 dist-test-slave-45dx krb5kdc[1301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.194@KRBTEST.COM
I20260808 02:31:26.400394 2102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:26.385693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57030 (local address 127.24.116.194:41133)
0808 02:31:26.386321 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:26.386328 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:26.386355 (+ 27us) server_negotiation.cc:407] Connection header received
0808 02:31:26.386416 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:26.386422 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:26.386644 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:26.386773 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:26.387721 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:26.388844 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:26.390062 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:26.390716 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:26.390823 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:26.394918 (+ 4095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:26.394930 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:26.394945 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:26.394978 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:26.397854 (+ 2876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:26.398507 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:26.398514 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:26.398516 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:26.398631 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:26.398981 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:26.398984 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:26.398986 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:26.399347 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:26.399590 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:26.399829 (+ 239us) server_negotiation.cc:299] Negotiation successful
0808 02:31:26.400043 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":305,"threads_started":1}
I20260808 02:31:26.401697 1849 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:26.485347 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 1669
I20260808 02:31:26.507515 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 1869
Aug 08 02:31:26 dist-test-slave-45dx krb5kdc[1301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.195@KRBTEST.COM
I20260808 02:31:26.524511 2104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:26.508781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60542 (local address 127.24.116.195:42071)
0808 02:31:26.509453 (+ 672us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:26.509459 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:26.509491 (+ 32us) server_negotiation.cc:407] Connection header received
0808 02:31:26.509552 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:26.509558 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:26.509771 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:26.509971 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:26.511205 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:26.512485 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:26.513793 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:26.514373 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:26.514520 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:26.518751 (+ 4231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:26.518763 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:26.518779 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:26.518820 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:26.521574 (+ 2754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:26.522337 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:26.522344 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:26.522346 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:26.522483 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:26.522882 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:26.522887 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:26.522890 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:26.523243 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:26.523571 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:26.523850 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 02:31:26.524120 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":349,"threads_started":1}
I20260808 02:31:26.525852 2059 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:26.609859 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 1869
I20260808 02:31:26.634114 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 1317
I20260808 02:31:26.635330 1420 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:26.742380 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 1317
2026-08-08T02:31:26Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4388 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:31:26 dist-test-slave-45dx krb5kdc[2113](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:31:26 dist-test-slave-45dx krb5kdc[2113](info): set up 2 sockets
Aug 08 02:31:26 dist-test-slave-45dx krb5kdc[2113](info): commencing operation
krb5kdc: starting...
W20260808 02:31:28.073491 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.277s user 0.003s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:31:28 dist-test-slave-45dx krb5kdc[2113](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:31:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:31:28Z Disabled control of system clock
WARNING: no policy specified for oryx/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.254.keytab.
Entry for principal oryx/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.254.keytab.
I20260808 02:31:28.343834 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:33319
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.254.keytab
--principal=oryx/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:45137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:33319
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:28.686388 2130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:28.686746 2130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:28.686939 2130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:28.695573 2130 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:31:28.695724 2130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:28.695835 2130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:28.695945 2130 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:31:28.696029 2130 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:31:28.706159 2130 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:45137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:33319
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.254.keytab
--principal=oryx/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:33319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:28.707501 2130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:28.708902 2130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:28.721061 2138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:28.721149 2142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:28.721082 2140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:28.722002 2130 server_base.cc:1034] running on GCE node
I20260808 02:31:28.722903 2130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:28.724411 2130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:28.725652 2130 hybrid_clock.cc:648] HybridClock initialized: now 1786156288725599 us; error 53 us; skew 500 ppm
I20260808 02:31:28.726013 2130 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:28 dist-test-slave-45dx krb5kdc[2113](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156288, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:28.729146 2130 init.cc:377] Logged in from keytab as oryx/127.24.116.254@KRBTEST.COM (short username oryx)
I20260808 02:31:28.730829 2130 webserver.cc:460] Webserver started at http://127.24.116.254:43459/ using document root <none> and password file <none>
I20260808 02:31:28.731568 2130 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:28.731721 2130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:28.732059 2130 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:28.735196 2130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "1411d8b83e714c8d9b40fa837fc7c233"
format_stamp: "Formatted at 2026-08-08 02:31:28 on dist-test-slave-45dx"
server_key: "20d6d1385c7c846b71715ad582a8655f"
server_key_iv: "9abb046027bef22bcb5b6fd0bf55672c"
server_key_version: "encryptionkey@0"
I20260808 02:31:28.736013 2130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "1411d8b83e714c8d9b40fa837fc7c233"
format_stamp: "Formatted at 2026-08-08 02:31:28 on dist-test-slave-45dx"
server_key: "20d6d1385c7c846b71715ad582a8655f"
server_key_iv: "9abb046027bef22bcb5b6fd0bf55672c"
server_key_version: "encryptionkey@0"
I20260808 02:31:28.741564 2130 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 02:31:28.745038 2157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:28.746338 2130 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:31:28.746552 2130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "1411d8b83e714c8d9b40fa837fc7c233"
format_stamp: "Formatted at 2026-08-08 02:31:28 on dist-test-slave-45dx"
server_key: "20d6d1385c7c846b71715ad582a8655f"
server_key_iv: "9abb046027bef22bcb5b6fd0bf55672c"
server_key_version: "encryptionkey@0"
I20260808 02:31:28.746760 2130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:28.764962 2130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:28.768891 2130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:28.769181 2130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:28.787990 2130 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:33319
I20260808 02:31:28.788033 2242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:33319 every 8 connection(s)
I20260808 02:31:28.789433 2130 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:31:28.791260 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 2130
I20260808 02:31:28.791497 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:31:28.792184 25043 external_mini_cluster.cc:1428] Setting key 0afcfb127656ae415b5b70ffa8824f75
I20260808 02:31:28.793682 2243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 02:31:28 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM
I20260808 02:31:28.807884 2243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233: Bootstrap starting.
I20260808 02:31:28.812459 2243 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:28.813777 2243 log.cc:824] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233: Log is configured to *not* fsync() on all Append() calls
I20260808 02:31:28.817319 2243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233: No bootstrap required, opened a new log
I20260808 02:31:28.817410 2246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:28.794251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50428 (local address 127.24.116.254:33319)
0808 02:31:28.795072 (+ 821us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:28.795087 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:28.795137 (+ 50us) server_negotiation.cc:407] Connection header received
0808 02:31:28.797170 (+ 2033us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:28.797200 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:28.797705 (+ 505us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:28.798140 (+ 435us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:28.799555 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:28.801704 (+ 2149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:28.802908 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:28.803986 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:28.804191 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:28.808419 (+ 4228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:28.808430 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:28.808451 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:28.808493 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:28.812767 (+ 4274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:28.813469 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:28.813480 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:28.813490 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:28.813725 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:28.814144 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:28.814149 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:28.814152 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:28.814856 (+ 704us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:28.815103 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:28.815628 (+ 525us) server_negotiation.cc:299] Negotiation successful
0808 02:31:28.816058 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":559,"thread_start_us":330,"threads_started":1}
I20260808 02:31:28.825973 2243 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } }
I20260808 02:31:28.826327 2243 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:28.826406 2243 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1411d8b83e714c8d9b40fa837fc7c233, State: Initialized, Role: FOLLOWER
I20260808 02:31:28.826881 2243 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } }
I20260808 02:31:28.827090 2243 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:31:28.827186 2243 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:31:28.827316 2243 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:28.829519 2243 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } }
I20260808 02:31:28.829968 2243 leader_election.cc:302] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1411d8b83e714c8d9b40fa837fc7c233; no voters:
I20260808 02:31:28.830482 2243 leader_election.cc:288] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:31:28.830636 2250 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:31:28.831445 2250 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [term 1 LEADER]: Becoming Leader. State: Replica: 1411d8b83e714c8d9b40fa837fc7c233, State: Running, Role: LEADER
I20260808 02:31:28.832046 2250 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } }
I20260808 02:31:28.832870 2243 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:31:28.835179 2251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1411d8b83e714c8d9b40fa837fc7c233" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } }
I20260808 02:31:28.835204 2252 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1411d8b83e714c8d9b40fa837fc7c233. Latest consensus state: current_term: 1 leader_uuid: "1411d8b83e714c8d9b40fa837fc7c233" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } }
I20260808 02:31:28.835629 2252 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:28.836643 2251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:28.838485 2257 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:31:28.844013 2257 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:31:28.852726 2257 catalog_manager.cc:1347] Generated new cluster ID: afa59ea266074dd092f572db28a4a4ea
I20260808 02:31:28.852849 2257 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:31:28.866321 2257 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:31:28.867825 2257 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:31:28.877424 2257 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233: Generated new TSK 0
I20260808 02:31:28.878247 2257 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.24.116.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.116.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.116.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.193.keytab.
Entry for principal oryx/127.24.116.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.193.keytab.
I20260808 02:31:28.952382 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:33319
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.193.keytab
--principal=oryx/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:45137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:29.301349 2280 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:29.301657 2280 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:29.301776 2280 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:29.308920 2280 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:29.309080 2280 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:29.309258 2280 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:31:29.319595 2280 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:45137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.193.keytab
--principal=oryx/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:33319
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:29.320961 2280 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:29.322286 2280 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:29.336022 2295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:29.336086 2290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:29.336054 2289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:29.336952 2280 server_base.cc:1034] running on GCE node
I20260808 02:31:29.337724 2280 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:29.338845 2280 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:29.340083 2280 hybrid_clock.cc:648] HybridClock initialized: now 1786156289340036 us; error 38 us; skew 500 ppm
I20260808 02:31:29.340492 2280 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:29 dist-test-slave-45dx krb5kdc[2113](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156289, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:29.348717 2280 init.cc:377] Logged in from keytab as oryx/127.24.116.193@KRBTEST.COM (short username oryx)
I20260808 02:31:29.350418 2280 webserver.cc:460] Webserver started at http://127.24.116.193:41291/ using document root <none> and password file <none>
I20260808 02:31:29.351194 2280 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:29.351356 2280 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:29.351712 2280 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:29.354811 2280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e"
format_stamp: "Formatted at 2026-08-08 02:31:29 on dist-test-slave-45dx"
server_key: "e7cb3ddd1aa76d647b4e5ca73ee5a979"
server_key_iv: "33c5b38a939a053fd65983db8742053d"
server_key_version: "encryptionkey@0"
I20260808 02:31:29.355629 2280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e"
format_stamp: "Formatted at 2026-08-08 02:31:29 on dist-test-slave-45dx"
server_key: "e7cb3ddd1aa76d647b4e5ca73ee5a979"
server_key_iv: "33c5b38a939a053fd65983db8742053d"
server_key_version: "encryptionkey@0"
I20260808 02:31:29.360980 2280 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260808 02:31:29.364660 2304 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:29.366060 2280 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 02:31:29.366245 2280 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e"
format_stamp: "Formatted at 2026-08-08 02:31:29 on dist-test-slave-45dx"
server_key: "e7cb3ddd1aa76d647b4e5ca73ee5a979"
server_key_iv: "33c5b38a939a053fd65983db8742053d"
server_key_version: "encryptionkey@0"
I20260808 02:31:29.366451 2280 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:29.386442 2280 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:29.390635 2280 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:29.390946 2280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:29.391945 2280 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:29.393380 2280 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:29.393487 2280 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:29.393648 2280 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:29.393724 2280 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:29.428848 2280 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:35417
I20260808 02:31:29.428890 2486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:35417 every 8 connection(s)
I20260808 02:31:29.430233 2280 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:31:29.431725 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 2280
I20260808 02:31:29.431958 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:31:29.432921 25043 external_mini_cluster.cc:1428] Setting key cde117f7308d474e5164768d14cf8353
Aug 08 02:31:29 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156289, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM
I20260808 02:31:29.453722 2490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:29.433129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:36741 (local address 127.24.116.254:33319)
0808 02:31:29.434381 (+ 1252us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:29.434388 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:29.435050 (+ 662us) server_negotiation.cc:407] Connection header received
0808 02:31:29.436991 (+ 1941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:29.436999 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:29.437093 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:29.437216 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:29.438880 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:29.440042 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:29.441622 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:29.442370 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:29.442522 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:29.446329 (+ 3807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:29.446335 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:29.446338 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:29.446372 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:29.449940 (+ 3568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:29.450843 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:29.450852 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:29.450858 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:29.451022 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:29.451556 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:29.451564 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:29.451571 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:29.452002 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:29.452152 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:29.452935 (+ 783us) server_negotiation.cc:299] Negotiation successful
0808 02:31:29.453209 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1099,"thread_start_us":942,"threads_started":1}
I20260808 02:31:29.454330 2491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:29.433717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.24.116.193:36741)
0808 02:31:29.434869 (+ 1152us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:29.434916 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:29.436708 (+ 1792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:29.437426 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:29.437434 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:29.438068 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:29.438703 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:29.438721 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:29.440225 (+ 1504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:29.440229 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:29.441465 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:29.441478 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:29.442627 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:29.442632 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:29.442825 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:29.443556 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:29.443583 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:29.446095 (+ 2512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:29.450144 (+ 4049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:29.450152 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:29.450165 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:29.450715 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:29.451134 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:29.451137 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:29.451139 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:29.451397 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:29.452132 (+ 735us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:29.452138 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:29.452529 (+ 391us) client_negotiation.cc:769] Sending connection context
0808 02:31:29.452765 (+ 236us) client_negotiation.cc:240] Negotiation successful
0808 02:31:29.453195 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":863,"thread_start_us":590,"threads_started":1}
I20260808 02:31:29.455971 2488 heartbeater.cc:347] Connected to a master server at 127.24.116.254:33319
I20260808 02:31:29.456279 2488 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:29.457073 2488 heartbeater.cc:511] Master 127.24.116.254:33319 requested a full tablet report, sending...
I20260808 02:31:29.459256 2182 ts_manager.cc:194] Registered new tserver with Master: 5ae9c4be9bb94fecaf86e3c0c4311f1e (127.24.116.193:35417)
I20260808 02:31:29.460785 2182 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.116.193@KRBTEST.COM'} at 127.24.116.193:36741
WARNING: no policy specified for oryx/127.24.116.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.116.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.116.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.194.keytab.
Entry for principal oryx/127.24.116.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.194.keytab.
I20260808 02:31:29.496533 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:33319
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.194.keytab
--principal=oryx/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:45137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:29.840353 2496 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:29.840682 2496 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:29.840855 2496 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:29.848032 2496 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:29.848186 2496 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:29.848439 2496 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:31:29.858382 2496 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:45137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.194.keytab
--principal=oryx/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:33319
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:29.859738 2496 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:29.861105 2496 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:29.874717 2504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:29.874678 2505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:29.874641 2507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:29.875618 2496 server_base.cc:1034] running on GCE node
I20260808 02:31:29.876271 2496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:29.877264 2496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:29.878871 2496 hybrid_clock.cc:648] HybridClock initialized: now 1786156289878827 us; error 37 us; skew 500 ppm
I20260808 02:31:29.879235 2496 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:29 dist-test-slave-45dx krb5kdc[2113](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156289, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:29.882551 2496 init.cc:377] Logged in from keytab as oryx/127.24.116.194@KRBTEST.COM (short username oryx)
I20260808 02:31:29.884081 2496 webserver.cc:460] Webserver started at http://127.24.116.194:40119/ using document root <none> and password file <none>
I20260808 02:31:29.884847 2496 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:29.885010 2496 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:29.885325 2496 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:29.888289 2496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "d20264ccdfeb48978ef42511d9424140"
format_stamp: "Formatted at 2026-08-08 02:31:29 on dist-test-slave-45dx"
server_key: "ee430ad1fbd0e5c19e4ed05e0d496dd6"
server_key_iv: "3a50ab680ba1af563dcf4c196989c2a8"
server_key_version: "encryptionkey@0"
I20260808 02:31:29.889227 2496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "d20264ccdfeb48978ef42511d9424140"
format_stamp: "Formatted at 2026-08-08 02:31:29 on dist-test-slave-45dx"
server_key: "ee430ad1fbd0e5c19e4ed05e0d496dd6"
server_key_iv: "3a50ab680ba1af563dcf4c196989c2a8"
server_key_version: "encryptionkey@0"
I20260808 02:31:29.894667 2496 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 02:31:29.898480 2516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:29.899864 2496 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 02:31:29.900067 2496 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "d20264ccdfeb48978ef42511d9424140"
format_stamp: "Formatted at 2026-08-08 02:31:29 on dist-test-slave-45dx"
server_key: "ee430ad1fbd0e5c19e4ed05e0d496dd6"
server_key_iv: "3a50ab680ba1af563dcf4c196989c2a8"
server_key_version: "encryptionkey@0"
I20260808 02:31:29.900285 2496 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:29.916247 2496 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:29.920678 2496 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:29.920989 2496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:29.922032 2496 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:29.923413 2496 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:29.923498 2496 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:29.923588 2496 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:29.923631 2496 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:29.959692 2496 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:46137
I20260808 02:31:29.959710 2697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:46137 every 8 connection(s)
I20260808 02:31:29.961071 2496 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:31:29.963332 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 2496
I20260808 02:31:29.963536 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:31:29.964161 25043 external_mini_cluster.cc:1428] Setting key c46920fbd1facfebb464fa74276347fc
Aug 08 02:31:29 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156289, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM
I20260808 02:31:29.985862 2700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:29.963741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:56249 (local address 127.24.116.254:33319)
0808 02:31:29.964296 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:29.964328 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:29.965372 (+ 1044us) server_negotiation.cc:407] Connection header received
0808 02:31:29.967713 (+ 2341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:29.967717 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:29.967781 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:29.967872 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:29.970034 (+ 2162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:29.970847 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:29.973424 (+ 2577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:29.973852 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:29.973954 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:29.978628 (+ 4674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:29.978633 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:29.978636 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:29.978671 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:29.982325 (+ 3654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:29.983073 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:29.983081 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:29.983088 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:29.983252 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:29.983717 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:29.983725 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:29.983730 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:29.984149 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:29.984342 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:29.985049 (+ 707us) server_negotiation.cc:299] Negotiation successful
0808 02:31:29.985329 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":302,"threads_started":1}
I20260808 02:31:29.986478 2701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:29.964311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.24.116.194:56249)
0808 02:31:29.965182 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:29.965237 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:29.967427 (+ 2190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:29.968170 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:29.968185 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:29.969032 (+ 847us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:29.969859 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:29.969888 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:29.971006 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:29.971015 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:29.973264 (+ 2249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:29.973283 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:29.974093 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:29.974103 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:29.974436 (+ 333us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:29.975226 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:29.975262 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:29.978338 (+ 3076us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:29.982481 (+ 4143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:29.982488 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:29.982501 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:29.982934 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:29.983399 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:29.983402 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:29.983404 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:29.983583 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:29.984274 (+ 691us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:29.984280 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:29.984679 (+ 399us) client_negotiation.cc:769] Sending connection context
0808 02:31:29.984901 (+ 222us) client_negotiation.cc:240] Negotiation successful
0808 02:31:29.985303 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":329,"threads_started":1}
I20260808 02:31:29.987975 2698 heartbeater.cc:347] Connected to a master server at 127.24.116.254:33319
I20260808 02:31:29.988370 2698 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:29.989290 2698 heartbeater.cc:511] Master 127.24.116.254:33319 requested a full tablet report, sending...
I20260808 02:31:29.990929 2182 ts_manager.cc:194] Registered new tserver with Master: d20264ccdfeb48978ef42511d9424140 (127.24.116.194:46137)
I20260808 02:31:29.991753 2182 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.116.194@KRBTEST.COM'} at 127.24.116.194:56249
WARNING: no policy specified for oryx/127.24.116.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.116.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.116.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.195.keytab.
Entry for principal oryx/127.24.116.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.195.keytab.
I20260808 02:31:30.031558 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:33319
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.195.keytab
--principal=oryx/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:45137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:30.402005 2708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:30.402382 2708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:30.402549 2708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:30.410332 2708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:30.410509 2708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:30.410697 2708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:31:30.421092 2708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:45137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.195.keytab
--principal=oryx/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:33319
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:30.422561 2708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:30.424001 2708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:30.438912 2718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:30.438879 2719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:30.438980 2721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:30.440433 2708 server_base.cc:1034] running on GCE node
I20260808 02:31:30.441075 2708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:30.442086 2708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:30.443322 2708 hybrid_clock.cc:648] HybridClock initialized: now 1786156290443268 us; error 69 us; skew 500 ppm
I20260808 02:31:30.443650 2708 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:30 dist-test-slave-45dx krb5kdc[2113](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156290, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:30.446866 2708 init.cc:377] Logged in from keytab as oryx/127.24.116.195@KRBTEST.COM (short username oryx)
I20260808 02:31:30.448256 2708 webserver.cc:460] Webserver started at http://127.24.116.195:35619/ using document root <none> and password file <none>
I20260808 02:31:30.449026 2708 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:30.449133 2708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:30.449378 2708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:30.452497 2708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "c79aa635d6bf4ca29c8396475ce17bfb"
format_stamp: "Formatted at 2026-08-08 02:31:30 on dist-test-slave-45dx"
server_key: "35d704dc49b47991bc3960a9d4dd0ff7"
server_key_iv: "6133a8d9d9cba0d44ff3a423b77c5cb5"
server_key_version: "encryptionkey@0"
I20260808 02:31:30.453241 2708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "c79aa635d6bf4ca29c8396475ce17bfb"
format_stamp: "Formatted at 2026-08-08 02:31:30 on dist-test-slave-45dx"
server_key: "35d704dc49b47991bc3960a9d4dd0ff7"
server_key_iv: "6133a8d9d9cba0d44ff3a423b77c5cb5"
server_key_version: "encryptionkey@0"
I20260808 02:31:30.458278 2708 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.005s
I20260808 02:31:30.461681 2732 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:30.462996 2708 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 02:31:30.463163 2708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "c79aa635d6bf4ca29c8396475ce17bfb"
format_stamp: "Formatted at 2026-08-08 02:31:30 on dist-test-slave-45dx"
server_key: "35d704dc49b47991bc3960a9d4dd0ff7"
server_key_iv: "6133a8d9d9cba0d44ff3a423b77c5cb5"
server_key_version: "encryptionkey@0"
I20260808 02:31:30.463372 2708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:30.463802 2488 heartbeater.cc:503] Master 127.24.116.254:33319 was elected leader, sending a full tablet report...
I20260808 02:31:30.478995 2708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:30.483250 2708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:30.483557 2708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:30.484632 2708 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:30.485968 2708 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:30.486042 2708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:30.486214 2708 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:30.486266 2708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:30.522002 2708 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:38969
I20260808 02:31:30.522053 2915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:38969 every 8 connection(s)
I20260808 02:31:30.523311 2708 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:31:30.529774 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 2708
I20260808 02:31:30.529981 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:31:30.530650 25043 external_mini_cluster.cc:1428] Setting key 1ffd2ef6639e53bb96134a83fef725dd
Aug 08 02:31:30 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156290, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM
I20260808 02:31:30.545435 2918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:30.526403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:50467 (local address 127.24.116.254:33319)
0808 02:31:30.526936 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:30.526941 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:30.527852 (+ 911us) server_negotiation.cc:407] Connection header received
0808 02:31:30.530282 (+ 2430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:30.530286 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:30.530367 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:30.530474 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:30.532521 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:30.533496 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:30.535456 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:30.535842 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:30.535948 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:30.539728 (+ 3780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:30.539732 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:30.539735 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:30.539776 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:30.542450 (+ 2674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:30.543139 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:30.543143 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:30.543145 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:30.543261 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:30.543634 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:30.543637 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:30.543639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:30.543888 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:30.544003 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:30.544785 (+ 782us) server_negotiation.cc:299] Negotiation successful
0808 02:31:30.545015 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":281,"threads_started":1}
I20260808 02:31:30.546588 2920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:30.526931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.24.116.195:50467)
0808 02:31:30.527666 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:30.527710 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:30.529961 (+ 2251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:30.530797 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:30.530821 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:30.531518 (+ 697us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:30.532310 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:30.532365 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:30.533670 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:30.533675 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:30.535314 (+ 1639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:30.535328 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:30.536046 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:30.536051 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:30.536258 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:30.537111 (+ 853us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:30.537136 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:30.539532 (+ 2396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:30.542598 (+ 3066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:30.542604 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:30.542615 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:30.543030 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:30.543351 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:30.543354 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:30.543356 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:30.543533 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:30.543991 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:30.543997 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:30.544290 (+ 293us) client_negotiation.cc:769] Sending connection context
0808 02:31:30.544654 (+ 364us) client_negotiation.cc:240] Negotiation successful
0808 02:31:30.545210 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":280,"threads_started":1}
I20260808 02:31:30.547945 2916 heartbeater.cc:347] Connected to a master server at 127.24.116.254:33319
I20260808 02:31:30.548200 2916 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:30.548949 2916 heartbeater.cc:511] Master 127.24.116.254:33319 requested a full tablet report, sending...
I20260808 02:31:30.550249 2182 ts_manager.cc:194] Registered new tserver with Master: c79aa635d6bf4ca29c8396475ce17bfb (127.24.116.195:38969)
I20260808 02:31:30.551146 2182 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.116.195@KRBTEST.COM'} at 127.24.116.195:50467
I20260808 02:31:30.558694 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.24.116.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.116.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.116.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.253.keytab.
Entry for principal oryx/127.24.116.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.253.keytab.
I20260808 02:31:30.622344 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.253:33605
--webserver_interface=127.24.116.253
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.253.keytab
--principal=oryx/127.24.116.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:45137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:33319,127.24.116.253:33605
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:30.979758 2924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:30.980113 2924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:30.980273 2924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:30.987625 2924 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:31:30.987777 2924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:30.987884 2924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:30.987998 2924 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:31:30.988086 2924 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:31:30.995072 2698 heartbeater.cc:503] Master 127.24.116.254:33319 was elected leader, sending a full tablet report...
I20260808 02:31:30.999189 2924 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:45137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:33319,127.24.116.253:33605
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.253.keytab
--principal=oryx/127.24.116.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.253:33605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.24.116.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
W20260808 02:31:30.999601 2924 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.24.116.254:33319,127.24.116.253:33605'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 02:31:31.000758 2924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:31.002138 2924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:31.014593 2933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:31.014644 2934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:31.014549 2937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:31.015542 2924 server_base.cc:1034] running on GCE node
I20260808 02:31:31.016289 2924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:31.017766 2924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:31.018992 2924 hybrid_clock.cc:648] HybridClock initialized: now 1786156291018909 us; error 52 us; skew 500 ppm
I20260808 02:31:31.019284 2924 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:31 dist-test-slave-45dx krb5kdc[2113](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156291, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:31.022490 2924 init.cc:377] Logged in from keytab as oryx/127.24.116.253@KRBTEST.COM (short username oryx)
I20260808 02:31:31.024001 2924 webserver.cc:460] Webserver started at http://127.24.116.253:37821/ using document root <none> and password file <none>
I20260808 02:31:31.024796 2924 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:31.024917 2924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:31.025300 2924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:31.028349 2924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/data/instance:
uuid: "510b7389184341aebda800270f395f34"
format_stamp: "Formatted at 2026-08-08 02:31:31 on dist-test-slave-45dx"
server_key: "bfc083212c8eece47bea9f7d5d6c3801"
server_key_iv: "1908b203e008820830222bf6b57d8cc9"
server_key_version: "encryptionkey@0"
I20260808 02:31:31.029179 2924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/wal/instance:
uuid: "510b7389184341aebda800270f395f34"
format_stamp: "Formatted at 2026-08-08 02:31:31 on dist-test-slave-45dx"
server_key: "bfc083212c8eece47bea9f7d5d6c3801"
server_key_iv: "1908b203e008820830222bf6b57d8cc9"
server_key_version: "encryptionkey@0"
I20260808 02:31:31.034497 2924 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.005s
I20260808 02:31:31.037998 2946 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:31.039500 2924 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 02:31:31.039669 2924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/wal
uuid: "510b7389184341aebda800270f395f34"
format_stamp: "Formatted at 2026-08-08 02:31:31 on dist-test-slave-45dx"
server_key: "bfc083212c8eece47bea9f7d5d6c3801"
server_key_iv: "1908b203e008820830222bf6b57d8cc9"
server_key_version: "encryptionkey@0"
I20260808 02:31:31.039893 2924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:31.059182 2924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:31.063279 2924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:31.063570 2924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:31.083025 2924 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.253:33605
I20260808 02:31:31.083050 3025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.253:33605 every 8 connection(s)
I20260808 02:31:31.084527 2924 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/data/info.pb
I20260808 02:31:31.088186 3026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:31.089701 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 2924
I20260808 02:31:31.097746 3026 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:31:31 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.116.253@KRBTEST.COM
Aug 08 02:31:31 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156291, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.253@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM
I20260808 02:31:31.115684 3029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.092005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35040 (local address 127.24.116.253:33605)
0808 02:31:31.092854 (+ 849us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:31.092865 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:31.092909 (+ 44us) server_negotiation.cc:407] Connection header received
0808 02:31:31.094517 (+ 1608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:31.094541 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:31.094938 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:31.095285 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:31.097217 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.098530 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.100351 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.101519 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.101697 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.106775 (+ 5078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:31.106782 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:31.106793 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:31.106830 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:31.110696 (+ 3866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.111510 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.111519 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.111529 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.111724 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.112222 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.112230 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.112233 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.113037 (+ 804us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:31.113361 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:31.113806 (+ 445us) server_negotiation.cc:299] Negotiation successful
0808 02:31:31.114290 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":422,"threads_started":1}
I20260808 02:31:31.117828 3033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.100746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.0.0.1:50430)
0808 02:31:31.101568 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:31.101642 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:31.101823 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:31.102325 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:31.102331 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:31.103226 (+ 895us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:31.103593 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.103606 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.104838 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.104846 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.106226 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.106239 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.107095 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.107103 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.107345 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.108034 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:31.108067 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:31.110943 (+ 2876us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:31.114949 (+ 4006us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:31.114960 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:31.114965 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:31.115419 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:31.115869 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:31.115876 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:31.115881 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:31.116070 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:31.116806 (+ 736us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:31.116812 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:31.117022 (+ 210us) client_negotiation.cc:769] Sending connection context
0808 02:31:31.117276 (+ 254us) client_negotiation.cc:240] Negotiation successful
0808 02:31:31.117530 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":626,"thread_start_us":471,"threads_started":1}
I20260808 02:31:31.118727 3032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.100674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50430 (local address 127.24.116.254:33319)
0808 02:31:31.101207 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:31.101215 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:31.101972 (+ 757us) server_negotiation.cc:407] Connection header received
0808 02:31:31.102036 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:31.102040 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:31.102115 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:31.102204 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:31.103769 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.104688 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.106395 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.106889 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.106998 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.111141 (+ 4143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:31.111146 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:31.111149 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:31.111185 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:31.114802 (+ 3617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.115555 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.115561 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.115564 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.115731 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.116205 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.116209 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.116213 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.116679 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:31.116832 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:31.118173 (+ 1341us) server_negotiation.cc:299] Negotiation successful
0808 02:31:31.118431 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":283,"threads_started":1}
I20260808 02:31:31.120182 3026 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:31:31 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156291, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.253@KRBTEST.COM for oryx/127.24.116.253@KRBTEST.COM
I20260808 02:31:31.132004 3033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.121095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:33605 (local address 127.0.0.1:35046)
0808 02:31:31.121320 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:31.121334 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:31.121423 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:31.121680 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:31.121683 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:31.122040 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:31.122173 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.122181 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.123100 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.123103 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.123959 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.123969 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.124675 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.124679 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.124797 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.125320 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:31.125336 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:31.127304 (+ 1968us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:31.130028 (+ 2724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:31.130032 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:31.130034 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:31.130399 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:31.130707 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:31.130710 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:31.130712 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:31.130833 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:31.131287 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:31.131291 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:31.131401 (+ 110us) client_negotiation.cc:769] Sending connection context
0808 02:31:31.131505 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 02:31:31.131697 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154}
I20260808 02:31:31.132078 3029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.121104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35046 (local address 127.24.116.253:33605)
0808 02:31:31.121236 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:31.121240 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:31.121402 (+ 162us) server_negotiation.cc:407] Connection header received
0808 02:31:31.121511 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:31.121515 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:31.121570 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:31.121644 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:31.122289 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.122972 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.124076 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.124543 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.124640 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.127474 (+ 2834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:31.127479 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:31.127482 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:31.127510 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:31.129910 (+ 2400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.130503 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.130507 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.130509 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.130616 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.130932 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.130935 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.130938 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.131192 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:31.131298 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:31.131588 (+ 290us) server_negotiation.cc:299] Negotiation successful
0808 02:31:31.131814 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":36}
I20260808 02:31:31.136999 3026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34: Bootstrap starting.
I20260808 02:31:31.140206 3026 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:31.141317 3026 log.cc:824] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34: Log is configured to *not* fsync() on all Append() calls
I20260808 02:31:31.144075 3026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34: No bootstrap required, opened a new log
I20260808 02:31:31.151376 3026 raft_consensus.cc:348] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } }
I20260808 02:31:31.151731 3026 raft_consensus.cc:374] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:31.151842 3026 raft_consensus.cc:729] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510b7389184341aebda800270f395f34, State: Initialized, Role: FOLLOWER
I20260808 02:31:31.152545 3026 consensus_queue.cc:260] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } }
I20260808 02:31:31.153404 3036 sys_catalog.cc:455] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } } }
I20260808 02:31:31.153716 3036 sys_catalog.cc:458] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:31:31.154410 3026 sys_catalog.cc:564] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 02:31:31.163235 3055 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 02:31:31.163384 3055 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 02:31:31.165303 2924 master_runner.cc:428] Detected that this master 510b7389184341aebda800270f395f34 is joining an existing cluster
I20260808 02:31:31.165405 2924 master_runner.cc:432] Initiating AddMaster RPC to add 127.24.116.253:33605
I20260808 02:31:31.197486 3032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.169563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50434 (local address 127.24.116.254:33319)
0808 02:31:31.169860 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:31.169866 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:31.181545 (+ 11679us) server_negotiation.cc:407] Connection header received
0808 02:31:31.181739 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:31.181745 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:31.181837 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:31.181955 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:31.183423 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.184505 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.186083 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.186757 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.186858 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.190072 (+ 3214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:31.190079 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:31.190083 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:31.190123 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:31.194248 (+ 4125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.195095 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.195100 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.195103 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.195251 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.195718 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.195723 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.195726 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.196102 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:31.196222 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:31.196908 (+ 686us) server_negotiation.cc:299] Negotiation successful
0808 02:31:31.197144 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152}
I20260808 02:31:31.197525 3029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.170319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35052 (local address 127.24.116.253:33605)
0808 02:31:31.170512 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:31.170518 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:31.180964 (+ 10446us) server_negotiation.cc:407] Connection header received
0808 02:31:31.181260 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:31.181267 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:31.181346 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:31.181421 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:31.183094 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.184255 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.186425 (+ 2170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.187112 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.187244 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.190054 (+ 2810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:31.190060 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:31.190064 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:31.190097 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:31.194102 (+ 4005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.195036 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.195043 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.195052 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.195217 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.195702 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.195706 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.195709 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.196082 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:31.196241 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:31.196877 (+ 636us) server_negotiation.cc:299] Negotiation successful
0808 02:31:31.197121 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":44}
I20260808 02:31:31.198621 3064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.169780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:33605 (local address 127.0.0.1:35052)
0808 02:31:31.180831 (+ 11051us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:31.180860 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:31.181091 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:31.181655 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:31.181662 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:31.182492 (+ 830us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:31.182917 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.182930 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.184519 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.184524 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.186281 (+ 1757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.186294 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.187559 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.187566 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.187777 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.188459 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:31.188484 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:31.189856 (+ 1372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:31.194255 (+ 4399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:31.194260 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:31.194263 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:31.194912 (+ 649us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:31.195362 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:31.195368 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:31.195372 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:31.195582 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:31.196347 (+ 765us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:31.196352 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:31.196604 (+ 252us) client_negotiation.cc:769] Sending connection context
0808 02:31:31.197802 (+ 1198us) client_negotiation.cc:240] Negotiation successful
0808 02:31:31.198108 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10861,"mutex_wait_us":108,"spinlock_wait_cycles":1664,"thread_start_us":10704,"threads_started":1}
I20260808 02:31:31.199086 3065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.169918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.0.0.1:50434)
0808 02:31:31.181395 (+ 11477us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:31.181412 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:31.181584 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:31.181989 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:31.181994 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:31.182810 (+ 816us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:31.183216 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.183232 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.184681 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.184689 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.185905 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.185920 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.187199 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.187205 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.187401 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.188468 (+ 1067us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:31.188581 (+ 113us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:31.189856 (+ 1275us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:31.194419 (+ 4563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:31.194424 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:31.194428 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:31.194957 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:31.195395 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:31.195399 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:31.195402 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:31.195584 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:31.196347 (+ 763us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:31.196352 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:31.196604 (+ 252us) client_negotiation.cc:769] Sending connection context
0808 02:31:31.198217 (+ 1613us) client_negotiation.cc:240] Negotiation successful
0808 02:31:31.198550 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11354,"mutex_wait_us":47,"spinlock_wait_cycles":73984,"thread_start_us":11142,"threads_started":1}
WARNING: no policy specified for oryx/127.24.116.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.116.252@KRBTEST.COM" created.
Aug 08 02:31:31 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156288, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.254@KRBTEST.COM for oryx/127.24.116.253@KRBTEST.COM
I20260808 02:31:31.224740 3029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.205831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35064 (local address 127.24.116.253:33605)
0808 02:31:31.206068 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:31.206077 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:31.206658 (+ 581us) server_negotiation.cc:407] Connection header received
0808 02:31:31.206931 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:31.206936 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:31.207036 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:31.207114 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:31.209263 (+ 2149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.210547 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.212564 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.213358 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.213519 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.217955 (+ 4436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:31.217964 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:31.217973 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:31.218014 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:31.221844 (+ 3830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.222572 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.222578 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.222581 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.222722 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.223137 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.223140 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.223172 (+ 32us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.223419 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:31.223576 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:31.224086 (+ 510us) server_negotiation.cc:299] Negotiation successful
0808 02:31:31.224348 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 02:31:31.224802 3067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.205797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:33605 (local address 127.0.0.1:35064)
0808 02:31:31.206498 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:31.206545 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:31.206734 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:31.207207 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:31.207215 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:31.208761 (+ 1546us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:31.209075 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.209090 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.210713 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.210718 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.212394 (+ 1676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.212410 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.213544 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.213551 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.213751 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.214552 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:31.214578 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:31.217745 (+ 3167us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:31.221999 (+ 4254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:31.222009 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:31.222015 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:31.222417 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:31.222841 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:31.222846 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:31.222850 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:31.223000 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:31.223556 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:31.223564 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:31.223763 (+ 199us) client_negotiation.cc:769] Sending connection context
0808 02:31:31.223949 (+ 186us) client_negotiation.cc:240] Negotiation successful
0808 02:31:31.224341 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":278,"threads_started":1}
I20260808 02:31:31.226949 2182 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.24.116.253:33605: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "510b7389184341aebda800270f395f34"
member_type: NON_VOTER
last_known_addr {
host: "127.24.116.253"
port: 33605
}
attrs {
promote: true
}
}
dest_uuid: "1411d8b83e714c8d9b40fa837fc7c233"
cas_config_opid_index: -1
I20260808 02:31:31.228209 2182 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: NON_VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: true } }
I20260808 02:31:31.243155 2985 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:31.241906 3072 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 510b7389184341aebda800270f395f34 (127.24.116.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: NON_VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: true } } }
I20260808 02:31:31.247735 2985 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 1 FOLLOWER]: Refusing update from remote peer 1411d8b83e714c8d9b40fa837fc7c233: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 02:31:31.247783 3072 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.24.116.253:33605
I20260808 02:31:31.248402 3070 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1411d8b83e714c8d9b40fa837fc7c233" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: NON_VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: true } } }
I20260808 02:31:31.248817 3070 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:31.248853 2924 master.cc:537] Master@127.24.116.253:33605 shutting down...
I20260808 02:31:31.249769 3072 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "510b7389184341aebda800270f395f34" member_type: NON_VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:31:31.256338 3036 raft_consensus.cc:482] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:31:31.256608 3036 raft_consensus.cc:504] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } }
I20260808 02:31:31.258086 3036 leader_election.cc:288] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1411d8b83e714c8d9b40fa837fc7c233 (127.24.116.254:33319)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.116.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.252.keytab.
Entry for principal oryx/127.24.116.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.252.keytab.
I20260808 02:31:31.259428 2198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "510b7389184341aebda800270f395f34" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1411d8b83e714c8d9b40fa837fc7c233" is_pre_election: true
I20260808 02:31:31.260736 2949 leader_election.cc:302] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 510b7389184341aebda800270f395f34; no voters: 1411d8b83e714c8d9b40fa837fc7c233
I20260808 02:31:31.261458 3036 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 02:31:31.262204 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.252:40613
--webserver_interface=127.24.116.252
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.252.keytab
--principal=oryx/127.24.116.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:45137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:33319,127.24.116.253:33605,127.24.116.252:40613
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:31:31.272861 2924 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260808 02:31:31.273219 2158 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260808 02:31:31.273456 2924 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:31.273757 2924 tablet_replica.cc:330] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34: stopping tablet replica
I20260808 02:31:31.282843 3067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.282391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:33605 (local address 127.0.0.1:35076)
0808 02:31:31.282583 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:31.282694 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:33605: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260808 02:31:31.283134 2158 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 -> Peer 510b7389184341aebda800270f395f34 (127.24.116.253:33605): Couldn't send request to peer 510b7389184341aebda800270f395f34. Status: Network error: Client connection negotiation failed: client connection to 127.24.116.253:33605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 02:31:31.293301 2924 master.cc:552] Master@127.24.116.253:33605 shutdown complete.
I20260808 02:31:31.293455 2924 master_runner.cc:305] Clearing existing system tablet
I20260808 02:31:31.293906 2924 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:31.294027 2924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:31.296645 2924 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260808 02:31:31.298171 3080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:31.298499 2924 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:31.298821 2924 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260808 02:31:31.298936 2924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/wal
uuid: "510b7389184341aebda800270f395f34"
format_stamp: "Formatted at 2026-08-08 02:31:31 on dist-test-slave-45dx"
server_key: "bfc083212c8eece47bea9f7d5d6c3801"
server_key_iv: "1908b203e008820830222bf6b57d8cc9"
server_key_version: "encryptionkey@0"
I20260808 02:31:31.302429 2924 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:31.307538 2924 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 02:31:31.307729 2924 log.cc:1196] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 02:31:31.308153 2924 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34: Deleting consensus metadata
I20260808 02:31:31.308491 2924 master_runner.cc:315] Copying system tablet from 127.24.116.254:33319
I20260808 02:31:31.311280 2924 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34: tablet copy: Beginning tablet copy session from remote peer at address 127.24.116.254:33319
I20260808 02:31:31.324558 3032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.312186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50436 (local address 127.24.116.254:33319)
0808 02:31:31.312439 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:31.312449 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:31.312952 (+ 503us) server_negotiation.cc:407] Connection header received
0808 02:31:31.313174 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:31.313180 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:31.313256 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:31.313365 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:31.314252 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.315049 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.316258 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.316748 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.316894 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.318886 (+ 1992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:31.318892 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:31.318897 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:31.318935 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:31.321890 (+ 2955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.322543 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.322550 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.322554 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.322685 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.323075 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.323080 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.323084 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.323357 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:31.323524 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:31.323909 (+ 385us) server_negotiation.cc:299] Negotiation successful
0808 02:31:31.324121 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 02:31:31.324611 3092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.312155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.0.0.1:50436)
0808 02:31:31.312828 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:31.312848 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:31.313023 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:31.313399 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:31.313403 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:31.313843 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:31.314099 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.314108 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.315198 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.315204 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.316115 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.316126 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.316949 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.316958 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.317147 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.317912 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:31.317933 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:31.318690 (+ 757us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:31.322028 (+ 3338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:31.322033 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:31.322038 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:31.322408 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:31.322800 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:31.322805 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:31.322809 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:31.322964 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:31.323488 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:31.323493 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:31.323664 (+ 171us) client_negotiation.cc:769] Sending connection context
0808 02:31:31.323808 (+ 144us) client_negotiation.cc:240] Negotiation successful
0808 02:31:31.324124 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":444,"threads_started":1}
I20260808 02:31:31.325848 2220 tablet_copy_service.cc:140] P 1411d8b83e714c8d9b40fa837fc7c233: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 510b7389184341aebda800270f395f34 ({username='oryx', principal='oryx/127.24.116.253@KRBTEST.COM'} at 127.0.0.1:50436)
I20260808 02:31:31.326222 2220 tablet_copy_service.cc:161] P 1411d8b83e714c8d9b40fa837fc7c233: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 510b7389184341aebda800270f395f34 at {username='oryx', principal='oryx/127.24.116.253@KRBTEST.COM'} at 127.0.0.1:50436: session id = 510b7389184341aebda800270f395f34-00000000000000000000000000000000
I20260808 02:31:31.329672 2220 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 02:31:31.331873 2924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 02:31:31.337594 2924 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34: tablet copy: Starting download of 0 data blocks...
I20260808 02:31:31.337991 2924 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34: tablet copy: Starting download of 1 WAL segments...
I20260808 02:31:31.341440 2924 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 02:31:31.344972 2220 tablet_copy_service.cc:342] P 1411d8b83e714c8d9b40fa837fc7c233: Request end of tablet copy session 510b7389184341aebda800270f395f34-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.24.116.253@KRBTEST.COM'} at 127.0.0.1:50436
I20260808 02:31:31.345214 2220 tablet_copy_service.cc:433] P 1411d8b83e714c8d9b40fa837fc7c233: ending tablet copy session 510b7389184341aebda800270f395f34-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 510b7389184341aebda800270f395f34
I20260808 02:31:31.358209 2924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:31.361116 3095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:31.361615 3097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:31.378254 3100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:31.378728 2924 server_base.cc:1034] running on GCE node
I20260808 02:31:31.379204 2924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:31.380019 2924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:31.381315 2924 hybrid_clock.cc:648] HybridClock initialized: now 1786156291381242 us; error 46 us; skew 500 ppm
I20260808 02:31:31.381659 2924 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:31 dist-test-slave-45dx krb5kdc[2113](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156291, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:31.384053 2924 init.cc:377] Logged in from keytab as oryx/127.24.116.253@KRBTEST.COM (short username oryx)
I20260808 02:31:31.389639 2924 webserver.cc:460] Webserver started at http://127.24.116.253:39053/ using document root <none> and password file <none>
I20260808 02:31:31.390091 2924 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:31.390236 2924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:31.393658 2924 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260808 02:31:31.395776 3112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:31.396418 2924 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260808 02:31:31.396593 2924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/wal
uuid: "510b7389184341aebda800270f395f34"
format_stamp: "Formatted at 2026-08-08 02:31:31 on dist-test-slave-45dx"
server_key: "bfc083212c8eece47bea9f7d5d6c3801"
server_key_iv: "1908b203e008820830222bf6b57d8cc9"
server_key_version: "encryptionkey@0"
I20260808 02:31:31.396883 2924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:31.412341 2924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:31.416882 2924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:31.444485 2924 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.253:33605
I20260808 02:31:31.444538 3194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.253:33605 every 8 connection(s)
I20260808 02:31:31.445612 2924 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-1/data/info.pb
I20260808 02:31:31.451140 3200 sys_catalog.cc:263] Verifying existing consensus state
I20260808 02:31:31.455283 3200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34: Bootstrap starting.
I20260808 02:31:31.475486 3200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 02:31:31.476075 3200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34: Bootstrap complete.
I20260808 02:31:31.477268 3200 raft_consensus.cc:348] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: NON_VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: true } }
I20260808 02:31:31.477584 3200 raft_consensus.cc:729] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 510b7389184341aebda800270f395f34, State: Initialized, Role: LEARNER
I20260808 02:31:31.477896 3200 consensus_queue.cc:260] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: NON_VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: true } }
I20260808 02:31:31.478778 3204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: NON_VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: true } } }
I20260808 02:31:31.479163 3204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [sys.catalog]: This master's current role is: LEARNER
I20260808 02:31:31.479229 3200 sys_catalog.cc:564] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:31:31.490332 3218 catalog_manager.cc:1259] Loaded cluster ID: afa59ea266074dd092f572db28a4a4ea
I20260808 02:31:31.490470 3218 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34: loading cluster ID for follower catalog manager: success
I20260808 02:31:31.494851 3218 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34: acquiring CA information for follower catalog manager: success
I20260808 02:31:31.497588 3218 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 02:31:31.553746 2916 heartbeater.cc:503] Master 127.24.116.254:33319 was elected leader, sending a full tablet report...
W20260808 02:31:31.710467 3078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:31.710788 3078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:31.710902 3078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:31.719717 3078 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:31:31.719841 3078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:31.719902 3078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:31.719961 3078 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:31:31.720012 3078 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:31:31.731549 3078 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:45137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:33319,127.24.116.253:33605,127.24.116.252:40613
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.252.keytab
--principal=oryx/127.24.116.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.252:40613
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.24.116.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:31.733273 3078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:31.734791 3078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:31.748745 3227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:31.748926 3231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:31.748926 3234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:31.749847 3078 server_base.cc:1034] running on GCE node
I20260808 02:31:31.750779 3078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:31.752375 3078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:31.753597 3078 hybrid_clock.cc:648] HybridClock initialized: now 1786156291753562 us; error 33 us; skew 500 ppm
I20260808 02:31:31.753960 3078 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:31 dist-test-slave-45dx krb5kdc[2113](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156291, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:31.757584 3078 init.cc:377] Logged in from keytab as oryx/127.24.116.252@KRBTEST.COM (short username oryx)
I20260808 02:31:31.759328 3078 webserver.cc:460] Webserver started at http://127.24.116.252:40433/ using document root <none> and password file <none>
I20260808 02:31:31.760120 3078 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:31.760259 3078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:31.760643 3078 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:31.763849 3078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/data/instance:
uuid: "146343da39844d15be75c5d54005a43b"
format_stamp: "Formatted at 2026-08-08 02:31:31 on dist-test-slave-45dx"
server_key: "674890de055c07b83841fc28105f0fa1"
server_key_iv: "ebb710b3b6d71eb48b442b715f0dce1b"
server_key_version: "encryptionkey@0"
I20260808 02:31:31.764688 3078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/wal/instance:
uuid: "146343da39844d15be75c5d54005a43b"
format_stamp: "Formatted at 2026-08-08 02:31:31 on dist-test-slave-45dx"
server_key: "674890de055c07b83841fc28105f0fa1"
server_key_iv: "ebb710b3b6d71eb48b442b715f0dce1b"
server_key_version: "encryptionkey@0"
I20260808 02:31:31.772624 3078 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260808 02:31:31.777410 3244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:31.778944 3078 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 02:31:31.779104 3078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/wal
uuid: "146343da39844d15be75c5d54005a43b"
format_stamp: "Formatted at 2026-08-08 02:31:31 on dist-test-slave-45dx"
server_key: "674890de055c07b83841fc28105f0fa1"
server_key_iv: "ebb710b3b6d71eb48b442b715f0dce1b"
server_key_version: "encryptionkey@0"
I20260808 02:31:31.779368 3078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:31.804044 3078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:31.809180 3078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:31.809504 3078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:31.821357 3261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.811242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35080 (local address 127.24.116.253:33605)
0808 02:31:31.813447 (+ 2205us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:31.813453 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:31.814009 (+ 556us) server_negotiation.cc:407] Connection header received
0808 02:31:31.814256 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:31.814260 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:31.814342 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:31.814446 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:31.814990 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.816138 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.818937 (+ 2799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.820181 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.820444 (+ 263us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.820672 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:31.820988 (+ 316us) server_negotiation.cc:299] Negotiation successful
0808 02:31:31.821095 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2013,"thread_start_us":1860,"threads_started":1}
I20260808 02:31:31.821635 3260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.810924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:33605 (local address 127.0.0.1:35080)
0808 02:31:31.813883 (+ 2959us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:31.813904 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:31.814103 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:31.814526 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:31.814531 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:31.814565 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:31.814823 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.814858 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.816340 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.816350 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.818713 (+ 2363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.818732 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.820470 (+ 1738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.820477 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.820701 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.820804 (+ 103us) client_negotiation.cc:769] Sending connection context
0808 02:31:31.820955 (+ 151us) client_negotiation.cc:240] Negotiation successful
0808 02:31:31.821158 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2778,"thread_start_us":2631,"threads_started":1}
I20260808 02:31:31.823007 3151 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260808 02:31:31.823733 3204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1411d8b83e714c8d9b40fa837fc7c233. Latest consensus state: current_term: 1 leader_uuid: "1411d8b83e714c8d9b40fa837fc7c233" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: NON_VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: true } } }
I20260808 02:31:31.824013 3204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [sys.catalog]: This master's current role is: LEARNER
I20260808 02:31:31.835687 3078 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.252:40613
I20260808 02:31:31.835738 3331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.252:40613 every 8 connection(s)
I20260808 02:31:31.837157 3078 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/data/info.pb
I20260808 02:31:31.839560 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 3078
I20260808 02:31:31.841840 3332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:31.853143 3332 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:31:31 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.116.252@KRBTEST.COM
Aug 08 02:31:31 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156291, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.252@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM
I20260808 02:31:31.870241 3338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.841742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48612 (local address 127.24.116.252:40613)
0808 02:31:31.845009 (+ 3267us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:31.845024 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:31.845075 (+ 51us) server_negotiation.cc:407] Connection header received
0808 02:31:31.847479 (+ 2404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:31.847510 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:31.848052 (+ 542us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:31.848523 (+ 471us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:31.849909 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.852148 (+ 2239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.853814 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.854861 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.855086 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.861200 (+ 6114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:31.861209 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:31.861220 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:31.861266 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:31.865058 (+ 3792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.865924 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.865930 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.865937 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.866124 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.866638 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.866642 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.866644 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.867346 (+ 702us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:31.867717 (+ 371us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:31.868208 (+ 491us) server_negotiation.cc:299] Negotiation successful
0808 02:31:31.868727 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3002,"thread_start_us":2717,"threads_started":1}
I20260808 02:31:31.874810 3342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.856198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.0.0.1:50450)
0808 02:31:31.857471 (+ 1273us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:31.857541 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:31.857722 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:31.858338 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:31.858347 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:31.859435 (+ 1088us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:31.859737 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.859756 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.861117 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.861121 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.862743 (+ 1622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.862757 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.863914 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.863920 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.864055 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.864814 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:31.864832 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:31.867420 (+ 2588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:31.871505 (+ 4085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:31.871526 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:31.871533 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:31.872419 (+ 886us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:31.872813 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:31.872818 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:31.872822 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:31.873055 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:31.873877 (+ 822us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:31.873884 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:31.874113 (+ 229us) client_negotiation.cc:769] Sending connection context
0808 02:31:31.874277 (+ 164us) client_negotiation.cc:240] Negotiation successful
0808 02:31:31.874524 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":886,"thread_start_us":502,"threads_started":1}
I20260808 02:31:31.874908 3344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.856387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50450 (local address 127.24.116.254:33319)
0808 02:31:31.857958 (+ 1571us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:31.857962 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:31.857980 (+ 18us) server_negotiation.cc:407] Connection header received
0808 02:31:31.858028 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:31.858032 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:31.858089 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:31.858181 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:31.859927 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.860913 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.862914 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.863615 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.863769 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.867731 (+ 3962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:31.867737 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:31.867740 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:31.867783 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:31.871288 (+ 3505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.872557 (+ 1269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.872561 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.872563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.872689 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.873189 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.873192 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.873194 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.873538 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:31.873776 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:31.874439 (+ 663us) server_negotiation.cc:299] Negotiation successful
0808 02:31:31.874623 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1463,"thread_start_us":1367,"threads_started":1}
I20260808 02:31:31.876379 3332 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:31:31 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156291, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.252@KRBTEST.COM for oryx/127.24.116.253@KRBTEST.COM
I20260808 02:31:31.889943 3342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.877128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:33605 (local address 127.0.0.1:35086)
0808 02:31:31.877349 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:31.877368 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:31.877469 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:31.877815 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:31.877819 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:31.878179 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:31.878310 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.878318 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.879380 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.879391 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.880455 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.880467 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.881195 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.881202 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.881383 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.882045 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:31.882072 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:31.884529 (+ 2457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:31.887690 (+ 3161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:31.887694 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:31.887697 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:31.888139 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:31.888608 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:31.888611 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:31.888613 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:31.888749 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:31.889251 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:31.889254 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:31.889381 (+ 127us) client_negotiation.cc:769] Sending connection context
0808 02:31:31.889492 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 02:31:31.889704 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 02:31:31.890148 3261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.877203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35086 (local address 127.24.116.253:33605)
0808 02:31:31.877424 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:31.877431 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:31.877450 (+ 19us) server_negotiation.cc:407] Connection header received
0808 02:31:31.877609 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:31.877619 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:31.877681 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:31.877786 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:31.878452 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.879217 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.880615 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.881036 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.881174 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.884686 (+ 3512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:31.884691 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:31.884695 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:31.884772 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:31.887561 (+ 2789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.888256 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.888261 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.888263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.888502 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.888857 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.888861 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.888863 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.889149 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:31.889276 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:31.889652 (+ 376us) server_negotiation.cc:299] Negotiation successful
0808 02:31:31.889859 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 02:31:31.891105 3332 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.252" port: 40613 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:31:31 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156291, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.252@KRBTEST.COM for oryx/127.24.116.252@KRBTEST.COM
I20260808 02:31:31.904948 3342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.891837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:40613 (local address 127.0.0.1:48622)
0808 02:31:31.892077 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:31.892094 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:31.892176 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:31.892576 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:31.892579 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:31.893004 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:31.893160 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.893168 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.894322 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.894325 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.895242 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.895253 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.896071 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.896083 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.896236 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.896939 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:31.896959 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:31.899265 (+ 2306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:31.902650 (+ 3385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:31.902654 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:31.902656 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:31.903016 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:31.903421 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:31.903424 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:31.903426 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:31.903570 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:31.904076 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:31.904079 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:31.904223 (+ 144us) client_negotiation.cc:769] Sending connection context
0808 02:31:31.904406 (+ 183us) client_negotiation.cc:240] Negotiation successful
0808 02:31:31.904606 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90}
I20260808 02:31:31.905057 3338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.892081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48622 (local address 127.24.116.252:40613)
0808 02:31:31.892263 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:31.892268 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:31.892283 (+ 15us) server_negotiation.cc:407] Connection header received
0808 02:31:31.892373 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:31.892378 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:31.892452 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:31.892534 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:31.893335 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.894185 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.895404 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.895874 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.895985 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.899442 (+ 3457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:31.899448 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:31.899451 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:31.899482 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:31.902517 (+ 3035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.903118 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.903122 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.903124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.903306 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.903667 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.903670 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.903672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.903973 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:31.904096 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:31.904521 (+ 425us) server_negotiation.cc:299] Negotiation successful
0808 02:31:31.904748 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":57}
I20260808 02:31:31.909909 3332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b: Bootstrap starting.
I20260808 02:31:31.913166 3332 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:31.914247 3332 log.cc:824] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b: Log is configured to *not* fsync() on all Append() calls
I20260808 02:31:31.917109 3332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b: No bootstrap required, opened a new log
I20260808 02:31:31.925200 3332 raft_consensus.cc:348] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 40613 } }
I20260808 02:31:31.925629 3332 raft_consensus.cc:374] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:31.925846 3332 raft_consensus.cc:729] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146343da39844d15be75c5d54005a43b, State: Initialized, Role: FOLLOWER
I20260808 02:31:31.926455 3332 consensus_queue.cc:260] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 40613 } }
I20260808 02:31:31.927441 3347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 40613 } } }
I20260808 02:31:31.927806 3347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:31:31.928467 3332 sys_catalog.cc:564] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [sys.catalog]: configured and running, proceeding with master startup.
W20260808 02:31:31.939074 3367 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 02:31:31.939232 3367 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 02:31:31.943373 3078 master_runner.cc:428] Detected that this master 146343da39844d15be75c5d54005a43b is joining an existing cluster
I20260808 02:31:31.943491 3078 master_runner.cc:432] Initiating AddMaster RPC to add 127.24.116.252:40613
I20260808 02:31:31.970434 3344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.947905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50460 (local address 127.24.116.254:33319)
0808 02:31:31.948146 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:31.948154 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:31.949344 (+ 1190us) server_negotiation.cc:407] Connection header received
0808 02:31:31.949638 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:31.949644 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:31.949748 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:31.949832 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:31.952009 (+ 2177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.953559 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.956415 (+ 2856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.957751 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.957904 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.961521 (+ 3617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:31.961547 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:31.961555 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:31.961609 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:31.966319 (+ 4710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.967380 (+ 1061us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.967386 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.967390 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.967565 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.968247 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.968254 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.968258 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.968691 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:31.968871 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:31.969698 (+ 827us) server_negotiation.cc:299] Negotiation successful
0808 02:31:31.970008 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 02:31:31.971814 3377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.947989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.0.0.1:50460)
0808 02:31:31.949238 (+ 1249us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:31.949261 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:31.949458 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:31.950182 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:31.950190 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:31.951200 (+ 1010us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:31.951762 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.951781 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.953859 (+ 2078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.953867 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.956179 (+ 2312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.956199 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.958360 (+ 2161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.958371 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.958653 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.959809 (+ 1156us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:31.959845 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:31.961281 (+ 1436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:31.966531 (+ 5250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:31.966537 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:31.966542 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:31.967205 (+ 663us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:31.967749 (+ 544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:31.967756 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:31.967760 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:31.968043 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:31.968975 (+ 932us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:31.968980 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:31.969302 (+ 322us) client_negotiation.cc:769] Sending connection context
0808 02:31:31.970718 (+ 1416us) client_negotiation.cc:240] Negotiation successful
0808 02:31:31.971162 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1096,"mutex_wait_us":36,"thread_start_us":909,"threads_started":1}
I20260808 02:31:31.977414 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 2280
I20260808 02:31:31.990619 3338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.949696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48636 (local address 127.24.116.252:40613)
0808 02:31:31.949877 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:31.949884 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:31.967298 (+ 17414us) server_negotiation.cc:407] Connection header received
0808 02:31:31.967504 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:31.967509 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:31.967591 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:31.967657 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:31.969207 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.970436 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.973367 (+ 2931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.974184 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.974292 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.977790 (+ 3498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:31.977796 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:31.977801 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:31.977834 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:31.983433 (+ 5599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.986245 (+ 2812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.986253 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.986259 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.986448 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.988411 (+ 1963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.988419 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.988426 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.988888 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:31.989085 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:31.989712 (+ 627us) server_negotiation.cc:299] Negotiation successful
0808 02:31:31.990008 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 02:31:31.992862 3261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.947951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35096 (local address 127.24.116.253:33605)
0808 02:31:31.948356 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:31.948363 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:31.960452 (+ 12089us) server_negotiation.cc:407] Connection header received
0808 02:31:31.960947 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:31.960954 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:31.961060 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:31.961143 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:31.963008 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.964460 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.967380 (+ 2920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.968331 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.968451 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.971528 (+ 3077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:31.971535 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:31.971541 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:31.971585 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:31.975468 (+ 3883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.985155 (+ 9687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.985165 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.985172 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.985410 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:31.986924 (+ 1514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:31.986932 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:31.986940 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:31.987453 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:31.987623 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:31.992094 (+ 4471us) server_negotiation.cc:299] Negotiation successful
0808 02:31:31.992404 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230}
I20260808 02:31:31.994378 3379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.949415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:40613 (local address 127.0.0.1:48636)
0808 02:31:31.967190 (+ 17775us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:31.967210 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:31.967385 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:31.967969 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:31.967974 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:31.968666 (+ 692us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:31.969051 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.969068 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.971155 (+ 2087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.971160 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.973210 (+ 2050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.973226 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.974633 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.974643 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.974851 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.976211 (+ 1360us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:31.976235 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:31.977619 (+ 1384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:31.983613 (+ 5994us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:31.983621 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:31.983628 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:31.986103 (+ 2475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:31.986612 (+ 509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:31.986620 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:31.986625 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:31.986773 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:31.989162 (+ 2389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:31.989168 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:31.989383 (+ 215us) client_negotiation.cc:769] Sending connection context
0808 02:31:31.993362 (+ 3979us) client_negotiation.cc:240] Negotiation successful
0808 02:31:31.993652 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17616,"thread_start_us":11073,"threads_started":1}
I20260808 02:31:31.995472 3380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.948456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:33605 (local address 127.0.0.1:35096)
0808 02:31:31.960284 (+ 11828us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:31.960333 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:31.960735 (+ 402us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:31.961440 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:31.961445 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:31.962328 (+ 883us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:31.962782 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.962799 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.964676 (+ 1877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.964684 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.967191 (+ 2507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.967203 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.968788 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.968801 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.969061 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.969915 (+ 854us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:31.969941 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:31.971268 (+ 1327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:31.975642 (+ 4374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:31.975648 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:31.975651 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:31.984953 (+ 9302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:31.985602 (+ 649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:31.985610 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:31.985616 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:31.985838 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:31.987746 (+ 1908us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:31.987754 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:31.988055 (+ 301us) client_negotiation.cc:769] Sending connection context
0808 02:31:31.994687 (+ 6632us) client_negotiation.cc:240] Negotiation successful
0808 02:31:31.995014 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11642,"mutex_wait_us":25,"thread_start_us":17071,"threads_started":1}
Aug 08 02:31:31 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156288, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.254@KRBTEST.COM for oryx/127.24.116.252@KRBTEST.COM
I20260808 02:31:32.009796 3338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.980114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48642 (local address 127.24.116.252:40613)
0808 02:31:31.991251 (+ 11137us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:31.991258 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:31.991281 (+ 23us) server_negotiation.cc:407] Connection header received
0808 02:31:31.991431 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:31.991439 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:31.991587 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:31.991702 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:31.992712 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.993814 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.995784 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.997000 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.000739 (+ 3739us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:32.002337 (+ 1598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:32.002345 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:32.002351 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:32.002405 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:32.006539 (+ 4134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:32.007524 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:32.007530 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:32.007533 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:32.007680 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:32.008163 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:32.008166 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:32.008168 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:32.008594 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:32.008755 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:32.009184 (+ 429us) server_negotiation.cc:299] Negotiation successful
0808 02:31:32.009423 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10996,"thread_start_us":24110,"threads_started":1}
I20260808 02:31:32.009797 3260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.979305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:40613 (local address 127.0.0.1:48642)
0808 02:31:31.979730 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:31.979753 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:31.979871 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:31.991754 (+ 11883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:31.991760 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:31.992321 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:31.992518 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.992531 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.994026 (+ 1495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.994032 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.995517 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:31.995535 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:31.997817 (+ 2282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:31.997823 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:31.998014 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:31.999271 (+ 1257us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:31.999295 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:32.002112 (+ 2817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:32.006703 (+ 4591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:32.006709 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:32.006712 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:32.007351 (+ 639us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:32.007801 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:32.007806 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:32.007810 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:32.008009 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:32.008736 (+ 727us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:32.008741 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:32.008913 (+ 172us) client_negotiation.cc:769] Sending connection context
0808 02:31:32.009065 (+ 152us) client_negotiation.cc:240] Negotiation successful
0808 02:31:32.009388 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284}
I20260808 02:31:32.011739 2182 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.24.116.252:40613: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "146343da39844d15be75c5d54005a43b"
member_type: NON_VOTER
last_known_addr {
host: "127.24.116.252"
port: 40613
}
attrs {
promote: true
}
}
dest_uuid: "1411d8b83e714c8d9b40fa837fc7c233"
cas_config_opid_index: 5
I20260808 02:31:32.012990 2182 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: NON_VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: true } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: NON_VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: true } }
I20260808 02:31:32.015117 3255 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 146343da39844d15be75c5d54005a43b (127.24.116.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: NON_VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: true } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: NON_VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: true } } }
Aug 08 02:31:32 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.116.193@KRBTEST.COM
I20260808 02:31:32.017379 3151 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 1 LEARNER]: Refusing update from remote peer 1411d8b83e714c8d9b40fa837fc7c233: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 02:31:32.021863 3255 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.24.116.252:40613
I20260808 02:31:32.025890 3292 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:32.027894 3381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:31.979072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37066 (local address 127.24.116.193:35417)
0808 02:31:32.003279 (+ 24207us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:32.003289 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:32.003322 (+ 33us) server_negotiation.cc:407] Connection header received
0808 02:31:32.003419 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:32.003435 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:32.003801 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:32.004014 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:32.006185 (+ 2171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:32.007950 (+ 1765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.009946 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:32.011433 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.011627 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:32.017937 (+ 6310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:32.017956 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:32.017976 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:32.018032 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:32.022299 (+ 4267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:32.023591 (+ 1292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:32.023606 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:32.023613 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:32.023908 (+ 295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:32.024570 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:32.024574 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:32.024577 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:32.025062 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:32.026837 (+ 1775us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:32.027034 (+ 197us) server_negotiation.cc:299] Negotiation successful
0808 02:31:32.027461 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23998,"thread_start_us":23796,"threads_started":1}
I20260808 02:31:32.028636 3078 master.cc:537] Master@127.24.116.252:40613 shutting down...
I20260808 02:31:32.030339 3292 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [term 1 FOLLOWER]: Refusing update from remote peer 1411d8b83e714c8d9b40fa837fc7c233: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 02:31:32.033149 2479 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:32.036818 3383 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "510b7389184341aebda800270f395f34" member_type: NON_VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260808 02:31:32.038839 3255 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: NON_VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:31:32.039441 3383 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1411d8b83e714c8d9b40fa837fc7c233" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: NON_VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: true } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: NON_VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: true } } }
I20260808 02:31:32.039758 3383 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:32.044679 3078 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:31:32.045225 3078 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:32.045480 3078 tablet_replica.cc:330] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b: stopping tablet replica
I20260808 02:31:32.050254 3151 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 146343da39844d15be75c5d54005a43b (127.24.116.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: NON_VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: true } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: NON_VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: true } } }
I20260808 02:31:32.054960 3078 master.cc:552] Master@127.24.116.252:40613 shutdown complete.
I20260808 02:31:32.055058 3078 master_runner.cc:305] Clearing existing system tablet
I20260808 02:31:32.055063 3204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1411d8b83e714c8d9b40fa837fc7c233" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: NON_VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: true } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: NON_VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: true } } }
I20260808 02:31:32.055378 3204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [sys.catalog]: This master's current role is: LEARNER
I20260808 02:31:32.057327 3384 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233: attempting to promote NON_VOTER 510b7389184341aebda800270f395f34 to VOTER
I20260808 02:31:32.057646 3260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:32.056977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:40613 (local address 127.0.0.1:48658)
0808 02:31:32.057170 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:32.057299 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:40613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 02:31:32.058211 3384 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: NON_VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: true } }
I20260808 02:31:32.058634 3078 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:32.058763 3078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:32.060618 3151 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 1 LEARNER]: Refusing update from remote peer 1411d8b83e714c8d9b40fa837fc7c233: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 02:31:32.061257 3384 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 02:31:32.064929 3151 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 510b7389184341aebda800270f395f34 (127.24.116.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: NON_VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: true } } }
I20260808 02:31:32.066030 3078 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.002s sys 0.000s
I20260808 02:31:32.066254 3255 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 510b7389184341aebda800270f395f34 (127.24.116.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: NON_VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: true } } }
I20260808 02:31:32.069444 3260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:32.068994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:40613 (local address 127.0.0.1:48662)
0808 02:31:32.069182 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:32.069273 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:40613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 02:31:32.071208 3260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:32.070770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:40613 (local address 127.0.0.1:48672)
0808 02:31:32.070960 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:32.071042 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:40613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
W20260808 02:31:32.071491 2159 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 -> Peer 146343da39844d15be75c5d54005a43b (127.24.116.252:40613): Couldn't send request to peer 146343da39844d15be75c5d54005a43b. Status: Network error: Client connection negotiation failed: client connection to 127.24.116.252:40613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 02:31:32.075217 3204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1411d8b83e714c8d9b40fa837fc7c233" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: NON_VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: true } } }
I20260808 02:31:32.075495 3204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:31:32.076370 3383 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1411d8b83e714c8d9b40fa837fc7c233" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: NON_VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: true } } }
I20260808 02:31:32.076632 3393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:32.076682 3383 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:32.077128 3384 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1411d8b83e714c8d9b40fa837fc7c233" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: NON_VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: true } } }
I20260808 02:31:32.077350 3384 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:32.080616 3078 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:32.080979 3078 fs_manager.cc:725] Time spent opening block manager: real 0.014s user 0.004s sys 0.002s
I20260808 02:31:32.081127 3078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/wal
uuid: "146343da39844d15be75c5d54005a43b"
format_stamp: "Formatted at 2026-08-08 02:31:31 on dist-test-slave-45dx"
server_key: "674890de055c07b83841fc28105f0fa1"
server_key_iv: "ebb710b3b6d71eb48b442b715f0dce1b"
server_key_version: "encryptionkey@0"
I20260808 02:31:32.085078 3078 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:32.090317 3078 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 02:31:32.090512 3078 log.cc:1196] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 02:31:32.090972 3078 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b: Deleting consensus metadata
I20260808 02:31:32.091244 3078 master_runner.cc:315] Copying system tablet from 127.24.116.254:33319
I20260808 02:31:32.093909 3078 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b: tablet copy: Beginning tablet copy session from remote peer at address 127.24.116.254:33319
I20260808 02:31:32.107981 3344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:32.095107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50474 (local address 127.24.116.254:33319)
0808 02:31:32.095359 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:32.095365 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:32.095487 (+ 122us) server_negotiation.cc:407] Connection header received
0808 02:31:32.095847 (+ 360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:32.095852 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:32.095920 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:32.096036 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:32.097085 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:32.098049 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.099317 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:32.099801 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.099947 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:32.101965 (+ 2018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:32.101972 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:32.101976 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:32.102019 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:32.105275 (+ 3256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:32.105928 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:32.105935 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:32.105938 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:32.106074 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:32.106485 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:32.106492 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:32.106495 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:32.106792 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:32.106955 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:32.107374 (+ 419us) server_negotiation.cc:299] Negotiation successful
0808 02:31:32.107598 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134}
I20260808 02:31:32.108461 3403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:32.094711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.0.0.1:50474)
0808 02:31:32.095373 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:32.095397 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:32.095653 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:32.096066 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:32.096071 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:32.096593 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:32.096934 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:32.096946 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:32.098206 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.098211 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:32.099160 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:32.099177 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:32.099964 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.099970 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:32.100247 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:32.101003 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:32.101021 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:32.101746 (+ 725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:32.105421 (+ 3675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:32.105427 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:32.105431 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:32.105805 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:32.106194 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:32.106198 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:32.106209 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:32.106365 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:32.106918 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:32.106923 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:32.107095 (+ 172us) client_negotiation.cc:769] Sending connection context
0808 02:31:32.107248 (+ 153us) client_negotiation.cc:240] Negotiation successful
0808 02:31:32.107590 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":664,"threads_started":1}
I20260808 02:31:32.109117 2220 tablet_copy_service.cc:140] P 1411d8b83e714c8d9b40fa837fc7c233: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 146343da39844d15be75c5d54005a43b ({username='oryx', principal='oryx/127.24.116.252@KRBTEST.COM'} at 127.0.0.1:50474)
I20260808 02:31:32.109328 2220 tablet_copy_service.cc:161] P 1411d8b83e714c8d9b40fa837fc7c233: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 146343da39844d15be75c5d54005a43b at {username='oryx', principal='oryx/127.24.116.252@KRBTEST.COM'} at 127.0.0.1:50474: session id = 146343da39844d15be75c5d54005a43b-00000000000000000000000000000000
I20260808 02:31:32.111654 2220 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 02:31:32.113417 3078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 02:31:32.118604 3078 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b: tablet copy: Starting download of 0 data blocks...
I20260808 02:31:32.119020 3078 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b: tablet copy: Starting download of 1 WAL segments...
I20260808 02:31:32.121416 3078 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 02:31:32.124979 2220 tablet_copy_service.cc:342] P 1411d8b83e714c8d9b40fa837fc7c233: Request end of tablet copy session 146343da39844d15be75c5d54005a43b-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.24.116.252@KRBTEST.COM'} at 127.0.0.1:50474
I20260808 02:31:32.125123 2220 tablet_copy_service.cc:433] P 1411d8b83e714c8d9b40fa837fc7c233: ending tablet copy session 146343da39844d15be75c5d54005a43b-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 146343da39844d15be75c5d54005a43b
I20260808 02:31:32.135522 3078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:32.138134 3404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:32.145539 3405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:32.150430 3078 server_base.cc:1034] running on GCE node
W20260808 02:31:32.150391 3410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:32.151026 3078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:32.151803 3078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:32.153023 3078 hybrid_clock.cc:648] HybridClock initialized: now 1786156292152951 us; error 54 us; skew 500 ppm
I20260808 02:31:32.153313 3078 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:32 dist-test-slave-45dx krb5kdc[2113](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156292, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:32.155319 3078 init.cc:377] Logged in from keytab as oryx/127.24.116.252@KRBTEST.COM (short username oryx)
I20260808 02:31:32.157359 3078 webserver.cc:460] Webserver started at http://127.24.116.252:38077/ using document root <none> and password file <none>
I20260808 02:31:32.157673 3078 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:32.157788 3078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:32.160768 3078 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260808 02:31:32.162679 3418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:32.164768 3078 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260808 02:31:32.164906 3078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/wal
uuid: "146343da39844d15be75c5d54005a43b"
format_stamp: "Formatted at 2026-08-08 02:31:31 on dist-test-slave-45dx"
server_key: "674890de055c07b83841fc28105f0fa1"
server_key_iv: "ebb710b3b6d71eb48b442b715f0dce1b"
server_key_version: "encryptionkey@0"
I20260808 02:31:32.165108 3078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:32.186062 3078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:32.190124 3078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:32.204268 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 2280
I20260808 02:31:32.238914 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:35417
--local_ip_for_outbound_sockets=127.24.116.193
--tserver_master_addrs=127.24.116.254:33319
--webserver_port=41291
--webserver_interface=127.24.116.193
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.193.keytab
--principal=oryx/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:45137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.24.116.254:33319,127.24.116.253:33605
--tserver_master_addrs=127.24.116.254:33319,127.24.116.253:33605,127.24.116.252:40613 with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:31:32.240983 3078 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.252:40613
I20260808 02:31:32.241032 3492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.252:40613 every 8 connection(s)
I20260808 02:31:32.242326 3078 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/master-2/data/info.pb
I20260808 02:31:32.247875 3494 sys_catalog.cc:263] Verifying existing consensus state
I20260808 02:31:32.251994 3494 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b: Bootstrap starting.
I20260808 02:31:32.273818 3494 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 02:31:32.274506 3494 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b: Bootstrap complete.
I20260808 02:31:32.275854 3494 raft_consensus.cc:348] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: NON_VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: true } }
I20260808 02:31:32.276216 3494 raft_consensus.cc:729] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 146343da39844d15be75c5d54005a43b, State: Initialized, Role: LEARNER
I20260808 02:31:32.276618 3494 consensus_queue.cc:260] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: NON_VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: true } }
I20260808 02:31:32.279181 3499 sys_catalog.cc:455] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: NON_VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: true } } }
I20260808 02:31:32.279536 3499 sys_catalog.cc:458] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [sys.catalog]: This master's current role is: LEARNER
I20260808 02:31:32.279771 3494 sys_catalog.cc:564] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:31:32.288722 3516 catalog_manager.cc:1259] Loaded cluster ID: afa59ea266074dd092f572db28a4a4ea
I20260808 02:31:32.288873 3516 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b: loading cluster ID for follower catalog manager: success
I20260808 02:31:32.292925 3516 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b: acquiring CA information for follower catalog manager: success
I20260808 02:31:32.295555 3516 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 02:31:32.550369 3260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:32.543914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:40613 (local address 127.0.0.1:52428)
0808 02:31:32.544136 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:32.544154 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:32.544263 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:32.545091 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:32.545096 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:32.545128 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:32.545331 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:32.545341 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:32.546773 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.546779 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:32.548127 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:32.548141 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:32.549457 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.549464 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:32.549692 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:32.549735 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 02:31:32.549865 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 02:31:32.550034 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 02:31:32.550575 3517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:32.544095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52428 (local address 127.24.116.252:40613)
0808 02:31:32.544748 (+ 653us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:32.544753 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:32.544770 (+ 17us) server_negotiation.cc:407] Connection header received
0808 02:31:32.544834 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:32.544838 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:32.544920 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:32.545062 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:32.545515 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:32.546605 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.548294 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:32.549247 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.549485 (+ 238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:32.549705 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:32.549900 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 02:31:32.550046 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":386,"threads_started":1}
I20260808 02:31:32.551630 3456 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260808 02:31:32.552444 3499 sys_catalog.cc:455] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1411d8b83e714c8d9b40fa837fc7c233. Latest consensus state: current_term: 1 leader_uuid: "1411d8b83e714c8d9b40fa837fc7c233" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: NON_VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: true } } }
I20260808 02:31:32.552804 3499 sys_catalog.cc:458] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [sys.catalog]: This master's current role is: LEARNER
W20260808 02:31:32.646014 3496 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:32.646344 3496 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:32.646538 3496 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:32.654510 3496 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:32.654631 3496 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:32.654752 3496 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:31:32.665446 3496 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:45137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.193.keytab
--principal=oryx/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:35417
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=41291
--tserver_master_addrs=127.24.116.254:33319,127.24.116.253:33605,127.24.116.252:40613
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:32.667011 3496 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:32.668627 3496 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:32.683104 3525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:32.683081 3526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:32.683730 3528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:32.684373 3496 server_base.cc:1034] running on GCE node
I20260808 02:31:32.685158 3496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:32.686188 3496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:32.687448 3496 hybrid_clock.cc:648] HybridClock initialized: now 1786156292687399 us; error 53 us; skew 500 ppm
I20260808 02:31:32.687889 3496 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:32 dist-test-slave-45dx krb5kdc[2113](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156292, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:32.691663 3496 init.cc:377] Logged in from keytab as oryx/127.24.116.193@KRBTEST.COM (short username oryx)
I20260808 02:31:32.693490 3496 webserver.cc:460] Webserver started at http://127.24.116.193:41291/ using document root <none> and password file <none>
I20260808 02:31:32.694240 3496 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:32.694371 3496 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:32.700361 3496 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 02:31:32.703696 3541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:32.705701 3496 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260808 02:31:32.705873 3496 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e"
format_stamp: "Formatted at 2026-08-08 02:31:29 on dist-test-slave-45dx"
server_key: "e7cb3ddd1aa76d647b4e5ca73ee5a979"
server_key_iv: "33c5b38a939a053fd65983db8742053d"
server_key_version: "encryptionkey@0"
I20260808 02:31:32.706918 3496 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:32.727440 3496 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:32.731766 3496 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:32.732041 3496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:32.733265 3496 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:32.734922 3496 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:32.735018 3496 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:32.735107 3496 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:32.735169 3496 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:32.781893 3496 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:35417
I20260808 02:31:32.781976 3715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:35417 every 8 connection(s)
I20260808 02:31:32.783522 3496 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:31:32.787122 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 3496
I20260808 02:31:32.787585 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 2496
Aug 08 02:31:32 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156292, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.253@KRBTEST.COM
I20260808 02:31:32.832494 3723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:32.786845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:55333 (local address 127.24.116.253:33605)
0808 02:31:32.788972 (+ 2127us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:32.788983 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:32.792499 (+ 3516us) server_negotiation.cc:407] Connection header received
0808 02:31:32.797238 (+ 4739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:32.797249 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:32.797422 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:32.797537 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:32.801293 (+ 3756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:32.803050 (+ 1757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.806960 (+ 3910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:32.808225 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.808413 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:32.819988 (+ 11575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:32.820000 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:32.820009 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:32.820079 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:32.828105 (+ 8026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:32.829451 (+ 1346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:32.829458 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:32.829462 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:32.829620 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:32.830234 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:32.830240 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:32.830243 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:32.830608 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:32.830749 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:32.831802 (+ 1053us) server_negotiation.cc:299] Negotiation successful
0808 02:31:32.832048 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1938,"thread_start_us":1764,"threads_started":1}
I20260808 02:31:32.835970 3726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:32.787481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:33605 (local address 127.24.116.193:55333)
0808 02:31:32.792236 (+ 4755us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:32.792337 (+ 101us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:32.796746 (+ 4409us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:32.798381 (+ 1635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:32.798399 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:32.799536 (+ 1137us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:32.800952 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:32.800994 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:32.803391 (+ 2397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.803401 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:32.806709 (+ 3308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:32.806734 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:32.809045 (+ 2311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.809058 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:32.809658 (+ 600us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:32.810735 (+ 1077us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:32.810779 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:32.816425 (+ 5646us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:32.828348 (+ 11923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:32.828360 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:32.828379 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:32.829264 (+ 885us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:32.829770 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:32.829775 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:32.829779 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:32.830100 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:32.830861 (+ 761us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:32.830869 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:32.831370 (+ 501us) client_negotiation.cc:769] Sending connection context
0808 02:31:32.833155 (+ 1785us) client_negotiation.cc:240] Negotiation successful
0808 02:31:32.833786 (+ 631us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4393,"thread_start_us":37005,"threads_started":1}
Aug 08 02:31:32 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156292, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.252@KRBTEST.COM
I20260808 02:31:32.838235 3718 heartbeater.cc:347] Connected to a master server at 127.24.116.253:33605
I20260808 02:31:32.838688 3718 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:32.839934 3718 heartbeater.cc:511] Master 127.24.116.253:33605 requested a full tablet report, sending...
I20260808 02:31:32.842767 3134 ts_manager.cc:194] Registered new tserver with Master: 5ae9c4be9bb94fecaf86e3c0c4311f1e (127.24.116.193:35417)
Aug 08 02:31:32 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.116.194@KRBTEST.COM
Aug 08 02:31:32 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156292, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM
I20260808 02:31:32.852550 3517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:32.787819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:39587 (local address 127.24.116.252:40613)
0808 02:31:32.792218 (+ 4399us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:32.792224 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:32.817218 (+ 24994us) server_negotiation.cc:407] Connection header received
0808 02:31:32.817592 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:32.817602 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:32.817725 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:32.817822 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:32.821869 (+ 4047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:32.825462 (+ 3593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.831659 (+ 6197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:32.832773 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.832934 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:32.845205 (+ 12271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:32.845215 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:32.845224 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:32.845280 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:32.849024 (+ 3744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:32.850022 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:32.850029 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:32.850036 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:32.850199 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:32.850721 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:32.850728 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:32.850733 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:32.851165 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:32.851321 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:32.851860 (+ 539us) server_negotiation.cc:299] Negotiation successful
0808 02:31:32.852122 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4256}
I20260808 02:31:32.852566 3731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:32.787481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:40613 (local address 127.24.116.193:39587)
0808 02:31:32.817062 (+ 29581us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:32.817091 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:32.817394 (+ 303us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:32.818147 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:32.818154 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:32.819062 (+ 908us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:32.819560 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:32.819577 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:32.828894 (+ 9317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.828904 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:32.831402 (+ 2498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:32.831423 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:32.833426 (+ 2003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.833438 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:32.833746 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:32.834637 (+ 891us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:32.834674 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:32.844837 (+ 10163us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:32.849207 (+ 4370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:32.849212 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:32.849216 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:32.849823 (+ 607us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:32.850360 (+ 537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:32.850366 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:32.850371 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:32.850537 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:32.851325 (+ 788us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:32.851331 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:32.851511 (+ 180us) client_negotiation.cc:769] Sending connection context
0808 02:31:32.851718 (+ 207us) client_negotiation.cc:240] Negotiation successful
0808 02:31:32.852051 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29343,"mutex_wait_us":631,"thread_start_us":3489,"threads_started":1}
I20260808 02:31:32.853626 3716 heartbeater.cc:347] Connected to a master server at 127.24.116.252:40613
I20260808 02:31:32.853783 3716 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:32.854331 3716 heartbeater.cc:511] Master 127.24.116.252:40613 requested a full tablet report, sending...
I20260808 02:31:32.855789 3725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:32.792728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.24.116.193:59781)
0808 02:31:32.824898 (+ 32170us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:32.824921 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:32.825075 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:32.838517 (+ 13442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:32.838525 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:32.839411 (+ 886us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:32.839926 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:32.839942 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:32.841490 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.841499 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:32.843202 (+ 1703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:32.843217 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:32.844485 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.844498 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:32.844696 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:32.845319 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:32.845345 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:32.848285 (+ 2940us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:32.852337 (+ 4052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:32.852344 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:32.852349 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:32.853327 (+ 978us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:32.853836 (+ 509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:32.853842 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:32.853848 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:32.854028 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:32.854702 (+ 674us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:32.854708 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:32.854885 (+ 177us) client_negotiation.cc:769] Sending connection context
0808 02:31:32.855025 (+ 140us) client_negotiation.cc:240] Negotiation successful
0808 02:31:32.855316 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32036,"spinlock_wait_cycles":21248,"thread_start_us":17850,"threads_started":1}
I20260808 02:31:32.855949 3734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:32.793423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55644 (local address 127.24.116.194:46137)
0808 02:31:32.824101 (+ 30678us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:32.824114 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:32.833039 (+ 8925us) server_negotiation.cc:407] Connection header received
0808 02:31:32.833358 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:32.833367 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:32.833647 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:32.833806 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:32.836412 (+ 2606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:32.838080 (+ 1668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.840194 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:32.841034 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.841158 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:32.847752 (+ 6594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:32.847771 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:32.847789 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:32.847836 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:32.851849 (+ 4013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:32.852874 (+ 1025us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:32.852883 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:32.852886 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:32.853072 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:32.853549 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:32.853554 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:32.853557 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:32.853988 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:32.854301 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:32.855216 (+ 915us) server_negotiation.cc:299] Negotiation successful
0808 02:31:32.855496 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30439,"thread_start_us":30707,"threads_started":1}
I20260808 02:31:32.856040 3445 ts_manager.cc:194] Registered new tserver with Master: 5ae9c4be9bb94fecaf86e3c0c4311f1e (127.24.116.193:35417)
I20260808 02:31:32.856674 3733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:32.792898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:59781 (local address 127.24.116.254:33319)
0808 02:31:32.838145 (+ 45247us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:32.838153 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:32.838173 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:31:32.838234 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:32.838238 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:32.838320 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:32.838477 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:32.840222 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:32.841294 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.843388 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:32.844026 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:32.844157 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:32.848546 (+ 4389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:32.848550 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:32.848553 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:32.848590 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:32.852154 (+ 3564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:32.853515 (+ 1361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:32.853520 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:32.853523 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:32.853693 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:32.854185 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:32.854192 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:32.854195 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:32.854560 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:32.854712 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:32.856153 (+ 1441us) server_negotiation.cc:299] Negotiation successful
0808 02:31:32.856418 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45118,"thread_start_us":45301,"threads_started":1}
I20260808 02:31:32.857564 3717 heartbeater.cc:347] Connected to a master server at 127.24.116.254:33319
I20260808 02:31:32.857581 2690 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:32.857717 3717 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:32.858263 3717 heartbeater.cc:511] Master 127.24.116.254:33319 requested a full tablet report, sending...
I20260808 02:31:32.859711 2182 ts_manager.cc:194] Re-registered known tserver with Master: 5ae9c4be9bb94fecaf86e3c0c4311f1e (127.24.116.193:35417)
I20260808 02:31:32.860808 2182 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.116.193@KRBTEST.COM'} at 127.24.116.193:59781
I20260808 02:31:32.950557 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 2496
I20260808 02:31:32.977255 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:46137
--local_ip_for_outbound_sockets=127.24.116.194
--tserver_master_addrs=127.24.116.254:33319
--webserver_port=40119
--webserver_interface=127.24.116.194
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.194.keytab
--principal=oryx/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:45137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.24.116.254:33319,127.24.116.253:33605
--tserver_master_addrs=127.24.116.254:33319,127.24.116.253:33605,127.24.116.252:40613 with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:31:33.005288 3384 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1411d8b83e714c8d9b40fa837fc7c233" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: NON_VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: true } } }
I20260808 02:31:33.005784 3384 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:33.007251 3738 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233: attempting to promote NON_VOTER 146343da39844d15be75c5d54005a43b to VOTER
I20260808 02:31:33.007908 3738 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: false } }
I20260808 02:31:33.009864 3456 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [term 1 LEARNER]: Refusing update from remote peer 1411d8b83e714c8d9b40fa837fc7c233: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260808 02:31:33.009917 3151 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 1 FOLLOWER]: Refusing update from remote peer 1411d8b83e714c8d9b40fa837fc7c233: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260808 02:31:33.010530 3739 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 02:31:33.011085 3738 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 02:31:33.014021 3739 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 146343da39844d15be75c5d54005a43b (127.24.116.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: false } } }
I20260808 02:31:33.017063 3151 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 146343da39844d15be75c5d54005a43b (127.24.116.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: false } } }
I20260808 02:31:33.018428 3739 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1411d8b83e714c8d9b40fa837fc7c233" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: false } } }
I20260808 02:31:33.018678 3739 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:33.019007 3739 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1411d8b83e714c8d9b40fa837fc7c233" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: false } } }
I20260808 02:31:33.019205 3739 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:33.024184 3747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1411d8b83e714c8d9b40fa837fc7c233" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: false } } }
I20260808 02:31:33.024703 3747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:31:33.025131 3739 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1411d8b83e714c8d9b40fa837fc7c233" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: false } } }
I20260808 02:31:33.025409 3739 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:33.025806 3456 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 146343da39844d15be75c5d54005a43b (127.24.116.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: false } } }
I20260808 02:31:33.029032 3499 sys_catalog.cc:455] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1411d8b83e714c8d9b40fa837fc7c233" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: false } } }
I20260808 02:31:33.029307 3499 sys_catalog.cc:458] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [sys.catalog]: This master's current role is: FOLLOWER
W20260808 02:31:33.338114 3737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:33.338420 3737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:33.338526 3737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:33.346328 3737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:33.346432 3737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:33.346560 3737 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:31:33.356662 3737 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:45137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.194.keytab
--principal=oryx/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:46137
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=40119
--tserver_master_addrs=127.24.116.254:33319,127.24.116.253:33605,127.24.116.252:40613
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:33.358004 3737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:33.359268 3737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:33.372921 3754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:33.372876 3753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:33.372953 3756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:33.373891 3737 server_base.cc:1034] running on GCE node
I20260808 02:31:33.374616 3737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:33.375559 3737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:33.376811 3737 hybrid_clock.cc:648] HybridClock initialized: now 1786156293376777 us; error 45 us; skew 500 ppm
I20260808 02:31:33.377137 3737 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:33 dist-test-slave-45dx krb5kdc[2113](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156293, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:33.380697 3737 init.cc:377] Logged in from keytab as oryx/127.24.116.194@KRBTEST.COM (short username oryx)
I20260808 02:31:33.382189 3737 webserver.cc:460] Webserver started at http://127.24.116.194:40119/ using document root <none> and password file <none>
I20260808 02:31:33.382937 3737 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:33.383098 3737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:33.388667 3737 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:31:33.391323 3769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:33.392817 3737 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:31:33.392987 3737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "d20264ccdfeb48978ef42511d9424140"
format_stamp: "Formatted at 2026-08-08 02:31:29 on dist-test-slave-45dx"
server_key: "ee430ad1fbd0e5c19e4ed05e0d496dd6"
server_key_iv: "3a50ab680ba1af563dcf4c196989c2a8"
server_key_version: "encryptionkey@0"
I20260808 02:31:33.393970 3737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:33.418172 3737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:33.422735 3737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:33.423041 3737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:33.424077 3737 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:33.425520 3737 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:33.425614 3737 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:33.425755 3737 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:33.425861 3737 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:33.462230 3737 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:46137
I20260808 02:31:33.462342 3941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:46137 every 8 connection(s)
I20260808 02:31:33.463745 3737 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:31:33.466478 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 3737
I20260808 02:31:33.466828 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 2708
Aug 08 02:31:33 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156293, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.253@KRBTEST.COM
Aug 08 02:31:33 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156293, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.252@KRBTEST.COM
Aug 08 02:31:33 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.116.195@KRBTEST.COM
Aug 08 02:31:33 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156293, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM
I20260808 02:31:33.513552 3950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:33.467599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:57451 (local address 127.24.116.253:33605)
0808 02:31:33.480010 (+ 12411us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:33.480020 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:33.485716 (+ 5696us) server_negotiation.cc:407] Connection header received
0808 02:31:33.485816 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:33.485825 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:33.485940 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:33.486069 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:33.489987 (+ 3918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:33.491595 (+ 1608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:33.495328 (+ 3733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:33.496233 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:33.496393 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:33.503412 (+ 7019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:33.503421 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:33.503428 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:33.503492 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:33.508202 (+ 4710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:33.509700 (+ 1498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:33.509707 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:33.509711 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:33.509867 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:33.511464 (+ 1597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:33.511470 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:33.511473 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:33.511874 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:33.512038 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:33.512862 (+ 824us) server_negotiation.cc:299] Negotiation successful
0808 02:31:33.513129 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12213,"thread_start_us":12425,"threads_started":1}
I20260808 02:31:33.514649 3949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:33.466718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:51105 (local address 127.24.116.252:40613)
0808 02:31:33.492286 (+ 25568us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:33.492293 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:33.492332 (+ 39us) server_negotiation.cc:407] Connection header received
0808 02:31:33.492393 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:33.492400 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:33.492490 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:33.494098 (+ 1608us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:33.494292 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:33.495662 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:33.497911 (+ 2249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:33.498777 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:33.498909 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:33.503564 (+ 4655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:33.503570 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:33.503575 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:33.503615 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:33.508278 (+ 4663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:33.510129 (+ 1851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:33.510138 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:33.510142 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:33.510328 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:33.510836 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:33.510841 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:33.510845 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:33.511353 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:33.511523 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:33.513968 (+ 2445us) server_negotiation.cc:299] Negotiation successful
0808 02:31:33.514206 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25450,"thread_start_us":25314,"threads_started":1}
I20260808 02:31:33.515620 3953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:33.467541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:33605 (local address 127.24.116.194:57451)
0808 02:31:33.481613 (+ 14072us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:33.481655 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:33.485201 (+ 3546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:33.487489 (+ 2288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:33.487506 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:33.488617 (+ 1111us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:33.489707 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:33.489739 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:33.491897 (+ 2158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:33.491906 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:33.495078 (+ 3172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:33.495100 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:33.496837 (+ 1737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:33.496846 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:33.497342 (+ 496us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:33.498506 (+ 1164us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:33.498536 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:33.503109 (+ 4573us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:33.508461 (+ 5352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:33.508466 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:33.508486 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:33.509530 (+ 1044us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:33.511039 (+ 1509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:33.511044 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:33.511048 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:33.511294 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:33.512130 (+ 836us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:33.512135 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:33.512361 (+ 226us) client_negotiation.cc:769] Sending connection context
0808 02:31:33.513784 (+ 1423us) client_negotiation.cc:240] Negotiation successful
0808 02:31:33.514114 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13798,"spinlock_wait_cycles":27904,"thread_start_us":18749,"threads_started":1}
I20260808 02:31:33.515661 3952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:33.468137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:40613 (local address 127.24.116.194:51105)
0808 02:31:33.486795 (+ 18658us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:33.486821 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:33.486973 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:33.492694 (+ 5721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:33.492699 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:33.493540 (+ 841us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:33.493915 (+ 375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:33.493933 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:33.495856 (+ 1923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:33.495862 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:33.497669 (+ 1807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:33.497700 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:33.498996 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:33.499004 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:33.499178 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:33.499874 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:33.499904 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:33.503362 (+ 3458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:33.508455 (+ 5093us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:33.508466 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:33.508486 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:33.509546 (+ 1060us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:33.510461 (+ 915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:33.510466 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:33.510470 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:33.510693 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:33.511605 (+ 912us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:33.511614 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:33.512253 (+ 639us) client_negotiation.cc:769] Sending connection context
0808 02:31:33.512681 (+ 428us) client_negotiation.cc:240] Negotiation successful
0808 02:31:33.513264 (+ 583us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18478,"thread_start_us":12981,"threads_started":1}
I20260808 02:31:33.517552 3943 heartbeater.cc:347] Connected to a master server at 127.24.116.252:40613
I20260808 02:31:33.517905 3943 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:33.518285 3955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:33.468406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59238 (local address 127.24.116.195:38969)
0808 02:31:33.489959 (+ 21553us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:33.489970 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:33.490893 (+ 923us) server_negotiation.cc:407] Connection header received
0808 02:31:33.490996 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:33.491009 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:33.491347 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:33.491530 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:33.494816 (+ 3286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:33.496514 (+ 1698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:33.499106 (+ 2592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:33.500331 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:33.500469 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:33.507134 (+ 6665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:33.507152 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:33.507172 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:33.507233 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:33.512876 (+ 5643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:33.514103 (+ 1227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:33.514113 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:33.514116 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:33.514286 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:33.515005 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:33.515010 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:33.515013 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:33.515501 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:33.517379 (+ 1878us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:33.517583 (+ 204us) server_negotiation.cc:299] Negotiation successful
0808 02:31:33.517859 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21251,"thread_start_us":21068,"threads_started":1}
I20260808 02:31:33.518870 3943 heartbeater.cc:511] Master 127.24.116.252:40613 requested a full tablet report, sending...
I20260808 02:31:33.519685 3946 heartbeater.cc:347] Connected to a master server at 127.24.116.253:33605
I20260808 02:31:33.519722 2909 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:33.519855 3946 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:33.520516 3946 heartbeater.cc:511] Master 127.24.116.253:33605 requested a full tablet report, sending...
I20260808 02:31:33.521075 3445 ts_manager.cc:194] Registered new tserver with Master: d20264ccdfeb48978ef42511d9424140 (127.24.116.194:46137)
I20260808 02:31:33.521795 3134 ts_manager.cc:194] Registered new tserver with Master: d20264ccdfeb48978ef42511d9424140 (127.24.116.194:46137)
I20260808 02:31:33.522619 3958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:33.482674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:40293 (local address 127.24.116.254:33319)
0808 02:31:33.498251 (+ 15577us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:33.498258 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:33.499120 (+ 862us) server_negotiation.cc:407] Connection header received
0808 02:31:33.499189 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:33.499197 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:33.499274 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:33.500326 (+ 1052us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:33.501955 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:33.503623 (+ 1668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:33.505985 (+ 2362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:33.506644 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:33.507420 (+ 776us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:33.511098 (+ 3678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:33.511106 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:33.511110 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:33.511154 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:33.515033 (+ 3879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:33.516364 (+ 1331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:33.516371 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:33.516374 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:33.516547 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:33.517564 (+ 1017us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:33.517571 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:33.517575 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:33.517916 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:33.518080 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:33.521960 (+ 3880us) server_negotiation.cc:299] Negotiation successful
0808 02:31:33.522223 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15432,"thread_start_us":15333,"threads_started":1}
I20260808 02:31:33.522672 3957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:33.482548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.24.116.194:40293)
0808 02:31:33.488916 (+ 6368us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:33.488937 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:33.489064 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:33.499451 (+ 10387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:33.499457 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:33.501171 (+ 1714us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:33.501715 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:33.501752 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:33.504358 (+ 2606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:33.504366 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:33.505785 (+ 1419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:33.505802 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:33.506878 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:33.506884 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:33.507084 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:33.507688 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:33.507710 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:33.510794 (+ 3084us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:33.515539 (+ 4745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:33.515547 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:33.515553 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:33.516139 (+ 586us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:33.516873 (+ 734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:33.516880 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:33.516884 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:33.517056 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:33.521407 (+ 4351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:33.521413 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:33.521560 (+ 147us) client_negotiation.cc:769] Sending connection context
0808 02:31:33.521822 (+ 262us) client_negotiation.cc:240] Negotiation successful
0808 02:31:33.522140 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6212,"thread_start_us":6574,"threads_started":1}
I20260808 02:31:33.523824 3944 heartbeater.cc:347] Connected to a master server at 127.24.116.254:33319
I20260808 02:31:33.523986 3944 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:33.524710 3944 heartbeater.cc:511] Master 127.24.116.254:33319 requested a full tablet report, sending...
I20260808 02:31:33.526034 2182 ts_manager.cc:194] Re-registered known tserver with Master: d20264ccdfeb48978ef42511d9424140 (127.24.116.194:46137)
I20260808 02:31:33.526854 2182 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.116.194@KRBTEST.COM'} at 127.24.116.194:40293
I20260808 02:31:33.611018 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 2708
I20260808 02:31:33.634613 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:38969
--local_ip_for_outbound_sockets=127.24.116.195
--tserver_master_addrs=127.24.116.254:33319
--webserver_port=35619
--webserver_interface=127.24.116.195
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.195.keytab
--principal=oryx/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:45137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.24.116.254:33319,127.24.116.253:33605
--tserver_master_addrs=127.24.116.254:33319,127.24.116.253:33605,127.24.116.252:40613 with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:31:33.864348 3717 heartbeater.cc:503] Master 127.24.116.254:33319 was elected leader, sending a full tablet report...
W20260808 02:31:33.992806 3960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:33.993141 3960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:33.993239 3960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:34.000943 3960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:34.001101 3960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:34.001217 3960 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:31:34.011340 3960 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:45137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.195.keytab
--principal=oryx/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:38969
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=35619
--tserver_master_addrs=127.24.116.254:33319,127.24.116.253:33605,127.24.116.252:40613
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:34.012746 3960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:34.014034 3960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:34.028487 3966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:34.028463 3969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:34.028532 3971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:34.029417 3960 server_base.cc:1034] running on GCE node
I20260808 02:31:34.030105 3960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:34.031159 3960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:34.032418 3960 hybrid_clock.cc:648] HybridClock initialized: now 1786156294032361 us; error 51 us; skew 500 ppm
I20260808 02:31:34.032748 3960 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:34 dist-test-slave-45dx krb5kdc[2113](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156294, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:34.036098 3960 init.cc:377] Logged in from keytab as oryx/127.24.116.195@KRBTEST.COM (short username oryx)
I20260808 02:31:34.037704 3960 webserver.cc:460] Webserver started at http://127.24.116.195:35619/ using document root <none> and password file <none>
I20260808 02:31:34.038476 3960 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:34.038645 3960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:34.044234 3960 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260808 02:31:34.047003 3983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:34.048475 3960 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:31:34.048611 3960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "c79aa635d6bf4ca29c8396475ce17bfb"
format_stamp: "Formatted at 2026-08-08 02:31:30 on dist-test-slave-45dx"
server_key: "35d704dc49b47991bc3960a9d4dd0ff7"
server_key_iv: "6133a8d9d9cba0d44ff3a423b77c5cb5"
server_key_version: "encryptionkey@0"
I20260808 02:31:34.049595 3960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:34.063530 3960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:34.067953 3960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:34.068274 3960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:34.069398 3960 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:34.070766 3960 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:34.070858 3960 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:34.070977 3960 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:34.071076 3960 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:34.106817 3960 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:38969
I20260808 02:31:34.106909 4157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:38969 every 8 connection(s)
I20260808 02:31:34.108289 3960 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:31:34.111406 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 3960
Aug 08 02:31:34 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156294, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.252@KRBTEST.COM
Aug 08 02:31:34 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156294, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM
Aug 08 02:31:34 dist-test-slave-45dx krb5kdc[2113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156294, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.253@KRBTEST.COM
I20260808 02:31:34.156076 4165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:34.112385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:40613 (local address 127.24.116.195:44365)
0808 02:31:34.114389 (+ 2004us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:34.114465 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:34.124008 (+ 9543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:34.127123 (+ 3115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:34.127127 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:34.127969 (+ 842us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:34.129398 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:34.129431 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.131329 (+ 1898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.131335 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:34.133136 (+ 1801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:34.133150 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.135442 (+ 2292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.135452 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:34.135816 (+ 364us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:34.136820 (+ 1004us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:34.136856 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:34.141169 (+ 4313us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:34.148484 (+ 7315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:34.148500 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:34.148530 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:34.149365 (+ 835us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:34.150393 (+ 1028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:34.150400 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:34.150407 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:34.150779 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:34.152395 (+ 1616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:34.152405 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:34.152937 (+ 532us) client_negotiation.cc:769] Sending connection context
0808 02:31:34.153271 (+ 334us) client_negotiation.cc:240] Negotiation successful
0808 02:31:34.154106 (+ 835us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1601,"mutex_wait_us":192,"spinlock_wait_cycles":26880,"thread_start_us":3945,"threads_started":1}
I20260808 02:31:34.156128 4169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:34.113207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:44365 (local address 127.24.116.252:40613)
0808 02:31:34.126733 (+ 13526us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:34.126743 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:34.126766 (+ 23us) server_negotiation.cc:407] Connection header received
0808 02:31:34.126843 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:34.126850 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:34.126963 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:34.127086 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:34.129697 (+ 2611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.131126 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.133302 (+ 2176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.133924 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.134050 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:34.141507 (+ 7457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:34.141515 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:34.141520 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:34.141577 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:34.146884 (+ 5307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:34.149615 (+ 2731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:34.149625 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:34.149631 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:34.149826 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:34.151010 (+ 1184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:34.151018 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:34.151024 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:34.151510 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:34.155462 (+ 3952us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:34.155611 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 02:31:34.155846 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13352,"thread_start_us":13217,"threads_started":1}
I20260808 02:31:34.165839 4173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:34.113630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:33605 (local address 127.24.116.195:37073)
0808 02:31:34.121250 (+ 7620us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:34.121282 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:34.124014 (+ 2732us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:34.126487 (+ 2473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:34.126500 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:34.127970 (+ 1470us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:34.129419 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:34.129440 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.134670 (+ 5230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.134678 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:34.137778 (+ 3100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:34.137803 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.140248 (+ 2445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.140264 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:34.140500 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:34.142119 (+ 1619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:34.142151 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:34.145682 (+ 3531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:34.162093 (+ 16411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:34.162099 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:34.162103 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:34.162790 (+ 687us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:34.163325 (+ 535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:34.163331 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:34.163335 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:34.163498 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:34.164335 (+ 837us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:34.164343 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:34.164565 (+ 222us) client_negotiation.cc:769] Sending connection context
0808 02:31:34.164742 (+ 177us) client_negotiation.cc:240] Negotiation successful
0808 02:31:34.165142 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7432,"mutex_wait_us":214,"spinlock_wait_cycles":20864,"thread_start_us":18636,"threads_started":1}
I20260808 02:31:34.166023 4170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:34.113325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:37073 (local address 127.24.116.253:33605)
0808 02:31:34.125754 (+ 12429us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:34.125764 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:34.125791 (+ 27us) server_negotiation.cc:407] Connection header received
0808 02:31:34.125887 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:34.125896 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:34.126012 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:34.126156 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:34.133389 (+ 7233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.134485 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.138252 (+ 3767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.138905 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.139070 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:34.157136 (+ 18066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:34.157147 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:34.157152 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:34.157196 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:34.161901 (+ 4705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:34.162989 (+ 1088us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:34.162995 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:34.162999 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:34.163173 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:34.163659 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:34.163665 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:34.163669 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:34.164144 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:34.164348 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:34.165276 (+ 928us) server_negotiation.cc:299] Negotiation successful
0808 02:31:34.165547 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12249,"thread_start_us":13851,"threads_started":1}
I20260808 02:31:34.167613 4162 heartbeater.cc:347] Connected to a master server at 127.24.116.253:33605
I20260808 02:31:34.167904 4174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:34.117980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:40251 (local address 127.24.116.254:33319)
0808 02:31:34.131175 (+ 13195us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:34.131184 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:34.132113 (+ 929us) server_negotiation.cc:407] Connection header received
0808 02:31:34.132363 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:34.132377 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:34.132461 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:34.132570 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:34.134252 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.135093 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.136936 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.137476 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.137615 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:34.158660 (+ 21045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:34.158670 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:34.158678 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:34.158736 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:34.163472 (+ 4736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:34.164608 (+ 1136us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:34.164613 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:34.164618 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:34.164829 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:34.165455 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:34.165463 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:34.165466 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:34.165846 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:34.166617 (+ 771us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:34.167185 (+ 568us) server_negotiation.cc:299] Negotiation successful
0808 02:31:34.167414 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13063,"thread_start_us":13194,"threads_started":1}
I20260808 02:31:34.168020 4162 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:34.168903 4160 heartbeater.cc:347] Connected to a master server at 127.24.116.252:40613
I20260808 02:31:34.169090 4160 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:34.169229 4162 heartbeater.cc:511] Master 127.24.116.253:33605 requested a full tablet report, sending...
I20260808 02:31:34.169700 4160 heartbeater.cc:511] Master 127.24.116.252:40613 requested a full tablet report, sending...
I20260808 02:31:34.171356 3445 ts_manager.cc:194] Registered new tserver with Master: c79aa635d6bf4ca29c8396475ce17bfb (127.24.116.195:38969)
I20260808 02:31:34.171422 4172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:34.117835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.24.116.195:40251)
0808 02:31:34.131957 (+ 14122us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:34.131985 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:34.132155 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:34.132636 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:34.132645 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:34.133549 (+ 904us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:34.134048 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:34.134067 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.135247 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.135254 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:34.136788 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:34.136804 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.137675 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.137683 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:34.137913 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:34.139350 (+ 1437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:34.139366 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:34.157972 (+ 18606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:34.163609 (+ 5637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:34.163614 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:34.163617 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:34.164197 (+ 580us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:34.164989 (+ 792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:34.164996 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:34.165001 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:34.165220 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:34.166694 (+ 1474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:34.166701 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:34.166877 (+ 176us) client_negotiation.cc:769] Sending connection context
0808 02:31:34.167056 (+ 179us) client_negotiation.cc:240] Negotiation successful
0808 02:31:34.167385 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13907,"thread_start_us":3385,"threads_started":1}
I20260808 02:31:34.171451 3134 ts_manager.cc:194] Registered new tserver with Master: c79aa635d6bf4ca29c8396475ce17bfb (127.24.116.195:38969)
I20260808 02:31:34.172588 4161 heartbeater.cc:347] Connected to a master server at 127.24.116.254:33319
I20260808 02:31:34.172734 4161 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:34.173532 4161 heartbeater.cc:511] Master 127.24.116.254:33319 requested a full tablet report, sending...
I20260808 02:31:34.174994 2182 ts_manager.cc:194] Re-registered known tserver with Master: c79aa635d6bf4ca29c8396475ce17bfb (127.24.116.195:38969)
I20260808 02:31:34.176188 2182 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.116.195@KRBTEST.COM'} at 127.24.116.195:40251
I20260808 02:31:34.186556 4184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:34.142683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51322 (local address 127.24.116.254:33319)
0808 02:31:34.158807 (+ 16124us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:34.158814 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:34.158834 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:31:34.158897 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:34.158905 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:34.159010 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:34.159154 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:34.162119 (+ 2965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.164398 (+ 2279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.170367 (+ 5969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.171033 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.171167 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:34.176051 (+ 4884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:34.176056 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:34.176060 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:34.176091 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:34.180345 (+ 4254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:34.182295 (+ 1950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:34.182301 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:34.182305 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:34.182470 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:34.184433 (+ 1963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:34.184440 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:34.184446 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:34.184866 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:34.185135 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:34.185769 (+ 634us) server_negotiation.cc:299] Negotiation successful
0808 02:31:34.186031 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15960,"thread_start_us":15833,"threads_started":1}
I20260808 02:31:34.189813 4186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:34.142850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54370 (local address 127.24.116.253:33605)
0808 02:31:34.153514 (+ 10664us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:34.153525 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:34.153556 (+ 31us) server_negotiation.cc:407] Connection header received
0808 02:31:34.153643 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:34.153653 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:34.153951 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:34.154129 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:34.173925 (+ 19796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.175289 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.177340 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.178018 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.178112 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:34.181895 (+ 3783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:34.181906 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:34.181915 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:34.181963 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:34.185472 (+ 3509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:34.186406 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:34.186412 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:34.186414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:34.186555 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:34.186997 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:34.187002 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:34.187004 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:34.187505 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:34.187815 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:34.188179 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 02:31:34.189253 (+ 1074us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10428,"thread_start_us":10234,"threads_started":1}
I20260808 02:31:34.192469 4169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:34.153246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52440 (local address 127.24.116.252:40613)
0808 02:31:34.156474 (+ 3228us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:34.156482 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:34.171279 (+ 14797us) server_negotiation.cc:407] Connection header received
0808 02:31:34.171616 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:34.171622 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:34.171721 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:34.171790 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:34.177506 (+ 5716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.178554 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.181031 (+ 2477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.181859 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.181999 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:34.185243 (+ 3244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:34.185250 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:34.185256 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:34.185301 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:34.189031 (+ 3730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:34.189791 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:34.189799 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:34.189807 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:34.190177 (+ 370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:34.190611 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:34.190617 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:34.190620 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:34.190983 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:34.191219 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:34.191817 (+ 598us) server_negotiation.cc:299] Negotiation successful
0808 02:31:34.192066 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3053,"thread_start_us":14830,"threads_started":1}
I20260808 02:31:34.191946 2182 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51322:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:31:34.199965 2182 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:31:34.235982 4210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:34.222318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:38969 (local address 127.0.0.1:59244)
0808 02:31:34.225986 (+ 3668us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:34.226002 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:34.226183 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:34.227517 (+ 1334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:34.227525 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:34.227558 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:34.228348 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:34.228364 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.230880 (+ 2516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.230886 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:34.233019 (+ 2133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:34.233032 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.235061 (+ 2029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.235070 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:34.235238 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:34.235271 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 02:31:34.235381 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 02:31:34.235527 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3521,"thread_start_us":3366,"threads_started":1}
I20260808 02:31:34.236039 4212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:34.222698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59244 (local address 127.24.116.195:38969)
0808 02:31:34.225853 (+ 3155us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:34.225861 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:34.226834 (+ 973us) server_negotiation.cc:407] Connection header received
0808 02:31:34.226958 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:34.226972 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:34.227282 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:34.227523 (+ 241us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:34.228760 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.230115 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.233172 (+ 3057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.234838 (+ 1666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.235035 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:34.235204 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:34.235479 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 02:31:34.235670 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2949,"thread_start_us":2712,"threads_started":1}
I20260808 02:31:34.238204 4215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:34.223512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38768 (local address 127.24.116.193:35417)
0808 02:31:34.225453 (+ 1941us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:34.225464 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:34.226781 (+ 1317us) server_negotiation.cc:407] Connection header received
0808 02:31:34.227143 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:34.227151 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:34.227366 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:34.227539 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:34.228715 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.230682 (+ 1967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.234791 (+ 4109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.236290 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.236722 (+ 432us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:34.236907 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:34.237548 (+ 641us) server_negotiation.cc:299] Negotiation successful
0808 02:31:34.237787 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1748,"thread_start_us":1564,"threads_started":1}
I20260808 02:31:34.239013 4216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:34.223191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:35417 (local address 127.0.0.1:38768)
0808 02:31:34.226641 (+ 3450us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:34.226662 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:34.226936 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:34.227851 (+ 915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:34.227856 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:34.227893 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:34.228433 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:34.228448 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.230848 (+ 2400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.230857 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:34.234640 (+ 3783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:34.234651 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.237057 (+ 2406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.237064 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:34.237312 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:34.237347 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 02:31:34.238432 (+ 1085us) client_negotiation.cc:240] Negotiation successful
0808 02:31:34.238591 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3305,"mutex_wait_us":49,"thread_start_us":7119,"threads_started":1}
I20260808 02:31:34.241357 4214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:34.226006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:46137 (local address 127.0.0.1:55650)
0808 02:31:34.230625 (+ 4619us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:34.230639 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:34.230804 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:34.231878 (+ 1074us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:34.231883 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:34.231918 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:34.232530 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:34.232543 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.235269 (+ 2726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.235272 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:34.237751 (+ 2479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:34.237767 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.240384 (+ 2617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.240391 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:34.240671 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:34.240705 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 02:31:34.240795 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 02:31:34.240933 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4482,"mutex_wait_us":29,"thread_start_us":369,"threads_started":1}
I20260808 02:31:34.241093 4056 tablet_service.cc:1467] Processing CreateTablet for tablet e09a0e0f890c440ab8a1840e068381c0 (DEFAULT_TABLE table=test-table [id=816c9a85cd7645b78473c265e279115d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:31:34.242063 4218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:34.226292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55650 (local address 127.24.116.194:46137)
0808 02:31:34.226861 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:34.226870 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:34.230756 (+ 3886us) server_negotiation.cc:407] Connection header received
0808 02:31:34.231378 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:34.231388 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:34.231639 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:34.231893 (+ 254us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:34.232776 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.234304 (+ 1528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.238042 (+ 3738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.239798 (+ 1756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.239949 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:34.240117 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:34.241594 (+ 1477us) server_negotiation.cc:299] Negotiation successful
0808 02:31:34.241792 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":297,"threads_started":1}
I20260808 02:31:34.242471 4056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e09a0e0f890c440ab8a1840e068381c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:34.247455 3617 tablet_service.cc:1467] Processing CreateTablet for tablet e09a0e0f890c440ab8a1840e068381c0 (DEFAULT_TABLE table=test-table [id=816c9a85cd7645b78473c265e279115d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:31:34.248276 3843 tablet_service.cc:1467] Processing CreateTablet for tablet e09a0e0f890c440ab8a1840e068381c0 (DEFAULT_TABLE table=test-table [id=816c9a85cd7645b78473c265e279115d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:31:34.249287 3617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e09a0e0f890c440ab8a1840e068381c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:34.249666 3843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e09a0e0f890c440ab8a1840e068381c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:34.274935 4219 tablet_bootstrap.cc:492] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb: Bootstrap starting.
I20260808 02:31:34.279698 4219 tablet_bootstrap.cc:654] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:34.281095 4221 tablet_bootstrap.cc:492] T e09a0e0f890c440ab8a1840e068381c0 P 5ae9c4be9bb94fecaf86e3c0c4311f1e: Bootstrap starting.
I20260808 02:31:34.282150 4220 tablet_bootstrap.cc:492] T e09a0e0f890c440ab8a1840e068381c0 P d20264ccdfeb48978ef42511d9424140: Bootstrap starting.
I20260808 02:31:34.282377 4219 log.cc:824] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb: Log is configured to *not* fsync() on all Append() calls
I20260808 02:31:34.286222 4220 tablet_bootstrap.cc:654] T e09a0e0f890c440ab8a1840e068381c0 P d20264ccdfeb48978ef42511d9424140: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:34.287647 4220 log.cc:824] T e09a0e0f890c440ab8a1840e068381c0 P d20264ccdfeb48978ef42511d9424140: Log is configured to *not* fsync() on all Append() calls
I20260808 02:31:34.290129 4221 tablet_bootstrap.cc:654] T e09a0e0f890c440ab8a1840e068381c0 P 5ae9c4be9bb94fecaf86e3c0c4311f1e: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:34.291637 4221 log.cc:824] T e09a0e0f890c440ab8a1840e068381c0 P 5ae9c4be9bb94fecaf86e3c0c4311f1e: Log is configured to *not* fsync() on all Append() calls
I20260808 02:31:34.293634 4220 tablet_bootstrap.cc:492] T e09a0e0f890c440ab8a1840e068381c0 P d20264ccdfeb48978ef42511d9424140: No bootstrap required, opened a new log
I20260808 02:31:34.293951 4220 ts_tablet_manager.cc:1397] T e09a0e0f890c440ab8a1840e068381c0 P d20264ccdfeb48978ef42511d9424140: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.005s
I20260808 02:31:34.294068 4219 tablet_bootstrap.cc:492] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb: No bootstrap required, opened a new log
I20260808 02:31:34.294399 4219 ts_tablet_manager.cc:1397] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb: Time spent bootstrapping tablet: real 0.020s user 0.015s sys 0.000s
I20260808 02:31:34.297235 4221 tablet_bootstrap.cc:492] T e09a0e0f890c440ab8a1840e068381c0 P 5ae9c4be9bb94fecaf86e3c0c4311f1e: No bootstrap required, opened a new log
I20260808 02:31:34.297530 4221 ts_tablet_manager.cc:1397] T e09a0e0f890c440ab8a1840e068381c0 P 5ae9c4be9bb94fecaf86e3c0c4311f1e: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.005s
I20260808 02:31:34.302723 4220 raft_consensus.cc:348] T e09a0e0f890c440ab8a1840e068381c0 P d20264ccdfeb48978ef42511d9424140 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38969 } } peers { permanent_uuid: "d20264ccdfeb48978ef42511d9424140" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46137 } } peers { permanent_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 35417 } }
I20260808 02:31:34.303189 4220 raft_consensus.cc:374] T e09a0e0f890c440ab8a1840e068381c0 P d20264ccdfeb48978ef42511d9424140 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:34.303328 4220 raft_consensus.cc:729] T e09a0e0f890c440ab8a1840e068381c0 P d20264ccdfeb48978ef42511d9424140 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d20264ccdfeb48978ef42511d9424140, State: Initialized, Role: FOLLOWER
I20260808 02:31:34.304010 4220 consensus_queue.cc:260] T e09a0e0f890c440ab8a1840e068381c0 P d20264ccdfeb48978ef42511d9424140 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38969 } } peers { permanent_uuid: "d20264ccdfeb48978ef42511d9424140" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46137 } } peers { permanent_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 35417 } }
I20260808 02:31:34.306082 4220 ts_tablet_manager.cc:1428] T e09a0e0f890c440ab8a1840e068381c0 P d20264ccdfeb48978ef42511d9424140: Time spent starting tablet: real 0.012s user 0.009s sys 0.003s
I20260808 02:31:34.305963 4219 raft_consensus.cc:348] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38969 } } peers { permanent_uuid: "d20264ccdfeb48978ef42511d9424140" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46137 } } peers { permanent_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 35417 } }
I20260808 02:31:34.306363 3944 heartbeater.cc:503] Master 127.24.116.254:33319 was elected leader, sending a full tablet report...
I20260808 02:31:34.306478 4219 raft_consensus.cc:374] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:34.306624 4219 raft_consensus.cc:729] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c79aa635d6bf4ca29c8396475ce17bfb, State: Initialized, Role: FOLLOWER
I20260808 02:31:34.308713 4219 consensus_queue.cc:260] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38969 } } peers { permanent_uuid: "d20264ccdfeb48978ef42511d9424140" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46137 } } peers { permanent_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 35417 } }
I20260808 02:31:34.310789 4221 raft_consensus.cc:348] T e09a0e0f890c440ab8a1840e068381c0 P 5ae9c4be9bb94fecaf86e3c0c4311f1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38969 } } peers { permanent_uuid: "d20264ccdfeb48978ef42511d9424140" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46137 } } peers { permanent_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 35417 } }
I20260808 02:31:34.311293 4221 raft_consensus.cc:374] T e09a0e0f890c440ab8a1840e068381c0 P 5ae9c4be9bb94fecaf86e3c0c4311f1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:34.311518 4221 raft_consensus.cc:729] T e09a0e0f890c440ab8a1840e068381c0 P 5ae9c4be9bb94fecaf86e3c0c4311f1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ae9c4be9bb94fecaf86e3c0c4311f1e, State: Initialized, Role: FOLLOWER
I20260808 02:31:34.313030 4161 heartbeater.cc:503] Master 127.24.116.254:33319 was elected leader, sending a full tablet report...
I20260808 02:31:34.313781 4219 ts_tablet_manager.cc:1428] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb: Time spent starting tablet: real 0.019s user 0.009s sys 0.007s
I20260808 02:31:34.312595 4221 consensus_queue.cc:260] T e09a0e0f890c440ab8a1840e068381c0 P 5ae9c4be9bb94fecaf86e3c0c4311f1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38969 } } peers { permanent_uuid: "d20264ccdfeb48978ef42511d9424140" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46137 } } peers { permanent_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 35417 } }
I20260808 02:31:34.317471 4230 raft_consensus.cc:482] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:31:34.317790 4221 ts_tablet_manager.cc:1428] T e09a0e0f890c440ab8a1840e068381c0 P 5ae9c4be9bb94fecaf86e3c0c4311f1e: Time spent starting tablet: real 0.020s user 0.015s sys 0.002s
I20260808 02:31:34.317819 4230 raft_consensus.cc:504] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38969 } } peers { permanent_uuid: "d20264ccdfeb48978ef42511d9424140" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46137 } } peers { permanent_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 35417 } }
I20260808 02:31:34.320855 4230 leader_election.cc:288] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d20264ccdfeb48978ef42511d9424140 (127.24.116.194:46137), 5ae9c4be9bb94fecaf86e3c0c4311f1e (127.24.116.193:35417)
I20260808 02:31:34.328460 4172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:34.320552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:35417 (local address 127.24.116.195:58509)
0808 02:31:34.320911 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:34.320936 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:34.321056 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:34.321477 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:34.321484 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:34.321514 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:34.321750 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:34.321765 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.323657 (+ 1892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.323663 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:34.325971 (+ 2308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:34.325987 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.327739 (+ 1752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.327746 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:34.327954 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:34.327988 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 02:31:34.328099 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 02:31:34.328202 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172}
I20260808 02:31:34.328564 4215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:34.320762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:58509 (local address 127.24.116.193:35417)
0808 02:31:34.321015 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:34.321030 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:34.321060 (+ 30us) server_negotiation.cc:407] Connection header received
0808 02:31:34.321286 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:34.321290 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:34.321341 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:34.321413 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:34.321945 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.323248 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.326155 (+ 2907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.327514 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.327704 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:34.327801 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:34.328133 (+ 332us) server_negotiation.cc:299] Negotiation successful
0808 02:31:34.328291 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 02:31:34.329922 4173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:34.322119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:46137 (local address 127.24.116.195:60303)
0808 02:31:34.322495 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:34.322514 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:34.322615 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:34.323832 (+ 1217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:34.323837 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:34.323863 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:34.324060 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:34.324075 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.325639 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.325643 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:34.327677 (+ 2034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:34.327692 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.329271 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.329279 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:34.329542 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:34.329565 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 02:31:34.329644 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 02:31:34.329739 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271}
I20260808 02:31:34.329778 3654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e09a0e0f890c440ab8a1840e068381c0" candidate_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e" is_pre_election: true
I20260808 02:31:34.330127 4218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:34.322403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:60303 (local address 127.24.116.194:46137)
0808 02:31:34.323359 (+ 956us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:34.323366 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:34.323386 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:31:34.323454 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:34.323459 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:34.323538 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:34.323633 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:34.324262 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.325453 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.327854 (+ 2401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.329047 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.329162 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:34.329206 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:34.329707 (+ 501us) server_negotiation.cc:299] Negotiation successful
0808 02:31:34.329852 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":783}
I20260808 02:31:34.330327 3654 raft_consensus.cc:2454] T e09a0e0f890c440ab8a1840e068381c0 P 5ae9c4be9bb94fecaf86e3c0c4311f1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c79aa635d6bf4ca29c8396475ce17bfb in term 0.
I20260808 02:31:34.331094 3989 leader_election.cc:302] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ae9c4be9bb94fecaf86e3c0c4311f1e, c79aa635d6bf4ca29c8396475ce17bfb; no voters:
I20260808 02:31:34.331055 3872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e09a0e0f890c440ab8a1840e068381c0" candidate_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d20264ccdfeb48978ef42511d9424140" is_pre_election: true
I20260808 02:31:34.331598 4230 raft_consensus.cc:2781] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:31:34.331651 3872 raft_consensus.cc:2454] T e09a0e0f890c440ab8a1840e068381c0 P d20264ccdfeb48978ef42511d9424140 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c79aa635d6bf4ca29c8396475ce17bfb in term 0.
I20260808 02:31:34.331821 4230 raft_consensus.cc:482] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:31:34.331948 4230 raft_consensus.cc:3037] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:34.334568 4230 raft_consensus.cc:504] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38969 } } peers { permanent_uuid: "d20264ccdfeb48978ef42511d9424140" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46137 } } peers { permanent_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 35417 } }
I20260808 02:31:34.335291 4230 leader_election.cc:288] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb [CANDIDATE]: Term 1 election: Requested vote from peers d20264ccdfeb48978ef42511d9424140 (127.24.116.194:46137), 5ae9c4be9bb94fecaf86e3c0c4311f1e (127.24.116.193:35417)
I20260808 02:31:34.335661 3872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e09a0e0f890c440ab8a1840e068381c0" candidate_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d20264ccdfeb48978ef42511d9424140"
I20260808 02:31:34.335911 3872 raft_consensus.cc:3037] T e09a0e0f890c440ab8a1840e068381c0 P d20264ccdfeb48978ef42511d9424140 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:34.335944 3654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e09a0e0f890c440ab8a1840e068381c0" candidate_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e"
I20260808 02:31:34.336143 3654 raft_consensus.cc:3037] T e09a0e0f890c440ab8a1840e068381c0 P 5ae9c4be9bb94fecaf86e3c0c4311f1e [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:34.339578 3654 raft_consensus.cc:2454] T e09a0e0f890c440ab8a1840e068381c0 P 5ae9c4be9bb94fecaf86e3c0c4311f1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c79aa635d6bf4ca29c8396475ce17bfb in term 1.
I20260808 02:31:34.339578 3872 raft_consensus.cc:2454] T e09a0e0f890c440ab8a1840e068381c0 P d20264ccdfeb48978ef42511d9424140 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c79aa635d6bf4ca29c8396475ce17bfb in term 1.
I20260808 02:31:34.340147 3989 leader_election.cc:302] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ae9c4be9bb94fecaf86e3c0c4311f1e, c79aa635d6bf4ca29c8396475ce17bfb; no voters:
I20260808 02:31:34.340628 4230 raft_consensus.cc:2781] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:31:34.341352 4230 raft_consensus.cc:686] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb [term 1 LEADER]: Becoming Leader. State: Replica: c79aa635d6bf4ca29c8396475ce17bfb, State: Running, Role: LEADER
I20260808 02:31:34.342096 4230 consensus_queue.cc:237] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38969 } } peers { permanent_uuid: "d20264ccdfeb48978ef42511d9424140" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46137 } } peers { permanent_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 35417 } }
I20260808 02:31:34.347581 2179 catalog_manager.cc:5495] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb reported cstate change: term changed from 0 to 1, leader changed from <none> to c79aa635d6bf4ca29c8396475ce17bfb (127.24.116.195). New cstate: current_term: 1 leader_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d20264ccdfeb48978ef42511d9424140" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 35417 } health_report { overall_health: UNKNOWN } } }
W20260808 02:31:34.363332 4164 tablet.cc:2369] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:31:34.383936 4212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:34.377875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59260 (local address 127.24.116.195:38969)
0808 02:31:34.378074 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:34.378080 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:34.378162 (+ 82us) server_negotiation.cc:407] Connection header received
0808 02:31:34.378411 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:34.378416 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:34.378493 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:34.378659 (+ 166us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:31:34.379081 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.379915 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.381538 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.381992 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.382132 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:34.382772 (+ 640us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:31:34.383349 (+ 577us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:31:34.383521 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:34.383580 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 02:31:34.383661 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 02:31:34.393016 3654 raft_consensus.cc:1261] T e09a0e0f890c440ab8a1840e068381c0 P 5ae9c4be9bb94fecaf86e3c0c4311f1e [term 1 FOLLOWER]: Refusing update from remote peer c79aa635d6bf4ca29c8396475ce17bfb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:31:34.393054 3872 raft_consensus.cc:1261] T e09a0e0f890c440ab8a1840e068381c0 P d20264ccdfeb48978ef42511d9424140 [term 1 FOLLOWER]: Refusing update from remote peer c79aa635d6bf4ca29c8396475ce17bfb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:31:34.394096 4232 consensus_queue.cc:1035] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 35417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:31:34.394469 4230 consensus_queue.cc:1035] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d20264ccdfeb48978ef42511d9424140" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:31:34.428941 4238 mvcc.cc:205] Tried to move back new op lower bound from 7316096181822296064 to 7316096181629874176. Current Snapshot: MvccSnapshot[applied={T|T < 7316096181822296064 or (T in {7316096181822296064})}]
I20260808 02:31:34.439899 2182 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51322:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:31:34.440243 2182 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51322:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:31:34.448515 2182 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1411d8b83e714c8d9b40fa837fc7c233: Sending DeleteTablet for 3 replicas of tablet e09a0e0f890c440ab8a1840e068381c0
I20260808 02:31:34.449790 4056 tablet_service.cc:1514] Processing DeleteTablet for tablet e09a0e0f890c440ab8a1840e068381c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:34 UTC) from {username='oryx', principal='oryx/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:59244
I20260808 02:31:34.450421 3843 tablet_service.cc:1514] Processing DeleteTablet for tablet e09a0e0f890c440ab8a1840e068381c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:34 UTC) from {username='oryx', principal='oryx/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:55650
I20260808 02:31:34.451136 3617 tablet_service.cc:1514] Processing DeleteTablet for tablet e09a0e0f890c440ab8a1840e068381c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:34 UTC) from {username='oryx', principal='oryx/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:38768
I20260808 02:31:34.464989 4254 tablet_replica.cc:330] T e09a0e0f890c440ab8a1840e068381c0 P 5ae9c4be9bb94fecaf86e3c0c4311f1e: stopping tablet replica
I20260808 02:31:34.465585 4254 raft_consensus.cc:2229] T e09a0e0f890c440ab8a1840e068381c0 P 5ae9c4be9bb94fecaf86e3c0c4311f1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:31:34.466198 4254 raft_consensus.cc:2258] T e09a0e0f890c440ab8a1840e068381c0 P 5ae9c4be9bb94fecaf86e3c0c4311f1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:34.468779 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 2130
I20260808 02:31:34.470283 2236 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:34.475878 4251 tablet_replica.cc:330] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb: stopping tablet replica
I20260808 02:31:34.476316 4253 tablet_replica.cc:330] T e09a0e0f890c440ab8a1840e068381c0 P d20264ccdfeb48978ef42511d9424140: stopping tablet replica
I20260808 02:31:34.476462 4251 raft_consensus.cc:2229] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:31:34.476775 4253 raft_consensus.cc:2229] T e09a0e0f890c440ab8a1840e068381c0 P d20264ccdfeb48978ef42511d9424140 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:31:34.477312 4251 raft_consensus.cc:2258] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:34.477401 4253 raft_consensus.cc:2258] T e09a0e0f890c440ab8a1840e068381c0 P d20264ccdfeb48978ef42511d9424140 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:34.479784 4253 ts_tablet_manager.cc:1905] T e09a0e0f890c440ab8a1840e068381c0 P d20264ccdfeb48978ef42511d9424140: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:34.481856 4251 ts_tablet_manager.cc:1905] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:34.484408 4254 ts_tablet_manager.cc:1905] T e09a0e0f890c440ab8a1840e068381c0 P 5ae9c4be9bb94fecaf86e3c0c4311f1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:34.488418 4253 ts_tablet_manager.cc:1918] T e09a0e0f890c440ab8a1840e068381c0 P d20264ccdfeb48978ef42511d9424140: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:31:34.488668 4253 log.cc:1196] T e09a0e0f890c440ab8a1840e068381c0 P d20264ccdfeb48978ef42511d9424140: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/e09a0e0f890c440ab8a1840e068381c0
I20260808 02:31:34.489305 4253 ts_tablet_manager.cc:1939] T e09a0e0f890c440ab8a1840e068381c0 P d20264ccdfeb48978ef42511d9424140: Deleting consensus metadata
I20260808 02:31:34.491338 2159 catalog_manager.cc:4841] TS d20264ccdfeb48978ef42511d9424140 (127.24.116.194:46137): tablet e09a0e0f890c440ab8a1840e068381c0 (table test-table [id=816c9a85cd7645b78473c265e279115d]) successfully deleted
I20260808 02:31:34.499850 4251 ts_tablet_manager.cc:1918] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:31:34.500062 4251 log.cc:1196] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/e09a0e0f890c440ab8a1840e068381c0
I20260808 02:31:34.500586 4254 ts_tablet_manager.cc:1918] T e09a0e0f890c440ab8a1840e068381c0 P 5ae9c4be9bb94fecaf86e3c0c4311f1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:31:34.500808 4254 log.cc:1196] T e09a0e0f890c440ab8a1840e068381c0 P 5ae9c4be9bb94fecaf86e3c0c4311f1e: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/e09a0e0f890c440ab8a1840e068381c0
I20260808 02:31:34.501473 4254 ts_tablet_manager.cc:1939] T e09a0e0f890c440ab8a1840e068381c0 P 5ae9c4be9bb94fecaf86e3c0c4311f1e: Deleting consensus metadata
I20260808 02:31:34.501801 4251 ts_tablet_manager.cc:1939] T e09a0e0f890c440ab8a1840e068381c0 P c79aa635d6bf4ca29c8396475ce17bfb: Deleting consensus metadata
I20260808 02:31:34.522411 4186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:34.452596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54384 (local address 127.24.116.253:33605)
0808 02:31:34.452802 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:34.452809 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:34.467240 (+ 14431us) server_negotiation.cc:407] Connection header received
0808 02:31:34.467594 (+ 354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:34.467600 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:34.467685 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:34.467762 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:34.493258 (+ 25496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.494776 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.503609 (+ 8833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.504504 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.504589 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:34.514648 (+ 10059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:34.514656 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:34.514661 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:34.514717 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:34.518804 (+ 4087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:34.519960 (+ 1156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:34.519966 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:34.519970 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:34.520133 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:34.520660 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:34.520665 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:34.520669 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:34.521058 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:34.521343 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:34.521744 (+ 401us) server_negotiation.cc:299] Negotiation successful
0808 02:31:34.522036 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 02:31:34.541618 4169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:34.467499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52454 (local address 127.24.116.252:40613)
0808 02:31:34.467696 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:34.467702 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:34.522669 (+ 54967us) server_negotiation.cc:407] Connection header received
0808 02:31:34.522949 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:34.522955 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:34.523139 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:34.523298 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:34.525576 (+ 2278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.526997 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.529000 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.529803 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.529960 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:34.533570 (+ 3610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:34.533578 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:34.533584 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:34.533636 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:34.538099 (+ 4463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:34.538983 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:34.538991 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:34.538999 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:34.539179 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:34.539748 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:34.539754 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:34.539758 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:34.540129 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:34.540425 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:34.540893 (+ 468us) server_negotiation.cc:299] Negotiation successful
0808 02:31:34.541124 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 02:31:34.632956 2159 catalog_manager.cc:4841] TS c79aa635d6bf4ca29c8396475ce17bfb (127.24.116.195:38969): tablet e09a0e0f890c440ab8a1840e068381c0 (table test-table [id=816c9a85cd7645b78473c265e279115d]) successfully deleted
W20260808 02:31:34.633286 2159 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.24.116.195:38969, user_credentials={real_user=slave}} blocked reactor thread for 129743us
I20260808 02:31:34.633730 2161 catalog_manager.cc:4841] TS 5ae9c4be9bb94fecaf86e3c0c4311f1e (127.24.116.193:35417): tablet e09a0e0f890c440ab8a1840e068381c0 (table test-table [id=816c9a85cd7645b78473c265e279115d]) successfully deleted
W20260808 02:31:34.633891 2161 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.24.116.193:35417, user_credentials={real_user=slave}} blocked reactor thread for 130360us
I20260808 02:31:34.634225 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 2130
I20260808 02:31:34.687024 4186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:34.668976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54388 (local address 127.24.116.253:33605)
0808 02:31:34.669195 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:34.669200 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:34.669749 (+ 549us) server_negotiation.cc:407] Connection header received
0808 02:31:34.669979 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:34.669985 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:34.670095 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:34.670208 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:34.671990 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.673160 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.675301 (+ 2141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.676014 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.676139 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:34.679722 (+ 3583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:34.679730 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:34.679734 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:34.679776 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:34.683943 (+ 4167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:34.684699 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:34.684705 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:34.684709 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:34.684890 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:34.685359 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:34.685364 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:34.685370 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:34.685743 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:34.686038 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:34.686386 (+ 348us) server_negotiation.cc:299] Negotiation successful
0808 02:31:34.686624 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 02:31:34.690480 4169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:34.673242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52460 (local address 127.24.116.252:40613)
0808 02:31:34.673470 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:34.673476 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:34.673493 (+ 17us) server_negotiation.cc:407] Connection header received
0808 02:31:34.673552 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:34.673558 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:34.673650 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:34.673747 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:34.676167 (+ 2420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.677638 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.679943 (+ 2305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:34.680612 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:34.680749 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:34.683965 (+ 3216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:34.683972 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:34.683977 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:34.684021 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:34.687687 (+ 3666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:34.688514 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:34.688520 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:34.688523 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:34.688677 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:34.689137 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:34.689141 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:34.689143 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:34.689447 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:34.689628 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:34.690007 (+ 379us) server_negotiation.cc:299] Negotiation successful
0808 02:31:34.690176 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 02:31:35.424764 4273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:35.423727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.24.116.193:36959)
0808 02:31:35.424390 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:35.424566 (+ 176us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":365,"threads_started":1}
W20260808 02:31:35.425222 3717 heartbeater.cc:644] Failed to heartbeat to 127.24.116.254:33319 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
I20260808 02:31:35.432135 4277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:35.431186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.24.116.194:55633)
0808 02:31:35.431763 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:35.431915 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":315,"threads_started":1}
W20260808 02:31:35.432945 3944 heartbeater.cc:644] Failed to heartbeat to 127.24.116.254:33319 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
I20260808 02:31:35.433362 4278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:35.431997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.24.116.195:41093)
0808 02:31:35.432913 (+ 916us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:35.433072 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":800,"thread_start_us":669,"threads_started":1}
W20260808 02:31:35.433720 4161 heartbeater.cc:644] Failed to heartbeat to 127.24.116.254:33319 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
I20260808 02:31:35.947742 4279 raft_consensus.cc:482] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1411d8b83e714c8d9b40fa837fc7c233)
I20260808 02:31:35.948098 4279 raft_consensus.cc:504] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: false } }
I20260808 02:31:35.949607 4279 leader_election.cc:288] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1411d8b83e714c8d9b40fa837fc7c233 (127.24.116.254:33319), 510b7389184341aebda800270f395f34 (127.24.116.253:33605)
I20260808 02:31:35.962245 4280 raft_consensus.cc:482] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1411d8b83e714c8d9b40fa837fc7c233)
I20260808 02:31:35.962390 4282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:35.949861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.0.0.1:51744)
0808 02:31:35.961553 (+ 11692us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:35.961839 (+ 286us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11526,"thread_start_us":12107,"threads_started":1}
I20260808 02:31:35.962515 4280 raft_consensus.cc:504] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: false } }
W20260808 02:31:35.962747 3421 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
I20260808 02:31:35.963629 4280 leader_election.cc:288] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1411d8b83e714c8d9b40fa837fc7c233 (127.24.116.254:33319), 146343da39844d15be75c5d54005a43b (127.24.116.252:40613)
I20260808 02:31:35.964497 4282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:35.964147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.0.0.1:51752)
0808 02:31:35.964287 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:35.964388 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 02:31:35.964741 3421 leader_election.cc:334] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1411d8b83e714c8d9b40fa837fc7c233 (127.24.116.254:33319): Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
I20260808 02:31:35.965883 4288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:35.963854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.0.0.1:51748)
0808 02:31:35.965227 (+ 1373us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:35.965456 (+ 229us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1264,"thread_start_us":997,"threads_started":1}
W20260808 02:31:35.969273 3114 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
I20260808 02:31:35.971040 4281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:35.949915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:33605 (local address 127.0.0.1:54392)
0808 02:31:35.962499 (+ 12584us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:35.962518 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:35.962687 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:35.963134 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:35.963139 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:35.963166 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:35.963607 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:35.963623 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:35.965623 (+ 2000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:35.965630 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:35.968570 (+ 2940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:35.968593 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:35.970453 (+ 1860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:35.970462 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:35.970599 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:35.970624 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 02:31:35.970705 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 02:31:35.970790 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12259,"thread_start_us":11326,"threads_started":1}
I20260808 02:31:35.971211 4284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:35.950102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54392 (local address 127.24.116.253:33605)
0808 02:31:35.961946 (+ 11844us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:35.961955 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:35.962635 (+ 680us) server_negotiation.cc:407] Connection header received
0808 02:31:35.962857 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:35.962863 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:35.962948 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:35.963072 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:35.963879 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:35.965365 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:35.968749 (+ 3384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:35.970271 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:35.970437 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:35.970510 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:35.970756 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 02:31:35.970899 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11717,"thread_start_us":11521,"threads_started":1}
I20260808 02:31:35.971902 3151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "146343da39844d15be75c5d54005a43b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "510b7389184341aebda800270f395f34" is_pre_election: true
I20260808 02:31:35.972373 3151 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146343da39844d15be75c5d54005a43b in term 1.
I20260808 02:31:35.972702 4289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:35.971979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.0.0.1:51772)
0808 02:31:35.972144 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:35.972427 (+ 283us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 02:31:35.973094 3114 leader_election.cc:334] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1411d8b83e714c8d9b40fa837fc7c233 (127.24.116.254:33319): Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
I20260808 02:31:35.973883 3420 leader_election.cc:302] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146343da39844d15be75c5d54005a43b, 510b7389184341aebda800270f395f34; no voters: 1411d8b83e714c8d9b40fa837fc7c233
I20260808 02:31:35.974335 4279 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 02:31:35.974501 4279 raft_consensus.cc:482] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1411d8b83e714c8d9b40fa837fc7c233)
I20260808 02:31:35.974647 4279 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [term 1 FOLLOWER]: Advancing to term 2
I20260808 02:31:35.975991 4288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:35.965303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:40613 (local address 127.0.0.1:52476)
0808 02:31:35.966226 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:35.966246 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:35.966397 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:35.969152 (+ 2755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:35.969157 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:35.969182 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:35.969553 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:35.969567 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:35.971325 (+ 1758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:35.971330 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:35.973406 (+ 2076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:35.973419 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:35.975239 (+ 1820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:35.975250 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:35.975442 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:35.975465 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 02:31:35.975571 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 02:31:35.975708 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":811,"thread_start_us":3658,"threads_started":1}
I20260808 02:31:35.976133 4290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:35.965511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52476 (local address 127.24.116.252:40613)
0808 02:31:35.968812 (+ 3301us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:35.968818 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:35.968842 (+ 24us) server_negotiation.cc:407] Connection header received
0808 02:31:35.968900 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:35.968905 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:35.968996 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:35.969709 (+ 713us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:35.969972 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:35.971164 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:35.973571 (+ 2407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:35.975046 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:35.975243 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:35.975325 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:35.975600 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 02:31:35.975738 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3170,"thread_start_us":3058,"threads_started":1}
I20260808 02:31:35.976751 3456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "510b7389184341aebda800270f395f34" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "146343da39844d15be75c5d54005a43b" is_pre_election: true
I20260808 02:31:35.977289 4279 raft_consensus.cc:504] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: false } }
I20260808 02:31:35.977725 3456 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 510b7389184341aebda800270f395f34 in current term 2: Already voted for candidate 146343da39844d15be75c5d54005a43b in this term.
I20260808 02:31:35.978003 4279 leader_election.cc:288] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [CANDIDATE]: Term 2 election: Requested vote from peers 1411d8b83e714c8d9b40fa837fc7c233 (127.24.116.254:33319), 510b7389184341aebda800270f395f34 (127.24.116.253:33605)
I20260808 02:31:35.978474 4281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:35.978053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.0.0.1:51778)
0808 02:31:35.978240 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:35.978326 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260808 02:31:35.978497 3151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "146343da39844d15be75c5d54005a43b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "510b7389184341aebda800270f395f34"
I20260808 02:31:35.978520 3114 leader_election.cc:302] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 510b7389184341aebda800270f395f34; no voters: 1411d8b83e714c8d9b40fa837fc7c233, 146343da39844d15be75c5d54005a43b
I20260808 02:31:35.978770 3151 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 1 FOLLOWER]: Advancing to term 2
I20260808 02:31:35.979799 4281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:35.979391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.0.0.1:51788)
0808 02:31:35.979561 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:35.979657 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260808 02:31:35.979985 3421 leader_election.cc:334] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1411d8b83e714c8d9b40fa837fc7c233 (127.24.116.254:33319): Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
I20260808 02:31:35.981501 3151 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146343da39844d15be75c5d54005a43b in term 2.
I20260808 02:31:35.981694 4280 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 02:31:35.981914 3420 leader_election.cc:302] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146343da39844d15be75c5d54005a43b, 510b7389184341aebda800270f395f34; no voters: 1411d8b83e714c8d9b40fa837fc7c233
I20260808 02:31:35.982191 4279 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [term 2 FOLLOWER]: Leader election won for term 2
I20260808 02:31:35.982668 4279 raft_consensus.cc:686] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [term 2 LEADER]: Becoming Leader. State: Replica: 146343da39844d15be75c5d54005a43b, State: Running, Role: LEADER
I20260808 02:31:35.983083 4279 consensus_queue.cc:237] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: false } }
I20260808 02:31:35.985047 4292 sys_catalog.cc:455] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 146343da39844d15be75c5d54005a43b. Latest consensus state: current_term: 2 leader_uuid: "146343da39844d15be75c5d54005a43b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: false } } }
I20260808 02:31:35.985414 4292 sys_catalog.cc:458] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:35.986055 4299 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:31:35.989732 4299 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:31:35.990558 4299 catalog_manager.cc:1259] Loaded cluster ID: afa59ea266074dd092f572db28a4a4ea
I20260808 02:31:35.990628 4299 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:31:35.991770 4299 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:31:35.992636 4299 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b: Loaded TSK: 0
I20260808 02:31:35.993463 4299 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:31:36.030351 3440 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52460:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:31:36.038235 3440 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:31:36.042583 4281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.042140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.0.0.1:51806)
0808 02:31:36.042323 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:36.042422 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 02:31:36.042716 3151 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [term 2 FOLLOWER]: Refusing update from remote peer 146343da39844d15be75c5d54005a43b: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260808 02:31:36.043742 4281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.043277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.0.0.1:51808)
0808 02:31:36.043451 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:36.043557 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 02:31:36.043635 4292 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [LEADER]: Connected to new peer: Peer: permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260808 02:31:36.043957 3421 consensus_peers.cc:487] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b -> Peer 1411d8b83e714c8d9b40fa837fc7c233 (127.24.116.254:33319): Couldn't send request to peer 1411d8b83e714c8d9b40fa837fc7c233. Status: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 02:31:36.046531 4280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 146343da39844d15be75c5d54005a43b. Latest consensus state: current_term: 2 leader_uuid: "146343da39844d15be75c5d54005a43b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: false } } }
I20260808 02:31:36.046875 4280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:31:36.049994 4292 sys_catalog.cc:455] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "146343da39844d15be75c5d54005a43b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: false } } }
I20260808 02:31:36.050308 4292 sys_catalog.cc:458] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:36.052845 4280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "146343da39844d15be75c5d54005a43b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1411d8b83e714c8d9b40fa837fc7c233" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33319 } } peers { permanent_uuid: "510b7389184341aebda800270f395f34" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 33605 } attrs { promote: false } } peers { permanent_uuid: "146343da39844d15be75c5d54005a43b" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 40613 } attrs { promote: false } } }
I20260808 02:31:36.053150 4280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 510b7389184341aebda800270f395f34 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:31:36.069341 4281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.057840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:38969 (local address 127.0.0.1:59272)
0808 02:31:36.057993 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:36.058009 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:36.058094 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:36.059317 (+ 1223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:36.059326 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:36.059366 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:36.059666 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:36.059685 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:36.064976 (+ 5291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:36.064985 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:36.066947 (+ 1962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:36.066962 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:36.068634 (+ 1672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:36.068640 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:36.068819 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:36.068859 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 02:31:36.068947 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 02:31:36.069093 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":1}
I20260808 02:31:36.070317 4308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.058042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59272 (local address 127.24.116.195:38969)
0808 02:31:36.058537 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:36.058545 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:36.058566 (+ 21us) server_negotiation.cc:407] Connection header received
0808 02:31:36.059010 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:36.059016 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:36.059118 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:36.063008 (+ 3890us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:36.063555 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:36.064810 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:36.067161 (+ 2351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:36.068428 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:36.069755 (+ 1327us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:36.069809 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:36.069850 (+ 41us) server_negotiation.cc:299] Negotiation successful
0808 02:31:36.069958 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":253,"threads_started":1}
I20260808 02:31:36.070878 4313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.059020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:35417 (local address 127.0.0.1:38774)
0808 02:31:36.060696 (+ 1676us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:36.060709 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:36.060790 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:36.064063 (+ 3273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:36.064068 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:36.064093 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:36.064465 (+ 372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:36.064477 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:36.066103 (+ 1626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:36.066109 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:36.068494 (+ 2385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:36.068507 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:36.070180 (+ 1673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:36.070186 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:36.070365 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:36.070414 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 02:31:36.070498 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 02:31:36.070617 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1572,"mutex_wait_us":484,"thread_start_us":1388,"threads_started":1}
I20260808 02:31:36.071197 4056 tablet_service.cc:1467] Processing CreateTablet for tablet 8c1952d5b7be48699d1e1dc1d733dbb4 (DEFAULT_TABLE table=test-table [id=a3b0921be146459784cccc06810f0f22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:31:36.071609 4315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.059962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38774 (local address 127.24.116.193:35417)
0808 02:31:36.063576 (+ 3614us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:36.063583 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:36.063602 (+ 19us) server_negotiation.cc:407] Connection header received
0808 02:31:36.063677 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:36.063684 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:36.063759 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:36.063858 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:36.064648 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:36.065904 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:36.068703 (+ 2799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:36.069933 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:36.070113 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:36.070188 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:36.071212 (+ 1024us) server_negotiation.cc:299] Negotiation successful
0808 02:31:36.071322 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3479,"thread_start_us":3361,"threads_started":1}
I20260808 02:31:36.071717 4056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c1952d5b7be48699d1e1dc1d733dbb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:36.071789 4282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.058552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:46137 (local address 127.0.0.1:55658)
0808 02:31:36.058693 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:36.058711 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:36.058820 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:36.065246 (+ 6426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:36.065251 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:36.065273 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:36.065643 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:36.065656 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:36.066682 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:36.066689 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:36.068984 (+ 2295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:36.068995 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:36.071054 (+ 2059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:36.071060 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:36.071251 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:36.071283 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 02:31:36.071376 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 02:31:36.071505 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":48}
I20260808 02:31:36.072258 3617 tablet_service.cc:1467] Processing CreateTablet for tablet 8c1952d5b7be48699d1e1dc1d733dbb4 (DEFAULT_TABLE table=test-table [id=a3b0921be146459784cccc06810f0f22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:31:36.072574 4309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.058691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55658 (local address 127.24.116.194:46137)
0808 02:31:36.064966 (+ 6275us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:36.064974 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:36.064998 (+ 24us) server_negotiation.cc:407] Connection header received
0808 02:31:36.065054 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:36.065058 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:36.065112 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:36.065223 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:36.065802 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:36.066539 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:36.069106 (+ 2567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:36.070333 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:36.070534 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:36.070615 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:36.072099 (+ 1484us) server_negotiation.cc:299] Negotiation successful
0808 02:31:36.072270 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6125,"thread_start_us":6023,"threads_started":1}
I20260808 02:31:36.072759 3617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c1952d5b7be48699d1e1dc1d733dbb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:36.073218 3843 tablet_service.cc:1467] Processing CreateTablet for tablet 8c1952d5b7be48699d1e1dc1d733dbb4 (DEFAULT_TABLE table=test-table [id=a3b0921be146459784cccc06810f0f22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:31:36.073647 3843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c1952d5b7be48699d1e1dc1d733dbb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:36.078152 4316 tablet_bootstrap.cc:492] T 8c1952d5b7be48699d1e1dc1d733dbb4 P 5ae9c4be9bb94fecaf86e3c0c4311f1e: Bootstrap starting.
I20260808 02:31:36.079912 4316 tablet_bootstrap.cc:654] T 8c1952d5b7be48699d1e1dc1d733dbb4 P 5ae9c4be9bb94fecaf86e3c0c4311f1e: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:36.081108 4318 tablet_bootstrap.cc:492] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb: Bootstrap starting.
I20260808 02:31:36.081333 4319 tablet_bootstrap.cc:492] T 8c1952d5b7be48699d1e1dc1d733dbb4 P d20264ccdfeb48978ef42511d9424140: Bootstrap starting.
I20260808 02:31:36.083076 4318 tablet_bootstrap.cc:654] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:36.083235 4316 tablet_bootstrap.cc:492] T 8c1952d5b7be48699d1e1dc1d733dbb4 P 5ae9c4be9bb94fecaf86e3c0c4311f1e: No bootstrap required, opened a new log
I20260808 02:31:36.083392 4316 ts_tablet_manager.cc:1397] T 8c1952d5b7be48699d1e1dc1d733dbb4 P 5ae9c4be9bb94fecaf86e3c0c4311f1e: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 02:31:36.083420 4319 tablet_bootstrap.cc:654] T 8c1952d5b7be48699d1e1dc1d733dbb4 P d20264ccdfeb48978ef42511d9424140: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:36.084370 4316 raft_consensus.cc:348] T 8c1952d5b7be48699d1e1dc1d733dbb4 P 5ae9c4be9bb94fecaf86e3c0c4311f1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38969 } } peers { permanent_uuid: "d20264ccdfeb48978ef42511d9424140" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46137 } } peers { permanent_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 35417 } }
I20260808 02:31:36.084661 4316 raft_consensus.cc:374] T 8c1952d5b7be48699d1e1dc1d733dbb4 P 5ae9c4be9bb94fecaf86e3c0c4311f1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:36.084791 4316 raft_consensus.cc:729] T 8c1952d5b7be48699d1e1dc1d733dbb4 P 5ae9c4be9bb94fecaf86e3c0c4311f1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ae9c4be9bb94fecaf86e3c0c4311f1e, State: Initialized, Role: FOLLOWER
I20260808 02:31:36.085108 4316 consensus_queue.cc:260] T 8c1952d5b7be48699d1e1dc1d733dbb4 P 5ae9c4be9bb94fecaf86e3c0c4311f1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38969 } } peers { permanent_uuid: "d20264ccdfeb48978ef42511d9424140" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46137 } } peers { permanent_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 35417 } }
I20260808 02:31:36.085562 4319 tablet_bootstrap.cc:492] T 8c1952d5b7be48699d1e1dc1d733dbb4 P d20264ccdfeb48978ef42511d9424140: No bootstrap required, opened a new log
I20260808 02:31:36.085724 4319 ts_tablet_manager.cc:1397] T 8c1952d5b7be48699d1e1dc1d733dbb4 P d20264ccdfeb48978ef42511d9424140: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260808 02:31:36.086211 4316 ts_tablet_manager.cc:1428] T 8c1952d5b7be48699d1e1dc1d733dbb4 P 5ae9c4be9bb94fecaf86e3c0c4311f1e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 02:31:36.086511 4319 raft_consensus.cc:348] T 8c1952d5b7be48699d1e1dc1d733dbb4 P d20264ccdfeb48978ef42511d9424140 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38969 } } peers { permanent_uuid: "d20264ccdfeb48978ef42511d9424140" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46137 } } peers { permanent_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 35417 } }
I20260808 02:31:36.086756 4319 raft_consensus.cc:374] T 8c1952d5b7be48699d1e1dc1d733dbb4 P d20264ccdfeb48978ef42511d9424140 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:36.086855 4319 raft_consensus.cc:729] T 8c1952d5b7be48699d1e1dc1d733dbb4 P d20264ccdfeb48978ef42511d9424140 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d20264ccdfeb48978ef42511d9424140, State: Initialized, Role: FOLLOWER
I20260808 02:31:36.087088 4319 consensus_queue.cc:260] T 8c1952d5b7be48699d1e1dc1d733dbb4 P d20264ccdfeb48978ef42511d9424140 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38969 } } peers { permanent_uuid: "d20264ccdfeb48978ef42511d9424140" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46137 } } peers { permanent_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 35417 } }
I20260808 02:31:36.094848 4318 tablet_bootstrap.cc:492] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb: No bootstrap required, opened a new log
I20260808 02:31:36.095054 4318 ts_tablet_manager.cc:1397] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.008s
I20260808 02:31:36.095677 4319 ts_tablet_manager.cc:1428] T 8c1952d5b7be48699d1e1dc1d733dbb4 P d20264ccdfeb48978ef42511d9424140: Time spent starting tablet: real 0.010s user 0.002s sys 0.005s
I20260808 02:31:36.096019 4318 raft_consensus.cc:348] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38969 } } peers { permanent_uuid: "d20264ccdfeb48978ef42511d9424140" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46137 } } peers { permanent_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 35417 } }
I20260808 02:31:36.096278 4318 raft_consensus.cc:374] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:36.096426 4318 raft_consensus.cc:729] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c79aa635d6bf4ca29c8396475ce17bfb, State: Initialized, Role: FOLLOWER
I20260808 02:31:36.096705 4318 consensus_queue.cc:260] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38969 } } peers { permanent_uuid: "d20264ccdfeb48978ef42511d9424140" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46137 } } peers { permanent_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 35417 } }
I20260808 02:31:36.096992 3716 heartbeater.cc:503] Master 127.24.116.252:40613 was elected leader, sending a full tablet report...
I20260808 02:31:36.098351 4324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.086911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.24.116.193:47021)
0808 02:31:36.097773 (+ 10862us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:36.097990 (+ 217us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":10631,"thread_start_us":9645,"threads_started":1}
I20260808 02:31:36.100080 4326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.096276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.24.116.194:51107)
0808 02:31:36.099585 (+ 3309us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:36.099785 (+ 200us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3179,"thread_start_us":3487,"threads_started":1}
I20260808 02:31:36.101145 4318 ts_tablet_manager.cc:1428] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb: Time spent starting tablet: real 0.006s user 0.004s sys 0.003s
I20260808 02:31:36.104743 4326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.100796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.24.116.194:50551)
0808 02:31:36.104527 (+ 3731us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:36.104603 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3651,"threads_started":1}
I20260808 02:31:36.109481 4324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.109017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.24.116.193:57529)
0808 02:31:36.109208 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:36.109305 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 02:31:36.110176 4329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.101185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.24.116.195:58915)
0808 02:31:36.109724 (+ 8539us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:36.109925 (+ 201us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":8319,"threads_started":1}
I20260808 02:31:36.111070 3943 heartbeater.cc:503] Master 127.24.116.252:40613 was elected leader, sending a full tablet report...
I20260808 02:31:36.111989 4329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.111573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.24.116.195:45673)
0808 02:31:36.111741 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:36.111842 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 02:31:36.112368 4160 heartbeater.cc:503] Master 127.24.116.252:40613 was elected leader, sending a full tablet report...
I20260808 02:31:36.158296 4327 raft_consensus.cc:482] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:31:36.158595 4327 raft_consensus.cc:504] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38969 } } peers { permanent_uuid: "d20264ccdfeb48978ef42511d9424140" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46137 } } peers { permanent_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 35417 } }
I20260808 02:31:36.159484 4327 leader_election.cc:288] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d20264ccdfeb48978ef42511d9424140 (127.24.116.194:46137), 5ae9c4be9bb94fecaf86e3c0c4311f1e (127.24.116.193:35417)
I20260808 02:31:36.160001 3872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c1952d5b7be48699d1e1dc1d733dbb4" candidate_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d20264ccdfeb48978ef42511d9424140" is_pre_election: true
I20260808 02:31:36.160101 3654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c1952d5b7be48699d1e1dc1d733dbb4" candidate_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e" is_pre_election: true
I20260808 02:31:36.160248 3872 raft_consensus.cc:2454] T 8c1952d5b7be48699d1e1dc1d733dbb4 P d20264ccdfeb48978ef42511d9424140 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c79aa635d6bf4ca29c8396475ce17bfb in term 0.
I20260808 02:31:36.160449 3654 raft_consensus.cc:2454] T 8c1952d5b7be48699d1e1dc1d733dbb4 P 5ae9c4be9bb94fecaf86e3c0c4311f1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c79aa635d6bf4ca29c8396475ce17bfb in term 0.
I20260808 02:31:36.160764 3985 leader_election.cc:302] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c79aa635d6bf4ca29c8396475ce17bfb, d20264ccdfeb48978ef42511d9424140; no voters:
I20260808 02:31:36.161083 4327 raft_consensus.cc:2781] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:31:36.161185 4327 raft_consensus.cc:482] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:31:36.161248 4327 raft_consensus.cc:3037] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:36.163301 4327 raft_consensus.cc:504] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38969 } } peers { permanent_uuid: "d20264ccdfeb48978ef42511d9424140" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46137 } } peers { permanent_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 35417 } }
I20260808 02:31:36.163812 4327 leader_election.cc:288] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb [CANDIDATE]: Term 1 election: Requested vote from peers d20264ccdfeb48978ef42511d9424140 (127.24.116.194:46137), 5ae9c4be9bb94fecaf86e3c0c4311f1e (127.24.116.193:35417)
I20260808 02:31:36.164414 3872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c1952d5b7be48699d1e1dc1d733dbb4" candidate_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d20264ccdfeb48978ef42511d9424140"
I20260808 02:31:36.164435 3654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c1952d5b7be48699d1e1dc1d733dbb4" candidate_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e"
I20260808 02:31:36.164646 3654 raft_consensus.cc:3037] T 8c1952d5b7be48699d1e1dc1d733dbb4 P 5ae9c4be9bb94fecaf86e3c0c4311f1e [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:36.164644 3872 raft_consensus.cc:3037] T 8c1952d5b7be48699d1e1dc1d733dbb4 P d20264ccdfeb48978ef42511d9424140 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:36.167635 3872 raft_consensus.cc:2454] T 8c1952d5b7be48699d1e1dc1d733dbb4 P d20264ccdfeb48978ef42511d9424140 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c79aa635d6bf4ca29c8396475ce17bfb in term 1.
I20260808 02:31:36.167642 3654 raft_consensus.cc:2454] T 8c1952d5b7be48699d1e1dc1d733dbb4 P 5ae9c4be9bb94fecaf86e3c0c4311f1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c79aa635d6bf4ca29c8396475ce17bfb in term 1.
I20260808 02:31:36.168073 3989 leader_election.cc:302] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ae9c4be9bb94fecaf86e3c0c4311f1e, c79aa635d6bf4ca29c8396475ce17bfb; no voters:
I20260808 02:31:36.168392 4327 raft_consensus.cc:2781] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:31:36.168849 4327 raft_consensus.cc:686] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb [term 1 LEADER]: Becoming Leader. State: Replica: c79aa635d6bf4ca29c8396475ce17bfb, State: Running, Role: LEADER
I20260808 02:31:36.169343 4327 consensus_queue.cc:237] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38969 } } peers { permanent_uuid: "d20264ccdfeb48978ef42511d9424140" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46137 } } peers { permanent_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 35417 } }
I20260808 02:31:36.169973 4329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.169466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.24.116.195:40613)
0808 02:31:36.169656 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:36.169765 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 02:31:36.172247 3445 catalog_manager.cc:5495] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb reported cstate change: term changed from 0 to 1, leader changed from <none> to c79aa635d6bf4ca29c8396475ce17bfb (127.24.116.195). New cstate: current_term: 1 leader_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79aa635d6bf4ca29c8396475ce17bfb" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d20264ccdfeb48978ef42511d9424140" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 35417 } health_report { overall_health: UNKNOWN } } }
I20260808 02:31:36.194443 4308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.190091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59286 (local address 127.24.116.195:38969)
0808 02:31:36.190274 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:36.190279 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:36.190296 (+ 17us) server_negotiation.cc:407] Connection header received
0808 02:31:36.190441 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:36.190445 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:36.190509 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:36.190586 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:31:36.190945 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:36.191646 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:36.192978 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:36.193377 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:36.193473 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:36.193873 (+ 400us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:31:36.193981 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:31:36.194049 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:36.194180 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 02:31:36.194244 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 02:31:36.197796 3872 raft_consensus.cc:1261] T 8c1952d5b7be48699d1e1dc1d733dbb4 P d20264ccdfeb48978ef42511d9424140 [term 1 FOLLOWER]: Refusing update from remote peer c79aa635d6bf4ca29c8396475ce17bfb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:31:36.197870 3654 raft_consensus.cc:1261] T 8c1952d5b7be48699d1e1dc1d733dbb4 P 5ae9c4be9bb94fecaf86e3c0c4311f1e [term 1 FOLLOWER]: Refusing update from remote peer c79aa635d6bf4ca29c8396475ce17bfb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:31:36.198474 4331 consensus_queue.cc:1035] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d20264ccdfeb48978ef42511d9424140" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:31:36.198851 4327 consensus_queue.cc:1035] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ae9c4be9bb94fecaf86e3c0c4311f1e" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 35417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:31:36.201779 4328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.200827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.24.116.194:50823)
0808 02:31:36.201143 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:36.201415 (+ 272us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 02:31:36.201845 4324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.201268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.24.116.193:58381)
0808 02:31:36.201515 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:36.201631 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147}
I20260808 02:31:36.207919 4328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.206728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.24.116.194:48831)
0808 02:31:36.207015 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:36.207131 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145}
I20260808 02:31:36.211158 4337 mvcc.cc:205] Tried to move back new op lower bound from 7316096189219528704 to 7316096189111742464. Current Snapshot: MvccSnapshot[applied={T|T < 7316096189219528704}]
I20260808 02:31:36.219111 4339 mvcc.cc:205] Tried to move back new op lower bound from 7316096189219528704 to 7316096189111742464. Current Snapshot: MvccSnapshot[applied={T|T < 7316096189219528704}]
I20260808 02:31:36.220721 4324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.220099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.24.116.193:57603)
0808 02:31:36.220455 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:36.220558 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233}
I20260808 02:31:36.221635 4329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.220993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.24.116.195:51487)
0808 02:31:36.221262 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:36.221390 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
I20260808 02:31:36.225557 4329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.224809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.24.116.195:50447)
0808 02:31:36.225283 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:36.225392 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364}
I20260808 02:31:36.229242 3440 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52460:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:31:36.229516 3440 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52460:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:31:36.234897 3440 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 146343da39844d15be75c5d54005a43b: Sending DeleteTablet for 3 replicas of tablet 8c1952d5b7be48699d1e1dc1d733dbb4
I20260808 02:31:36.236002 4056 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c1952d5b7be48699d1e1dc1d733dbb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:36 UTC) from {username='oryx', principal='oryx/127.24.116.252@KRBTEST.COM'} at 127.0.0.1:59272
I20260808 02:31:36.236191 3843 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c1952d5b7be48699d1e1dc1d733dbb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:36 UTC) from {username='oryx', principal='oryx/127.24.116.252@KRBTEST.COM'} at 127.0.0.1:55658
I20260808 02:31:36.236202 3617 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c1952d5b7be48699d1e1dc1d733dbb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:36 UTC) from {username='oryx', principal='oryx/127.24.116.252@KRBTEST.COM'} at 127.0.0.1:38774
I20260808 02:31:36.236855 4349 tablet_replica.cc:330] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb: stopping tablet replica
I20260808 02:31:36.237823 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 3496
I20260808 02:31:36.251894 4350 tablet_replica.cc:330] T 8c1952d5b7be48699d1e1dc1d733dbb4 P 5ae9c4be9bb94fecaf86e3c0c4311f1e: stopping tablet replica
I20260808 02:31:36.252142 4350 raft_consensus.cc:2229] T 8c1952d5b7be48699d1e1dc1d733dbb4 P 5ae9c4be9bb94fecaf86e3c0c4311f1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:31:36.252609 4349 raft_consensus.cc:2229] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:31:36.252796 4351 tablet_replica.cc:330] T 8c1952d5b7be48699d1e1dc1d733dbb4 P d20264ccdfeb48978ef42511d9424140: stopping tablet replica
I20260808 02:31:36.252995 4351 raft_consensus.cc:2229] T 8c1952d5b7be48699d1e1dc1d733dbb4 P d20264ccdfeb48978ef42511d9424140 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:31:36.253170 4349 raft_consensus.cc:2258] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:36.253302 4351 raft_consensus.cc:2258] T 8c1952d5b7be48699d1e1dc1d733dbb4 P d20264ccdfeb48978ef42511d9424140 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:36.253758 4350 raft_consensus.cc:2258] T 8c1952d5b7be48699d1e1dc1d733dbb4 P 5ae9c4be9bb94fecaf86e3c0c4311f1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:36.254913 4349 ts_tablet_manager.cc:1905] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:36.255329 4350 ts_tablet_manager.cc:1905] T 8c1952d5b7be48699d1e1dc1d733dbb4 P 5ae9c4be9bb94fecaf86e3c0c4311f1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:36.256850 4351 ts_tablet_manager.cc:1905] T 8c1952d5b7be48699d1e1dc1d733dbb4 P d20264ccdfeb48978ef42511d9424140: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:36.260454 4350 ts_tablet_manager.cc:1918] T 8c1952d5b7be48699d1e1dc1d733dbb4 P 5ae9c4be9bb94fecaf86e3c0c4311f1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:31:36.260664 4350 log.cc:1196] T 8c1952d5b7be48699d1e1dc1d733dbb4 P 5ae9c4be9bb94fecaf86e3c0c4311f1e: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/8c1952d5b7be48699d1e1dc1d733dbb4
I20260808 02:31:36.263417 4351 ts_tablet_manager.cc:1918] T 8c1952d5b7be48699d1e1dc1d733dbb4 P d20264ccdfeb48978ef42511d9424140: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:31:36.263548 4351 log.cc:1196] T 8c1952d5b7be48699d1e1dc1d733dbb4 P d20264ccdfeb48978ef42511d9424140: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/8c1952d5b7be48699d1e1dc1d733dbb4
I20260808 02:31:36.264003 4351 ts_tablet_manager.cc:1939] T 8c1952d5b7be48699d1e1dc1d733dbb4 P d20264ccdfeb48978ef42511d9424140: Deleting consensus metadata
I20260808 02:31:36.264237 4349 ts_tablet_manager.cc:1918] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:31:36.265260 3421 catalog_manager.cc:4841] TS d20264ccdfeb48978ef42511d9424140 (127.24.116.194:46137): tablet 8c1952d5b7be48699d1e1dc1d733dbb4 (table test-table [id=a3b0921be146459784cccc06810f0f22]) successfully deleted
I20260808 02:31:36.266628 4350 ts_tablet_manager.cc:1939] T 8c1952d5b7be48699d1e1dc1d733dbb4 P 5ae9c4be9bb94fecaf86e3c0c4311f1e: Deleting consensus metadata
I20260808 02:31:36.269019 3423 catalog_manager.cc:4841] TS 5ae9c4be9bb94fecaf86e3c0c4311f1e (127.24.116.193:35417): tablet 8c1952d5b7be48699d1e1dc1d733dbb4 (table test-table [id=a3b0921be146459784cccc06810f0f22]) successfully deleted
I20260808 02:31:36.270151 4349 log.cc:1196] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/8c1952d5b7be48699d1e1dc1d733dbb4
I20260808 02:31:36.270593 4349 ts_tablet_manager.cc:1939] T 8c1952d5b7be48699d1e1dc1d733dbb4 P c79aa635d6bf4ca29c8396475ce17bfb: Deleting consensus metadata
I20260808 02:31:36.271595 3421 catalog_manager.cc:4841] TS c79aa635d6bf4ca29c8396475ce17bfb (127.24.116.195:38969): tablet 8c1952d5b7be48699d1e1dc1d733dbb4 (table test-table [id=a3b0921be146459784cccc06810f0f22]) successfully deleted
I20260808 02:31:36.274713 4315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.238669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38790 (local address 127.24.116.193:35417)
0808 02:31:36.238878 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:36.238884 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:36.253895 (+ 15011us) server_negotiation.cc:407] Connection header received
0808 02:31:36.254208 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:36.254214 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:36.254346 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:36.254492 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:36.256273 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:36.257394 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:36.262692 (+ 5298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:36.263444 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:36.263576 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:36.268107 (+ 4531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:36.268126 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:36.268147 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:36.268212 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:36.271897 (+ 3685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:36.272665 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:36.272676 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:36.272679 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:36.272838 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:36.273197 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:36.273202 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:36.273206 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:36.273628 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:36.273938 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:36.274141 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 02:31:36.274357 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 02:31:36.275447 3710 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:36.369268 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 3496
I20260808 02:31:36.394389 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 3737
I20260808 02:31:36.408808 4309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.395176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55662 (local address 127.24.116.194:46137)
0808 02:31:36.395425 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:36.395432 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:36.395452 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:31:36.395618 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:36.395624 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:36.395711 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:36.395818 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:36.397394 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:36.398241 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:36.399521 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:36.399941 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:36.400083 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:36.402807 (+ 2724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:36.402833 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:36.402850 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:36.402884 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:36.405860 (+ 2976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:36.406551 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:36.406561 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:36.406565 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:36.406723 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:36.407135 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:36.407140 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:36.407143 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:36.407533 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:36.407872 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:36.408198 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 02:31:36.408490 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 02:31:36.409533 3935 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:36.467976 4282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.467540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.0.0.1:51822)
0808 02:31:36.467740 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:36.467840 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 02:31:36.469056 4282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.468677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33319 (local address 127.0.0.1:51838)
0808 02:31:36.468857 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:36.468923 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:33319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 02:31:36.522323 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 3737
I20260808 02:31:36.547765 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 3960
I20260808 02:31:36.562340 4308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:36.548652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59288 (local address 127.24.116.195:38969)
0808 02:31:36.548838 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:36.548843 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:36.548861 (+ 18us) server_negotiation.cc:407] Connection header received
0808 02:31:36.549026 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:36.549031 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:36.549103 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:36.549189 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:36.550672 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:36.551472 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:36.553026 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:36.553449 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:36.553602 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:36.556577 (+ 2975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:36.556593 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:36.556610 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:36.556643 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:36.559636 (+ 2993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:36.560388 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:36.560400 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:36.560403 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:36.560543 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:36.560917 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:36.560920 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:36.560922 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:36.561270 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:36.561499 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:36.561786 (+ 287us) server_negotiation.cc:299] Negotiation successful
0808 02:31:36.561964 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 02:31:36.563174 4153 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:36.685665 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 3960
I20260808 02:31:36.718027 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 2924
I20260808 02:31:36.719527 3187 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:36.847710 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 2924
I20260808 02:31:36.881810 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 3078
I20260808 02:31:36.882898 3488 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:37.006117 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 3078
2026-08-08T02:31:37Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (10262 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:31:37 dist-test-slave-45dx krb5kdc[4366](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:31:37 dist-test-slave-45dx krb5kdc[4366](info): set up 2 sockets
Aug 08 02:31:37 dist-test-slave-45dx krb5kdc[4366](info): commencing operation
krb5kdc: starting...
W20260808 02:31:38.425334 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.366s user 0.000s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:31:38 dist-test-slave-45dx krb5kdc[4366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156298, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:31:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:31:38Z Disabled control of system clock
WARNING: no policy specified for oryx/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.254.keytab.
Entry for principal oryx/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.254.keytab.
I20260808 02:31:38.697652 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:33147
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.254.keytab
--principal=oryx/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:38389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:33147
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:39.040616 4387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:39.040903 4387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:39.040993 4387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:39.048106 4387 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:31:39.048216 4387 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 02:31:39.048260 4387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:39.048358 4387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:39.048436 4387 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:31:39.048506 4387 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:31:39.058326 4387 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:38389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:33147
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.254.keytab
--principal=oryx/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:33147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:39.059561 4387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:39.060864 4387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:39.072860 4394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:39.072814 4397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:39.072837 4395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:39.073724 4387 server_base.cc:1034] running on GCE node
I20260808 02:31:39.074467 4387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:39.075809 4387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:39.077020 4387 hybrid_clock.cc:648] HybridClock initialized: now 1786156299076959 us; error 41 us; skew 500 ppm
I20260808 02:31:39.077374 4387 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:39 dist-test-slave-45dx krb5kdc[4366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156299, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:39.080533 4387 init.cc:377] Logged in from keytab as oryx/127.24.116.254@KRBTEST.COM (short username oryx)
I20260808 02:31:39.082027 4387 webserver.cc:460] Webserver started at http://127.24.116.254:36847/ using document root <none> and password file <none>
I20260808 02:31:39.082751 4387 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:39.082885 4387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:39.083222 4387 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:39.086290 4387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "f32373aefd404e458d8777b277bc8dcc"
format_stamp: "Formatted at 2026-08-08 02:31:39 on dist-test-slave-45dx"
server_key: "e8fffaad03163a7fe5a11a556a477208"
server_key_iv: "bcfff9a34c11113488532461f36846d2"
server_key_version: "encryptionkey@0"
I20260808 02:31:39.087101 4387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "f32373aefd404e458d8777b277bc8dcc"
format_stamp: "Formatted at 2026-08-08 02:31:39 on dist-test-slave-45dx"
server_key: "e8fffaad03163a7fe5a11a556a477208"
server_key_iv: "bcfff9a34c11113488532461f36846d2"
server_key_version: "encryptionkey@0"
I20260808 02:31:39.092249 4387 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 02:31:39.095777 4414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:39.097117 4387 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:31:39.097308 4387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "f32373aefd404e458d8777b277bc8dcc"
format_stamp: "Formatted at 2026-08-08 02:31:39 on dist-test-slave-45dx"
server_key: "e8fffaad03163a7fe5a11a556a477208"
server_key_iv: "bcfff9a34c11113488532461f36846d2"
server_key_version: "encryptionkey@0"
I20260808 02:31:39.097548 4387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:39.118760 4387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:39.123065 4387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:39.123374 4387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:39.146252 4387 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:33147
I20260808 02:31:39.146276 4501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:33147 every 8 connection(s)
I20260808 02:31:39.147681 4387 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:31:39.151582 4504 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:39.155422 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 4387
I20260808 02:31:39.155647 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:31:39.156555 25043 external_mini_cluster.cc:1428] Setting key c2d5d087293c1055cf8b307f406d5822
I20260808 02:31:39.163363 4504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc: Bootstrap starting.
I20260808 02:31:39.166445 4504 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:39.167472 4504 log.cc:824] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc: Log is configured to *not* fsync() on all Append() calls
I20260808 02:31:39.170241 4504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc: No bootstrap required, opened a new log
Aug 08 02:31:39 dist-test-slave-45dx krb5kdc[4366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156298, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM
I20260808 02:31:39.179960 4504 raft_consensus.cc:348] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f32373aefd404e458d8777b277bc8dcc" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33147 } }
I20260808 02:31:39.180347 4512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:39.158744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42664 (local address 127.24.116.254:33147)
0808 02:31:39.159529 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:39.159541 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:39.159633 (+ 92us) server_negotiation.cc:407] Connection header received
0808 02:31:39.162030 (+ 2397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:39.162053 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:39.162423 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:39.162823 (+ 400us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:39.164402 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:39.165717 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:39.167057 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:39.167801 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:39.168001 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:39.172703 (+ 4702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:39.172714 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:39.172729 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:39.172773 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:39.175927 (+ 3154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:39.176813 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:39.176821 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:39.176830 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:39.177015 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:39.177431 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:39.177434 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:39.177437 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:39.178051 (+ 614us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:39.178305 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:39.178800 (+ 495us) server_negotiation.cc:299] Negotiation successful
0808 02:31:39.179227 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":564,"thread_start_us":330,"threads_started":1}
I20260808 02:31:39.180469 4504 raft_consensus.cc:374] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:39.180598 4504 raft_consensus.cc:729] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f32373aefd404e458d8777b277bc8dcc, State: Initialized, Role: FOLLOWER
I20260808 02:31:39.181195 4504 consensus_queue.cc:260] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f32373aefd404e458d8777b277bc8dcc" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33147 } }
I20260808 02:31:39.181459 4504 raft_consensus.cc:388] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:31:39.181641 4504 raft_consensus.cc:482] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:31:39.181850 4504 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:39.184196 4504 raft_consensus.cc:504] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f32373aefd404e458d8777b277bc8dcc" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33147 } }
I20260808 02:31:39.184742 4504 leader_election.cc:302] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f32373aefd404e458d8777b277bc8dcc; no voters:
I20260808 02:31:39.185406 4504 leader_election.cc:288] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:31:39.185590 4515 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:31:39.186491 4515 raft_consensus.cc:686] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc [term 1 LEADER]: Becoming Leader. State: Replica: f32373aefd404e458d8777b277bc8dcc, State: Running, Role: LEADER
I20260808 02:31:39.187041 4515 consensus_queue.cc:237] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f32373aefd404e458d8777b277bc8dcc" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33147 } }
I20260808 02:31:39.187652 4504 sys_catalog.cc:564] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:31:39.190060 4517 sys_catalog.cc:455] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc [sys.catalog]: SysCatalogTable state changed. Reason: New leader f32373aefd404e458d8777b277bc8dcc. Latest consensus state: current_term: 1 leader_uuid: "f32373aefd404e458d8777b277bc8dcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f32373aefd404e458d8777b277bc8dcc" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33147 } } }
I20260808 02:31:39.190081 4516 sys_catalog.cc:455] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f32373aefd404e458d8777b277bc8dcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f32373aefd404e458d8777b277bc8dcc" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33147 } } }
I20260808 02:31:39.190543 4517 sys_catalog.cc:458] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:39.190580 4516 sys_catalog.cc:458] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:39.194173 4523 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:31:39.200680 4523 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:31:39.209944 4523 catalog_manager.cc:1347] Generated new cluster ID: 6cf673e49dc840cf8d59c3f67673e846
I20260808 02:31:39.210093 4523 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:31:39.220221 4523 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:31:39.221537 4523 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:31:39.229797 4523 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc: Generated new TSK 0
I20260808 02:31:39.230635 4523 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.24.116.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.116.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.116.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.193.keytab.
Entry for principal oryx/127.24.116.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.193.keytab.
I20260808 02:31:39.300967 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:33147
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.193.keytab
--principal=oryx/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:38389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:39.646088 4543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:39.646375 4543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:39.646543 4543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:39.653954 4543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:39.654181 4543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:39.654361 4543 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 02:31:39.654513 4543 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:31:39.664909 4543 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:38389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.193.keytab
--principal=oryx/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.116.254:33147
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:39.666420 4543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:39.667732 4543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:39.680986 4550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:39.681506 4557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:39.681581 4549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:39.682667 4543 server_base.cc:1034] running on GCE node
I20260808 02:31:39.683362 4543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:39.684641 4543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:39.685899 4543 hybrid_clock.cc:648] HybridClock initialized: now 1786156299685820 us; error 64 us; skew 500 ppm
I20260808 02:31:39.686221 4543 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:39 dist-test-slave-45dx krb5kdc[4366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156299, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:39.694264 4543 init.cc:377] Logged in from keytab as oryx/127.24.116.193@KRBTEST.COM (short username oryx)
I20260808 02:31:39.695827 4543 webserver.cc:460] Webserver started at http://127.24.116.193:35469/ using document root <none> and password file <none>
I20260808 02:31:39.696733 4543 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:39.696885 4543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:39.697248 4543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:39.700479 4543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "c2ee14ed64b344b59d9dda2d88c154fc"
format_stamp: "Formatted at 2026-08-08 02:31:39 on dist-test-slave-45dx"
server_key: "7f22f0391e76ded7cc1cac43fa31a515"
server_key_iv: "0e07fa91eaf109ac968e10b7a187453f"
server_key_version: "encryptionkey@0"
I20260808 02:31:39.701416 4543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "c2ee14ed64b344b59d9dda2d88c154fc"
format_stamp: "Formatted at 2026-08-08 02:31:39 on dist-test-slave-45dx"
server_key: "7f22f0391e76ded7cc1cac43fa31a515"
server_key_iv: "0e07fa91eaf109ac968e10b7a187453f"
server_key_version: "encryptionkey@0"
I20260808 02:31:39.706910 4543 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260808 02:31:39.710621 4565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:39.711951 4543 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 02:31:39.712137 4543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "c2ee14ed64b344b59d9dda2d88c154fc"
format_stamp: "Formatted at 2026-08-08 02:31:39 on dist-test-slave-45dx"
server_key: "7f22f0391e76ded7cc1cac43fa31a515"
server_key_iv: "0e07fa91eaf109ac968e10b7a187453f"
server_key_version: "encryptionkey@0"
I20260808 02:31:39.712430 4543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:39.734793 4543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:39.739197 4543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:39.739490 4543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:39.742429 4543 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:39.742558 4543 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:39.742710 4543 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:39.742821 4543 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 02:31:39 dist-test-slave-45dx krb5kdc[4366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156299, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM
I20260808 02:31:39.768597 4580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:39.743193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:60061 (local address 127.24.116.254:33147)
0808 02:31:39.748650 (+ 5457us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:39.748655 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:39.748671 (+ 16us) server_negotiation.cc:407] Connection header received
0808 02:31:39.748727 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:39.748731 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:39.748831 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:39.749030 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:39.751340 (+ 2310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:39.752708 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:39.755387 (+ 2679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:39.756153 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:39.756349 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:39.761590 (+ 5241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:39.761599 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:39.761608 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:39.761641 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:39.764844 (+ 3203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:39.765637 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:39.765645 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:39.765652 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:39.765848 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:39.766315 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:39.766324 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:39.766329 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:39.766788 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:39.766964 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:39.767706 (+ 742us) server_negotiation.cc:299] Negotiation successful
0808 02:31:39.768026 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5346,"thread_start_us":5260,"threads_started":1}
I20260808 02:31:39.769574 4583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:39.743787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33147 (local address 127.24.116.193:60061)
0808 02:31:39.744670 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:39.744716 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:39.746658 (+ 1942us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:39.749305 (+ 2647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:39.749322 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:39.750251 (+ 929us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:39.751098 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:39.751138 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:39.752907 (+ 1769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:39.752916 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:39.755218 (+ 2302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:39.755234 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:39.756494 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:39.756505 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:39.756823 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:39.757783 (+ 960us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:39.757832 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:39.761348 (+ 3516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:39.765022 (+ 3674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:39.765029 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:39.765042 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:39.765471 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:39.765985 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:39.765988 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:39.765991 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:39.766192 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:39.766929 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:39.766935 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:39.767296 (+ 361us) client_negotiation.cc:769] Sending connection context
0808 02:31:39.767538 (+ 242us) client_negotiation.cc:240] Negotiation successful
0808 02:31:39.767930 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":373,"threads_started":1}
I20260808 02:31:39.790982 4580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:39.775926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:58849 (local address 127.24.116.254:33147)
0808 02:31:39.776168 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:39.776177 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:39.776783 (+ 606us) server_negotiation.cc:407] Connection header received
0808 02:31:39.776980 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:39.776983 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:39.777047 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:39.777127 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:39.778674 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:39.779354 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:39.781276 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:39.782101 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:39.782255 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:39.785100 (+ 2845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:39.785105 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:39.785108 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:39.785137 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:39.787690 (+ 2553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:39.788436 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:39.788445 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:39.788451 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:39.788665 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:39.789211 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:39.789219 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:39.789224 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:39.789626 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:39.789789 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:39.790358 (+ 569us) server_negotiation.cc:299] Negotiation successful
0808 02:31:39.790596 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 02:31:39.791092 4671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:39.775874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33147 (local address 127.24.116.193:58849)
0808 02:31:39.776657 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:39.776683 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:39.776857 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:39.777197 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:39.777205 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:39.778033 (+ 828us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:39.778516 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:39.778533 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:39.779501 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:39.779512 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:39.781074 (+ 1562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:39.781098 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:39.782488 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:39.782500 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:39.782758 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:39.783589 (+ 831us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:39.783614 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:39.784824 (+ 1210us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:39.787841 (+ 3017us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:39.787848 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:39.787853 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:39.788264 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:39.788834 (+ 570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:39.788839 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:39.788847 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:39.789049 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:39.789750 (+ 701us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:39.789759 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:39.790025 (+ 266us) client_negotiation.cc:769] Sending connection context
0808 02:31:39.790216 (+ 191us) client_negotiation.cc:240] Negotiation successful
0808 02:31:39.790598 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":380,"threads_started":1}
I20260808 02:31:39.800297 4543 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:36405
I20260808 02:31:39.800420 4745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:36405 every 8 connection(s)
I20260808 02:31:39.801719 4543 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:31:39.803975 4747 heartbeater.cc:347] Connected to a master server at 127.24.116.254:33147
I20260808 02:31:39.804165 4747 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:39.804915 4747 heartbeater.cc:511] Master 127.24.116.254:33147 requested a full tablet report, sending...
I20260808 02:31:39.806910 4440 ts_manager.cc:194] Registered new tserver with Master: c2ee14ed64b344b59d9dda2d88c154fc (127.24.116.193:36405)
I20260808 02:31:39.808586 4440 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.116.193@KRBTEST.COM'} at 127.24.116.193:60061
I20260808 02:31:39.810334 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 4543
I20260808 02:31:39.810559 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:31:39.811410 25043 external_mini_cluster.cc:1428] Setting key 5508da13345cf4fde6368669d01b8f3f
WARNING: no policy specified for oryx/127.24.116.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.116.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.116.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.194.keytab.
Entry for principal oryx/127.24.116.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.194.keytab.
I20260808 02:31:39.871575 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:33147
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.194.keytab
--principal=oryx/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:38389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:40.236896 4756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:40.237210 4756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:40.237391 4756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:40.244860 4756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:40.245021 4756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:40.245167 4756 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 02:31:40.245306 4756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:31:40.255389 4756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:38389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.194.keytab
--principal=oryx/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.116.254:33147
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:40.256913 4756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:40.258308 4756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:40.274299 4766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:40.274423 4765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:40.274272 4768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:40.275023 4756 server_base.cc:1034] running on GCE node
I20260808 02:31:40.275635 4756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:40.276731 4756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:40.277987 4756 hybrid_clock.cc:648] HybridClock initialized: now 1786156300277919 us; error 42 us; skew 500 ppm
I20260808 02:31:40.278302 4756 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:40 dist-test-slave-45dx krb5kdc[4366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156300, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:40.286375 4756 init.cc:377] Logged in from keytab as oryx/127.24.116.194@KRBTEST.COM (short username oryx)
I20260808 02:31:40.287967 4756 webserver.cc:460] Webserver started at http://127.24.116.194:41575/ using document root <none> and password file <none>
I20260808 02:31:40.288825 4756 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:40.288960 4756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:40.289353 4756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:40.292233 4756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "2acaef350d0a4af9b06f6624b3423c3c"
format_stamp: "Formatted at 2026-08-08 02:31:40 on dist-test-slave-45dx"
server_key: "f691c2eaecf5cac2e29039f6649ea2b6"
server_key_iv: "42275df870e86a7b70c22ce89e506f6b"
server_key_version: "encryptionkey@0"
I20260808 02:31:40.293123 4756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "2acaef350d0a4af9b06f6624b3423c3c"
format_stamp: "Formatted at 2026-08-08 02:31:40 on dist-test-slave-45dx"
server_key: "f691c2eaecf5cac2e29039f6649ea2b6"
server_key_iv: "42275df870e86a7b70c22ce89e506f6b"
server_key_version: "encryptionkey@0"
I20260808 02:31:40.298581 4756 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260808 02:31:40.302285 4777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:40.303644 4756 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 02:31:40.303815 4756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "2acaef350d0a4af9b06f6624b3423c3c"
format_stamp: "Formatted at 2026-08-08 02:31:40 on dist-test-slave-45dx"
server_key: "f691c2eaecf5cac2e29039f6649ea2b6"
server_key_iv: "42275df870e86a7b70c22ce89e506f6b"
server_key_version: "encryptionkey@0"
I20260808 02:31:40.304047 4756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:40.328774 4756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:40.333436 4756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:40.333746 4756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:40.336625 4756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:40.336745 4756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:40.336899 4756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:40.336975 4756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 02:31:40 dist-test-slave-45dx krb5kdc[4366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156300, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM
I20260808 02:31:40.367520 4791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:40.337020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:46099 (local address 127.24.116.254:33147)
0808 02:31:40.337614 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:40.337624 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:40.338883 (+ 1259us) server_negotiation.cc:407] Connection header received
0808 02:31:40.341780 (+ 2897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:40.341789 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:40.341902 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:40.342015 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:40.344740 (+ 2725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:40.346019 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:40.350563 (+ 4544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:40.351370 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:40.351515 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:40.357498 (+ 5983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:40.357508 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:40.357515 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:40.357565 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:40.362535 (+ 4970us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:40.363831 (+ 1296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:40.363840 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:40.363846 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:40.364043 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:40.364746 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:40.364753 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:40.364759 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:40.365243 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:40.366418 (+ 1175us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:40.366704 (+ 286us) server_negotiation.cc:299] Negotiation successful
0808 02:31:40.366988 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":290,"threads_started":1}
I20260808 02:31:40.369462 4795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:40.337802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33147 (local address 127.24.116.194:46099)
0808 02:31:40.338720 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:40.338765 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:40.341355 (+ 2590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:40.342633 (+ 1278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:40.342644 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:40.343527 (+ 883us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:40.344476 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:40.344506 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:40.346233 (+ 1727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:40.346242 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:40.350314 (+ 4072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:40.350335 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:40.351916 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:40.351928 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:40.352293 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:40.353315 (+ 1022us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:40.353346 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:40.357168 (+ 3822us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:40.362765 (+ 5597us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:40.362780 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:40.362815 (+ 35us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:40.363598 (+ 783us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:40.364200 (+ 602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:40.364208 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:40.364214 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:40.364551 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:40.365431 (+ 880us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:40.365445 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:40.366150 (+ 705us) client_negotiation.cc:769] Sending connection context
0808 02:31:40.366563 (+ 413us) client_negotiation.cc:240] Negotiation successful
0808 02:31:40.367332 (+ 769us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":327,"threads_started":1}
I20260808 02:31:40.401782 4888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:40.376632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33147 (local address 127.24.116.194:43531)
0808 02:31:40.377973 (+ 1341us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:40.377999 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:40.378266 (+ 267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:40.378748 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:40.378756 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:40.379661 (+ 905us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:40.380331 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:40.380352 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:40.382095 (+ 1743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:40.382104 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:40.384514 (+ 2410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:40.384539 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:40.387087 (+ 2548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:40.387101 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:40.387425 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:40.388578 (+ 1153us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:40.388612 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:40.391412 (+ 2800us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:40.397756 (+ 6344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:40.397764 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:40.397770 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:40.398418 (+ 648us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:40.398982 (+ 564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:40.398993 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:40.398999 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:40.399200 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:40.400196 (+ 996us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:40.400203 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:40.400498 (+ 295us) client_negotiation.cc:769] Sending connection context
0808 02:31:40.400683 (+ 185us) client_negotiation.cc:240] Negotiation successful
0808 02:31:40.401144 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":918,"thread_start_us":517,"threads_started":1}
I20260808 02:31:40.402954 4791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:40.376351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:43531 (local address 127.24.116.254:33147)
0808 02:31:40.376586 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:40.376595 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:40.378112 (+ 1517us) server_negotiation.cc:407] Connection header received
0808 02:31:40.378449 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:40.378457 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:40.378586 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:40.378709 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:40.380555 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:40.381880 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:40.384754 (+ 2874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:40.385481 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:40.385583 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:40.391727 (+ 6144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:40.391733 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:40.391738 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:40.391785 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:40.396412 (+ 4627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:40.398580 (+ 2168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:40.398589 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:40.398594 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:40.398796 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:40.399359 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:40.399364 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:40.399367 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:40.399939 (+ 572us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:40.400116 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:40.402231 (+ 2115us) server_negotiation.cc:299] Negotiation successful
0808 02:31:40.402534 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260808 02:31:40.409966 4756 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:34063
I20260808 02:31:40.410063 4962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:34063 every 8 connection(s)
I20260808 02:31:40.411558 4756 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:31:40.414000 4964 heartbeater.cc:347] Connected to a master server at 127.24.116.254:33147
I20260808 02:31:40.414237 4964 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:40.415068 4964 heartbeater.cc:511] Master 127.24.116.254:33147 requested a full tablet report, sending...
I20260808 02:31:40.416764 4440 ts_manager.cc:194] Registered new tserver with Master: 2acaef350d0a4af9b06f6624b3423c3c (127.24.116.194:34063)
I20260808 02:31:40.418167 4440 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.116.194@KRBTEST.COM'} at 127.24.116.194:46099
I20260808 02:31:40.419782 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 4756
I20260808 02:31:40.419987 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:31:40.420634 25043 external_mini_cluster.cc:1428] Setting key dcbbe8c0c6dfe0e8c8ba13dc4eb4889c
WARNING: no policy specified for oryx/127.24.116.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.116.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.116.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.195.keytab.
Entry for principal oryx/127.24.116.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.195.keytab.
I20260808 02:31:40.482002 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:33147
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.195.keytab
--principal=oryx/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:38389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:31:40.811715 4747 heartbeater.cc:503] Master 127.24.116.254:33147 was elected leader, sending a full tablet report...
W20260808 02:31:40.831079 4971 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:40.831431 4971 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:40.831624 4971 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:40.838913 4971 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:40.839066 4971 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:40.839221 4971 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 02:31:40.839371 4971 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:31:40.849133 4971 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:38389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.195.keytab
--principal=oryx/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.116.254:33147
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:40.850461 4971 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:40.851846 4971 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:40.866225 4979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:40.866212 4980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:40.866545 4984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:40.867017 4971 server_base.cc:1034] running on GCE node
I20260808 02:31:40.867583 4971 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:40.868525 4971 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:40.869760 4971 hybrid_clock.cc:648] HybridClock initialized: now 1786156300869652 us; error 71 us; skew 500 ppm
I20260808 02:31:40.870110 4971 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:40 dist-test-slave-45dx krb5kdc[4366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156300, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:40.873898 4971 init.cc:377] Logged in from keytab as oryx/127.24.116.195@KRBTEST.COM (short username oryx)
I20260808 02:31:40.875481 4971 webserver.cc:460] Webserver started at http://127.24.116.195:35473/ using document root <none> and password file <none>
I20260808 02:31:40.876210 4971 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:40.876386 4971 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:40.876744 4971 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:40.879706 4971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "b54c7d3bd3024f569cf64e3aa51ee945"
format_stamp: "Formatted at 2026-08-08 02:31:40 on dist-test-slave-45dx"
server_key: "27e5513074a4f67f27ac88e3fb6e2014"
server_key_iv: "2824c88f152262c08975dc586b87420f"
server_key_version: "encryptionkey@0"
I20260808 02:31:40.880609 4971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "b54c7d3bd3024f569cf64e3aa51ee945"
format_stamp: "Formatted at 2026-08-08 02:31:40 on dist-test-slave-45dx"
server_key: "27e5513074a4f67f27ac88e3fb6e2014"
server_key_iv: "2824c88f152262c08975dc586b87420f"
server_key_version: "encryptionkey@0"
I20260808 02:31:40.886024 4971 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 02:31:40.889930 4996 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:40.891307 4971 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:31:40.891502 4971 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "b54c7d3bd3024f569cf64e3aa51ee945"
format_stamp: "Formatted at 2026-08-08 02:31:40 on dist-test-slave-45dx"
server_key: "27e5513074a4f67f27ac88e3fb6e2014"
server_key_iv: "2824c88f152262c08975dc586b87420f"
server_key_version: "encryptionkey@0"
I20260808 02:31:40.891741 4971 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:40.950981 4971 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:40.955228 4971 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:40.955549 4971 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:40.958530 4971 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:40.958642 4971 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:40.958796 4971 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:40.958897 4971 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 02:31:40 dist-test-slave-45dx krb5kdc[4366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156300, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM
I20260808 02:31:40.983021 5007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:40.959069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:38903 (local address 127.24.116.254:33147)
0808 02:31:40.959941 (+ 872us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:40.959945 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:40.960819 (+ 874us) server_negotiation.cc:407] Connection header received
0808 02:31:40.963029 (+ 2210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:40.963035 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:40.963130 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:40.963267 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:40.965621 (+ 2354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:40.966746 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:40.968720 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:40.969342 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:40.969509 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:40.975257 (+ 5748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:40.975265 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:40.975273 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:40.975318 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:40.978486 (+ 3168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:40.979742 (+ 1256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:40.979747 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:40.979749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:40.979877 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:40.980581 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:40.980589 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:40.980595 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:40.981084 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:40.981287 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:40.982124 (+ 837us) server_negotiation.cc:299] Negotiation successful
0808 02:31:40.982451 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":754,"thread_start_us":617,"threads_started":1}
I20260808 02:31:40.983644 5008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:40.959764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33147 (local address 127.24.116.195:38903)
0808 02:31:40.960654 (+ 890us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:40.960696 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:40.962718 (+ 2022us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:40.963539 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:40.963550 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:40.964398 (+ 848us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:40.965409 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:40.965444 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:40.966920 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:40.966927 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:40.968555 (+ 1628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:40.968571 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:40.969658 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:40.969669 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:40.970043 (+ 374us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:40.970988 (+ 945us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:40.971012 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:40.974932 (+ 3920us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:40.978636 (+ 3704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:40.978648 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:40.978673 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:40.979590 (+ 917us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:40.980004 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:40.980012 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:40.980019 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:40.980406 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:40.981235 (+ 829us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:40.981242 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:40.981685 (+ 443us) client_negotiation.cc:769] Sending connection context
0808 02:31:40.981946 (+ 261us) client_negotiation.cc:240] Negotiation successful
0808 02:31:40.982345 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"thread_start_us":365,"threads_started":1}
I20260808 02:31:41.005694 5007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:40.992065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:53709 (local address 127.24.116.254:33147)
0808 02:31:40.992286 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:40.992294 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:40.993044 (+ 750us) server_negotiation.cc:407] Connection header received
0808 02:31:40.993312 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:40.993318 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:40.993391 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:40.993500 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:40.994424 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:40.995253 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:40.996785 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:40.997187 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:40.997335 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:40.999202 (+ 1867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:40.999207 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:40.999210 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:40.999239 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:41.002301 (+ 3062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:41.003240 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:41.003249 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:41.003253 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:41.003434 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:41.003900 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:41.003908 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:41.003914 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:41.004368 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:41.004583 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:41.005069 (+ 486us) server_negotiation.cc:299] Negotiation successful
0808 02:31:41.005301 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 02:31:41.005771 5104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:40.992103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33147 (local address 127.24.116.195:53709)
0808 02:31:40.992932 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:40.992957 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:40.993133 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:40.993530 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:40.993534 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:40.993997 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:40.994284 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:40.994293 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:40.995397 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:40.995406 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:40.996651 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:40.996663 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:40.997383 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:40.997398 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:40.997580 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:40.998259 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:40.998277 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:40.998998 (+ 721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:41.002431 (+ 3433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:41.002438 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:41.002444 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:41.003034 (+ 590us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:41.003553 (+ 519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:41.003559 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:41.003562 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:41.003756 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:41.004507 (+ 751us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:41.004514 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:41.004772 (+ 258us) client_negotiation.cc:769] Sending connection context
0808 02:31:41.004963 (+ 191us) client_negotiation.cc:240] Negotiation successful
0808 02:31:41.005315 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":659,"thread_start_us":447,"threads_started":1}
I20260808 02:31:41.018146 4971 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:37807
I20260808 02:31:41.018175 5187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:37807 every 8 connection(s)
I20260808 02:31:41.019393 4971 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:31:41.021525 5188 heartbeater.cc:347] Connected to a master server at 127.24.116.254:33147
I20260808 02:31:41.021770 5188 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:41.022539 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 4971
I20260808 02:31:41.022583 5188 heartbeater.cc:511] Master 127.24.116.254:33147 requested a full tablet report, sending...
I20260808 02:31:41.022750 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:31:41.023321 25043 external_mini_cluster.cc:1428] Setting key 0dcf7b1a5e8edc550d86a2c9d1440a3e
I20260808 02:31:41.024151 4440 ts_manager.cc:194] Registered new tserver with Master: b54c7d3bd3024f569cf64e3aa51ee945 (127.24.116.195:37807)
I20260808 02:31:41.025069 4440 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.116.195@KRBTEST.COM'} at 127.24.116.195:38903
I20260808 02:31:41.026588 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 02:31:41 dist-test-slave-45dx krb5kdc[4366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156301, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 02:31:41 dist-test-slave-45dx krb5kdc[4366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:41 dist-test-slave-45dx krb5kdc[4366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 02:31:41.089780 5007 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:41.079324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42666 (local address 127.24.116.254:33147)
0808 02:31:41.079577 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:41.079584 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:41.079826 (+ 242us) server_negotiation.cc:407] Connection header received
0808 02:31:41.079979 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:41.079984 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:41.080064 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:41.080164 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:41.081594 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.082334 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.083560 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.083958 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.084049 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.089547 (+ 5498us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42666: BlockingRecv error: recv got EOF from 127.0.0.1:42666 (error 108)
Metrics: {"server-negotiator.queue_time_us":100}
Aug 08 02:31:41 dist-test-slave-45dx krb5kdc[4366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156301, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM
I20260808 02:31:41.106386 5007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.093169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42682 (local address 127.24.116.254:33147)
0808 02:31:41.093407 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:41.093414 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:41.093600 (+ 186us) server_negotiation.cc:407] Connection header received
0808 02:31:41.093717 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:41.093721 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:41.093787 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:41.093873 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:41.094960 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.095762 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.097188 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.097730 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.097864 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.101718 (+ 3854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:41.101732 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:41.101736 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:41.101767 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:41.104282 (+ 2515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:41.104893 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:41.104897 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:41.104899 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:41.105013 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:41.105331 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:41.105335 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:41.105336 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:41.105573 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:41.105790 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:41.106007 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 02:31:41.106165 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 02:31:41.110769 4438 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42682:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:31:41.117926 4438 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:31:41.151505 5212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.130320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:34063 (local address 127.0.0.1:38762)
0808 02:31:41.137575 (+ 7255us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:41.137635 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:41.137901 (+ 266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:41.142442 (+ 4541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:41.142454 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:41.142497 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:41.143090 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:41.143109 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.145748 (+ 2639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.145754 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:41.148493 (+ 2739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:41.148508 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.150391 (+ 1883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.150398 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:41.150621 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.150691 (+ 70us) client_negotiation.cc:769] Sending connection context
0808 02:31:41.150808 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 02:31:41.151013 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6910,"mutex_wait_us":4,"thread_start_us":6716,"threads_started":1}
I20260808 02:31:41.152967 5214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.130481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38762 (local address 127.24.116.194:34063)
0808 02:31:41.141595 (+ 11114us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:41.141603 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:41.141635 (+ 32us) server_negotiation.cc:407] Connection header received
0808 02:31:41.141763 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:41.141775 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:41.142135 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:41.143361 (+ 1226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:41.143612 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.145559 (+ 1947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.148686 (+ 3127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.150118 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.152196 (+ 2078us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.152404 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:41.152469 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 02:31:41.152644 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10957,"thread_start_us":10824,"threads_started":1}
I20260808 02:31:41.155220 5216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.130890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:36405 (local address 127.0.0.1:38608)
0808 02:31:41.143393 (+ 12503us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:41.143418 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:41.143573 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:41.145371 (+ 1798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:41.145378 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:41.145415 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:41.145928 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:41.145941 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.149023 (+ 3082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.149028 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:41.152269 (+ 3241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:41.152282 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.154415 (+ 2133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.154422 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:41.154603 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.154652 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 02:31:41.154719 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 02:31:41.154845 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12305,"thread_start_us":13682,"threads_started":1}
I20260808 02:31:41.156097 5222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.141652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:37807 (local address 127.0.0.1:57246)
0808 02:31:41.146330 (+ 4678us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:41.146347 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:41.146467 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:41.147660 (+ 1193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:41.147665 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:41.147689 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:41.148251 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:41.148262 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.150342 (+ 2080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.150350 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:41.152752 (+ 2402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:41.152767 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.155076 (+ 2309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.155082 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:41.155476 (+ 394us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.155519 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 02:31:41.155595 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 02:31:41.155723 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4544,"mutex_wait_us":82,"thread_start_us":4915,"threads_started":1}
I20260808 02:31:41.156479 5218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.131185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38608 (local address 127.24.116.193:36405)
0808 02:31:41.141280 (+ 10095us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:41.141293 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:41.143729 (+ 2436us) server_negotiation.cc:407] Connection header received
0808 02:31:41.143856 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:41.143867 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:41.144129 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:41.144366 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:41.146140 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.148869 (+ 2729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.152481 (+ 3612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.153920 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.155715 (+ 1795us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.155895 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:41.155965 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 02:31:41.156151 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9875,"thread_start_us":9705,"threads_started":1}
I20260808 02:31:41.157243 5220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.138551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57246 (local address 127.24.116.195:37807)
0808 02:31:41.146826 (+ 8275us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:41.146835 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:41.146867 (+ 32us) server_negotiation.cc:407] Connection header received
0808 02:31:41.146960 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:41.146967 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:41.147181 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:41.147357 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:41.148539 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.150189 (+ 1650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.152938 (+ 2749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.154573 (+ 1635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.154766 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.154916 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:41.156759 (+ 1843us) server_negotiation.cc:299] Negotiation successful
0808 02:31:41.156921 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7136,"thread_start_us":15523,"threads_started":1}
I20260808 02:31:41.157326 4860 tablet_service.cc:1467] Processing CreateTablet for tablet da221903688f4fe4b4aafca1c745c9a3 (DEFAULT_TABLE table=test-table [id=869b348309d3443abd6988da2aae6c31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:31:41.158898 4860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da221903688f4fe4b4aafca1c745c9a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:41.160056 4640 tablet_service.cc:1467] Processing CreateTablet for tablet da221903688f4fe4b4aafca1c745c9a3 (DEFAULT_TABLE table=test-table [id=869b348309d3443abd6988da2aae6c31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:31:41.160713 5073 tablet_service.cc:1467] Processing CreateTablet for tablet da221903688f4fe4b4aafca1c745c9a3 (DEFAULT_TABLE table=test-table [id=869b348309d3443abd6988da2aae6c31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:31:41.161409 4640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da221903688f4fe4b4aafca1c745c9a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:41.162031 5073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da221903688f4fe4b4aafca1c745c9a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:41.174398 5226 tablet_bootstrap.cc:492] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c: Bootstrap starting.
I20260808 02:31:41.175803 5227 tablet_bootstrap.cc:492] T da221903688f4fe4b4aafca1c745c9a3 P c2ee14ed64b344b59d9dda2d88c154fc: Bootstrap starting.
I20260808 02:31:41.177273 5231 tablet_bootstrap.cc:492] T da221903688f4fe4b4aafca1c745c9a3 P b54c7d3bd3024f569cf64e3aa51ee945: Bootstrap starting.
I20260808 02:31:41.178265 5226 tablet_bootstrap.cc:654] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:41.179663 5226 log.cc:824] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c: Log is configured to *not* fsync() on all Append() calls
I20260808 02:31:41.179738 5227 tablet_bootstrap.cc:654] T da221903688f4fe4b4aafca1c745c9a3 P c2ee14ed64b344b59d9dda2d88c154fc: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:41.180373 5231 tablet_bootstrap.cc:654] T da221903688f4fe4b4aafca1c745c9a3 P b54c7d3bd3024f569cf64e3aa51ee945: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:41.181164 5227 log.cc:824] T da221903688f4fe4b4aafca1c745c9a3 P c2ee14ed64b344b59d9dda2d88c154fc: Log is configured to *not* fsync() on all Append() calls
I20260808 02:31:41.181648 5231 log.cc:824] T da221903688f4fe4b4aafca1c745c9a3 P b54c7d3bd3024f569cf64e3aa51ee945: Log is configured to *not* fsync() on all Append() calls
I20260808 02:31:41.183231 5226 tablet_bootstrap.cc:492] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c: No bootstrap required, opened a new log
I20260808 02:31:41.183511 5226 ts_tablet_manager.cc:1397] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.006s
I20260808 02:31:41.184289 5227 tablet_bootstrap.cc:492] T da221903688f4fe4b4aafca1c745c9a3 P c2ee14ed64b344b59d9dda2d88c154fc: No bootstrap required, opened a new log
I20260808 02:31:41.184587 5227 ts_tablet_manager.cc:1397] T da221903688f4fe4b4aafca1c745c9a3 P c2ee14ed64b344b59d9dda2d88c154fc: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260808 02:31:41.184725 5231 tablet_bootstrap.cc:492] T da221903688f4fe4b4aafca1c745c9a3 P b54c7d3bd3024f569cf64e3aa51ee945: No bootstrap required, opened a new log
I20260808 02:31:41.184986 5231 ts_tablet_manager.cc:1397] T da221903688f4fe4b4aafca1c745c9a3 P b54c7d3bd3024f569cf64e3aa51ee945: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260808 02:31:41.191735 5226 raft_consensus.cc:348] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } } peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } }
I20260808 02:31:41.192251 5226 raft_consensus.cc:374] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:41.192389 5226 raft_consensus.cc:729] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2acaef350d0a4af9b06f6624b3423c3c, State: Initialized, Role: FOLLOWER
I20260808 02:31:41.193023 5226 consensus_queue.cc:260] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } } peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } }
I20260808 02:31:41.194139 4964 heartbeater.cc:503] Master 127.24.116.254:33147 was elected leader, sending a full tablet report...
I20260808 02:31:41.194849 5226 ts_tablet_manager.cc:1428] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c: Time spent starting tablet: real 0.011s user 0.011s sys 0.001s
I20260808 02:31:41.195456 5227 raft_consensus.cc:348] T da221903688f4fe4b4aafca1c745c9a3 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } } peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } }
I20260808 02:31:41.195899 5227 raft_consensus.cc:374] T da221903688f4fe4b4aafca1c745c9a3 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:41.195999 5227 raft_consensus.cc:729] T da221903688f4fe4b4aafca1c745c9a3 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2ee14ed64b344b59d9dda2d88c154fc, State: Initialized, Role: FOLLOWER
I20260808 02:31:41.196286 5231 raft_consensus.cc:348] T da221903688f4fe4b4aafca1c745c9a3 P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } } peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } }
I20260808 02:31:41.196810 5231 raft_consensus.cc:374] T da221903688f4fe4b4aafca1c745c9a3 P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:41.196902 5231 raft_consensus.cc:729] T da221903688f4fe4b4aafca1c745c9a3 P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b54c7d3bd3024f569cf64e3aa51ee945, State: Initialized, Role: FOLLOWER
I20260808 02:31:41.196722 5227 consensus_queue.cc:260] T da221903688f4fe4b4aafca1c745c9a3 P c2ee14ed64b344b59d9dda2d88c154fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } } peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } }
I20260808 02:31:41.197530 5231 consensus_queue.cc:260] T da221903688f4fe4b4aafca1c745c9a3 P b54c7d3bd3024f569cf64e3aa51ee945 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } } peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } }
I20260808 02:31:41.198797 5227 ts_tablet_manager.cc:1428] T da221903688f4fe4b4aafca1c745c9a3 P c2ee14ed64b344b59d9dda2d88c154fc: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260808 02:31:41.200220 5188 heartbeater.cc:503] Master 127.24.116.254:33147 was elected leader, sending a full tablet report...
I20260808 02:31:41.201437 5231 ts_tablet_manager.cc:1428] T da221903688f4fe4b4aafca1c745c9a3 P b54c7d3bd3024f569cf64e3aa51ee945: Time spent starting tablet: real 0.016s user 0.011s sys 0.004s
W20260808 02:31:41.271189 5189 tablet.cc:2369] T da221903688f4fe4b4aafca1c745c9a3 P b54c7d3bd3024f569cf64e3aa51ee945: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:31:41.304590 4748 tablet.cc:2369] T da221903688f4fe4b4aafca1c745c9a3 P c2ee14ed64b344b59d9dda2d88c154fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:31:41.413949 4965 tablet.cc:2369] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:31:41.471586 5238 raft_consensus.cc:482] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:31:41.472015 5238 raft_consensus.cc:504] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } } peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } }
I20260808 02:31:41.473991 5238 leader_election.cc:288] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b54c7d3bd3024f569cf64e3aa51ee945 (127.24.116.195:37807), c2ee14ed64b344b59d9dda2d88c154fc (127.24.116.193:36405)
I20260808 02:31:41.481422 5220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.474592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:43705 (local address 127.24.116.195:37807)
0808 02:31:41.474844 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:41.474854 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:41.475586 (+ 732us) server_negotiation.cc:407] Connection header received
0808 02:31:41.475746 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:41.475755 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:41.475854 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:41.475962 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:41.476651 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.477675 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.479609 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.480459 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.480658 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.480735 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:41.481020 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 02:31:41.481152 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 02:31:41.481559 5218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.474452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:57061 (local address 127.24.116.193:36405)
0808 02:31:41.474897 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:41.474908 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:41.476195 (+ 1287us) server_negotiation.cc:407] Connection header received
0808 02:31:41.476386 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:41.476397 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:41.476455 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:41.476526 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:41.477056 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.478005 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.479739 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.480611 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.480786 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.480884 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:41.481186 (+ 302us) server_negotiation.cc:299] Negotiation successful
0808 02:31:41.481317 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232}
I20260808 02:31:41.481585 5243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.474429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:37807 (local address 127.24.116.194:43705)
0808 02:31:41.475480 (+ 1051us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:41.475500 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:41.475623 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:41.476008 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:41.476013 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:41.476038 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:41.476471 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:41.476481 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.477809 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.477813 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:41.479447 (+ 1634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:41.479459 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.480672 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.480679 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:41.480837 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.480883 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 02:31:41.480994 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 02:31:41.481120 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":907,"mutex_wait_us":2,"thread_start_us":1355,"threads_started":1}
I20260808 02:31:41.481885 5242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.474434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:36405 (local address 127.24.116.194:57061)
0808 02:31:41.476067 (+ 1633us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:41.476112 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:41.476237 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:41.476571 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:41.476579 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:41.476608 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:41.476895 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:41.476902 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.478137 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.478143 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:41.479570 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:41.479582 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.480836 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.480843 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:41.481031 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.481055 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 02:31:41.481160 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 02:31:41.481286 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1513,"mutex_wait_us":68,"thread_start_us":674,"threads_started":1}
I20260808 02:31:41.482936 5108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da221903688f4fe4b4aafca1c745c9a3" candidate_uuid: "2acaef350d0a4af9b06f6624b3423c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" is_pre_election: true
I20260808 02:31:41.482949 4680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da221903688f4fe4b4aafca1c745c9a3" candidate_uuid: "2acaef350d0a4af9b06f6624b3423c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" is_pre_election: true
I20260808 02:31:41.483522 5108 raft_consensus.cc:2454] T da221903688f4fe4b4aafca1c745c9a3 P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2acaef350d0a4af9b06f6624b3423c3c in term 0.
I20260808 02:31:41.483521 4680 raft_consensus.cc:2454] T da221903688f4fe4b4aafca1c745c9a3 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2acaef350d0a4af9b06f6624b3423c3c in term 0.
I20260808 02:31:41.484213 4786 leader_election.cc:302] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2acaef350d0a4af9b06f6624b3423c3c, b54c7d3bd3024f569cf64e3aa51ee945; no voters:
I20260808 02:31:41.484659 5238 raft_consensus.cc:2781] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:31:41.484843 5238 raft_consensus.cc:482] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:31:41.484958 5238 raft_consensus.cc:3037] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:41.487375 5238 raft_consensus.cc:504] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } } peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } }
I20260808 02:31:41.488101 5238 leader_election.cc:288] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c [CANDIDATE]: Term 1 election: Requested vote from peers b54c7d3bd3024f569cf64e3aa51ee945 (127.24.116.195:37807), c2ee14ed64b344b59d9dda2d88c154fc (127.24.116.193:36405)
I20260808 02:31:41.488682 4680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da221903688f4fe4b4aafca1c745c9a3" candidate_uuid: "2acaef350d0a4af9b06f6624b3423c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ee14ed64b344b59d9dda2d88c154fc"
I20260808 02:31:41.488687 5108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da221903688f4fe4b4aafca1c745c9a3" candidate_uuid: "2acaef350d0a4af9b06f6624b3423c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b54c7d3bd3024f569cf64e3aa51ee945"
I20260808 02:31:41.488927 4680 raft_consensus.cc:3037] T da221903688f4fe4b4aafca1c745c9a3 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:41.488935 5108 raft_consensus.cc:3037] T da221903688f4fe4b4aafca1c745c9a3 P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:41.491360 5108 raft_consensus.cc:2454] T da221903688f4fe4b4aafca1c745c9a3 P b54c7d3bd3024f569cf64e3aa51ee945 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2acaef350d0a4af9b06f6624b3423c3c in term 1.
I20260808 02:31:41.491540 4680 raft_consensus.cc:2454] T da221903688f4fe4b4aafca1c745c9a3 P c2ee14ed64b344b59d9dda2d88c154fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2acaef350d0a4af9b06f6624b3423c3c in term 1.
I20260808 02:31:41.492030 4783 leader_election.cc:302] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2acaef350d0a4af9b06f6624b3423c3c, c2ee14ed64b344b59d9dda2d88c154fc; no voters:
I20260808 02:31:41.492451 5238 raft_consensus.cc:2781] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:31:41.492969 5238 raft_consensus.cc:686] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c [term 1 LEADER]: Becoming Leader. State: Replica: 2acaef350d0a4af9b06f6624b3423c3c, State: Running, Role: LEADER
I20260808 02:31:41.493507 5238 consensus_queue.cc:237] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } } peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } }
I20260808 02:31:41.498593 4438 catalog_manager.cc:5495] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2acaef350d0a4af9b06f6624b3423c3c (127.24.116.194). New cstate: current_term: 1 leader_uuid: "2acaef350d0a4af9b06f6624b3423c3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } health_report { overall_health: UNKNOWN } } }
I20260808 02:31:41.534525 5214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.529378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38764 (local address 127.24.116.194:34063)
0808 02:31:41.529583 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:41.529587 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:41.529696 (+ 109us) server_negotiation.cc:407] Connection header received
0808 02:31:41.529880 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:41.529884 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:41.529980 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:41.530112 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:31:41.530452 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.531139 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.532531 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.532922 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.533011 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.533476 (+ 465us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:31:41.534004 (+ 528us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:31:41.534110 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:41.534228 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 02:31:41.534293 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 02:31:41.543202 4680 raft_consensus.cc:1261] T da221903688f4fe4b4aafca1c745c9a3 P c2ee14ed64b344b59d9dda2d88c154fc [term 1 FOLLOWER]: Refusing update from remote peer 2acaef350d0a4af9b06f6624b3423c3c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:31:41.543202 5108 raft_consensus.cc:1261] T da221903688f4fe4b4aafca1c745c9a3 P b54c7d3bd3024f569cf64e3aa51ee945 [term 1 FOLLOWER]: Refusing update from remote peer 2acaef350d0a4af9b06f6624b3423c3c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:31:41.544435 5238 consensus_queue.cc:1035] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:31:41.544780 5245 consensus_queue.cc:1035] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:31:41.571066 4440 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42682:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:31:41.571321 4440 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42682:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:31:41.575575 4440 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc: Sending DeleteTablet for 3 replicas of tablet da221903688f4fe4b4aafca1c745c9a3
I20260808 02:31:41.576941 4860 tablet_service.cc:1514] Processing DeleteTablet for tablet da221903688f4fe4b4aafca1c745c9a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:41 UTC) from {username='oryx', principal='oryx/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:38762
I20260808 02:31:41.577034 4640 tablet_service.cc:1514] Processing DeleteTablet for tablet da221903688f4fe4b4aafca1c745c9a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:41 UTC) from {username='oryx', principal='oryx/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:38608
I20260808 02:31:41.577852 5073 tablet_service.cc:1514] Processing DeleteTablet for tablet da221903688f4fe4b4aafca1c745c9a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:41 UTC) from {username='oryx', principal='oryx/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:57246
I20260808 02:31:41.578981 5269 tablet_replica.cc:330] T da221903688f4fe4b4aafca1c745c9a3 P b54c7d3bd3024f569cf64e3aa51ee945: stopping tablet replica
I20260808 02:31:41.579516 5269 raft_consensus.cc:2229] T da221903688f4fe4b4aafca1c745c9a3 P b54c7d3bd3024f569cf64e3aa51ee945 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:31:41.580142 5269 raft_consensus.cc:2258] T da221903688f4fe4b4aafca1c745c9a3 P b54c7d3bd3024f569cf64e3aa51ee945 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:41.580523 4440 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42682:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 02:31:41.581312 5267 tablet_replica.cc:330] T da221903688f4fe4b4aafca1c745c9a3 P c2ee14ed64b344b59d9dda2d88c154fc: stopping tablet replica
W20260808 02:31:41.581465 4440 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:31:41.581911 5267 raft_consensus.cc:2229] T da221903688f4fe4b4aafca1c745c9a3 P c2ee14ed64b344b59d9dda2d88c154fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:31:41.582504 5267 raft_consensus.cc:2258] T da221903688f4fe4b4aafca1c745c9a3 P c2ee14ed64b344b59d9dda2d88c154fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:41.583413 5268 tablet_replica.cc:330] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c: stopping tablet replica
I20260808 02:31:41.583895 5268 raft_consensus.cc:2229] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:31:41.584654 5268 raft_consensus.cc:2258] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:41.585050 5267 ts_tablet_manager.cc:1905] T da221903688f4fe4b4aafca1c745c9a3 P c2ee14ed64b344b59d9dda2d88c154fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:41.586874 5269 ts_tablet_manager.cc:1905] T da221903688f4fe4b4aafca1c745c9a3 P b54c7d3bd3024f569cf64e3aa51ee945: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:41.591759 4640 tablet_service.cc:1467] Processing CreateTablet for tablet 3bfa2f0d4c904b4e8c657a70d778cac4 (DEFAULT_TABLE table=test-table [id=8dc7bdfaf44f4489a87d1bc2e4b4b438]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:31:41.592237 4640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bfa2f0d4c904b4e8c657a70d778cac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:41.593883 5268 ts_tablet_manager.cc:1905] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:41.595172 5073 tablet_service.cc:1467] Processing CreateTablet for tablet 3bfa2f0d4c904b4e8c657a70d778cac4 (DEFAULT_TABLE table=test-table [id=8dc7bdfaf44f4489a87d1bc2e4b4b438]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:31:41.596102 4860 tablet_service.cc:1467] Processing CreateTablet for tablet 3bfa2f0d4c904b4e8c657a70d778cac4 (DEFAULT_TABLE table=test-table [id=8dc7bdfaf44f4489a87d1bc2e4b4b438]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:31:41.596652 4860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bfa2f0d4c904b4e8c657a70d778cac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:41.595517 5269 ts_tablet_manager.cc:1918] T da221903688f4fe4b4aafca1c745c9a3 P b54c7d3bd3024f569cf64e3aa51ee945: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:31:41.597007 5269 log.cc:1196] T da221903688f4fe4b4aafca1c745c9a3 P b54c7d3bd3024f569cf64e3aa51ee945: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/da221903688f4fe4b4aafca1c745c9a3
I20260808 02:31:41.597637 5269 ts_tablet_manager.cc:1939] T da221903688f4fe4b4aafca1c745c9a3 P b54c7d3bd3024f569cf64e3aa51ee945: Deleting consensus metadata
I20260808 02:31:41.595687 5073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bfa2f0d4c904b4e8c657a70d778cac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:41.602825 4417 catalog_manager.cc:4841] TS b54c7d3bd3024f569cf64e3aa51ee945 (127.24.116.195:37807): tablet da221903688f4fe4b4aafca1c745c9a3 (table test-table [id=869b348309d3443abd6988da2aae6c31]) successfully deleted
I20260808 02:31:41.606352 5231 tablet_bootstrap.cc:492] T 3bfa2f0d4c904b4e8c657a70d778cac4 P b54c7d3bd3024f569cf64e3aa51ee945: Bootstrap starting.
I20260808 02:31:41.607209 5268 ts_tablet_manager.cc:1918] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:31:41.607532 5268 log.cc:1196] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/da221903688f4fe4b4aafca1c745c9a3
I20260808 02:31:41.608132 5231 tablet_bootstrap.cc:654] T 3bfa2f0d4c904b4e8c657a70d778cac4 P b54c7d3bd3024f569cf64e3aa51ee945: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:41.608390 5268 ts_tablet_manager.cc:1939] T da221903688f4fe4b4aafca1c745c9a3 P 2acaef350d0a4af9b06f6624b3423c3c: Deleting consensus metadata
I20260808 02:31:41.609265 5227 tablet_bootstrap.cc:492] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc: Bootstrap starting.
I20260808 02:31:41.609326 5226 tablet_bootstrap.cc:492] T 3bfa2f0d4c904b4e8c657a70d778cac4 P 2acaef350d0a4af9b06f6624b3423c3c: Bootstrap starting.
I20260808 02:31:41.611032 5226 tablet_bootstrap.cc:654] T 3bfa2f0d4c904b4e8c657a70d778cac4 P 2acaef350d0a4af9b06f6624b3423c3c: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:41.611035 5227 tablet_bootstrap.cc:654] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:41.612838 5267 ts_tablet_manager.cc:1918] T da221903688f4fe4b4aafca1c745c9a3 P c2ee14ed64b344b59d9dda2d88c154fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:31:41.613031 5267 log.cc:1196] T da221903688f4fe4b4aafca1c745c9a3 P c2ee14ed64b344b59d9dda2d88c154fc: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/da221903688f4fe4b4aafca1c745c9a3
I20260808 02:31:41.613641 5267 ts_tablet_manager.cc:1939] T da221903688f4fe4b4aafca1c745c9a3 P c2ee14ed64b344b59d9dda2d88c154fc: Deleting consensus metadata
I20260808 02:31:41.615777 4415 catalog_manager.cc:4841] TS c2ee14ed64b344b59d9dda2d88c154fc (127.24.116.193:36405): tablet da221903688f4fe4b4aafca1c745c9a3 (table test-table [id=869b348309d3443abd6988da2aae6c31]) successfully deleted
I20260808 02:31:41.616582 4417 catalog_manager.cc:4841] TS 2acaef350d0a4af9b06f6624b3423c3c (127.24.116.194:34063): tablet da221903688f4fe4b4aafca1c745c9a3 (table test-table [id=869b348309d3443abd6988da2aae6c31]) successfully deleted
I20260808 02:31:41.618156 5227 tablet_bootstrap.cc:492] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc: No bootstrap required, opened a new log
I20260808 02:31:41.618337 5227 ts_tablet_manager.cc:1397] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260808 02:31:41.618863 5226 tablet_bootstrap.cc:492] T 3bfa2f0d4c904b4e8c657a70d778cac4 P 2acaef350d0a4af9b06f6624b3423c3c: No bootstrap required, opened a new log
I20260808 02:31:41.619026 5226 ts_tablet_manager.cc:1397] T 3bfa2f0d4c904b4e8c657a70d778cac4 P 2acaef350d0a4af9b06f6624b3423c3c: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.005s
I20260808 02:31:41.619231 5227 raft_consensus.cc:348] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:41.619475 5227 raft_consensus.cc:374] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:41.619576 5227 raft_consensus.cc:729] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2ee14ed64b344b59d9dda2d88c154fc, State: Initialized, Role: FOLLOWER
I20260808 02:31:41.619864 5227 consensus_queue.cc:260] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:41.619877 5226 raft_consensus.cc:348] T 3bfa2f0d4c904b4e8c657a70d778cac4 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:41.620118 5226 raft_consensus.cc:374] T 3bfa2f0d4c904b4e8c657a70d778cac4 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:41.620225 5226 raft_consensus.cc:729] T 3bfa2f0d4c904b4e8c657a70d778cac4 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2acaef350d0a4af9b06f6624b3423c3c, State: Initialized, Role: FOLLOWER
I20260808 02:31:41.620560 5227 ts_tablet_manager.cc:1428] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 02:31:41.620553 5226 consensus_queue.cc:260] T 3bfa2f0d4c904b4e8c657a70d778cac4 P 2acaef350d0a4af9b06f6624b3423c3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:41.621181 5226 ts_tablet_manager.cc:1428] T 3bfa2f0d4c904b4e8c657a70d778cac4 P 2acaef350d0a4af9b06f6624b3423c3c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 02:31:41.622321 5231 tablet_bootstrap.cc:492] T 3bfa2f0d4c904b4e8c657a70d778cac4 P b54c7d3bd3024f569cf64e3aa51ee945: No bootstrap required, opened a new log
I20260808 02:31:41.622537 5231 ts_tablet_manager.cc:1397] T 3bfa2f0d4c904b4e8c657a70d778cac4 P b54c7d3bd3024f569cf64e3aa51ee945: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.003s
I20260808 02:31:41.623410 5231 raft_consensus.cc:348] T 3bfa2f0d4c904b4e8c657a70d778cac4 P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:41.623719 5231 raft_consensus.cc:374] T 3bfa2f0d4c904b4e8c657a70d778cac4 P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:41.623886 5231 raft_consensus.cc:729] T 3bfa2f0d4c904b4e8c657a70d778cac4 P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b54c7d3bd3024f569cf64e3aa51ee945, State: Initialized, Role: FOLLOWER
I20260808 02:31:41.624251 5231 consensus_queue.cc:260] T 3bfa2f0d4c904b4e8c657a70d778cac4 P b54c7d3bd3024f569cf64e3aa51ee945 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:41.625524 5231 ts_tablet_manager.cc:1428] T 3bfa2f0d4c904b4e8c657a70d778cac4 P b54c7d3bd3024f569cf64e3aa51ee945: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 02:31:41.734553 5239 raft_consensus.cc:482] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:31:41.734843 5239 raft_consensus.cc:504] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:41.736864 5239 leader_election.cc:288] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2acaef350d0a4af9b06f6624b3423c3c (127.24.116.194:34063), b54c7d3bd3024f569cf64e3aa51ee945 (127.24.116.195:37807)
I20260808 02:31:41.746011 5214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.737289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:58083 (local address 127.24.116.194:34063)
0808 02:31:41.737555 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:41.737565 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:41.738046 (+ 481us) server_negotiation.cc:407] Connection header received
0808 02:31:41.738335 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:41.738342 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:41.738420 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:41.738486 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:41.739461 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.740647 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.743338 (+ 2691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.744690 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.744835 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.744919 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:41.745508 (+ 589us) server_negotiation.cc:299] Negotiation successful
0808 02:31:41.745653 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 02:31:41.747025 5275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.737196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:34063 (local address 127.24.116.193:58083)
0808 02:31:41.737861 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:41.737882 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:41.738163 (+ 281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:41.738714 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:41.738719 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:41.738761 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:41.739239 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:41.739253 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.740867 (+ 1614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.740876 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:41.743124 (+ 2248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:41.743140 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.745123 (+ 1983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.745130 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:41.745306 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.745342 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 02:31:41.746474 (+ 1132us) client_negotiation.cc:240] Negotiation successful
0808 02:31:41.746628 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"mutex_wait_us":3,"thread_start_us":354,"threads_started":1}
I20260808 02:31:41.747045 5220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.738378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:58131 (local address 127.24.116.195:37807)
0808 02:31:41.738569 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:41.738575 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:41.740116 (+ 1541us) server_negotiation.cc:407] Connection header received
0808 02:31:41.740199 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:41.740204 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:41.740294 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:41.740415 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:41.741161 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.742265 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.744691 (+ 2426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.745822 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.745946 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.746015 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:41.746623 (+ 608us) server_negotiation.cc:299] Negotiation successful
0808 02:31:41.746782 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 02:31:41.747644 5277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.738664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:37807 (local address 127.24.116.193:58131)
0808 02:31:41.739379 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:41.739411 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:41.739552 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:41.740573 (+ 1021us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:41.740578 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:41.740602 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:41.740960 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:41.740972 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.742458 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.742463 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:41.744501 (+ 2038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:41.744516 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.746208 (+ 1692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.746214 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:41.746417 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.746459 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 02:31:41.747214 (+ 755us) client_negotiation.cc:240] Negotiation successful
0808 02:31:41.747339 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":376,"threads_started":1}
I20260808 02:31:41.751538 5106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bfa2f0d4c904b4e8c657a70d778cac4" candidate_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" is_pre_election: true
I20260808 02:31:41.751883 5106 raft_consensus.cc:2454] T 3bfa2f0d4c904b4e8c657a70d778cac4 P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2ee14ed64b344b59d9dda2d88c154fc in term 0.
I20260808 02:31:41.751722 4899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bfa2f0d4c904b4e8c657a70d778cac4" candidate_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2acaef350d0a4af9b06f6624b3423c3c" is_pre_election: true
I20260808 02:31:41.752185 4899 raft_consensus.cc:2454] T 3bfa2f0d4c904b4e8c657a70d778cac4 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2ee14ed64b344b59d9dda2d88c154fc in term 0.
I20260808 02:31:41.752908 4571 leader_election.cc:302] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2acaef350d0a4af9b06f6624b3423c3c, c2ee14ed64b344b59d9dda2d88c154fc; no voters:
I20260808 02:31:41.753654 5239 raft_consensus.cc:2781] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:31:41.753760 5239 raft_consensus.cc:482] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:31:41.753837 5239 raft_consensus.cc:3037] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:41.756954 5239 raft_consensus.cc:504] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:41.757633 5239 leader_election.cc:288] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc [CANDIDATE]: Term 1 election: Requested vote from peers 2acaef350d0a4af9b06f6624b3423c3c (127.24.116.194:34063), b54c7d3bd3024f569cf64e3aa51ee945 (127.24.116.195:37807)
I20260808 02:31:41.758328 5106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bfa2f0d4c904b4e8c657a70d778cac4" candidate_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b54c7d3bd3024f569cf64e3aa51ee945"
I20260808 02:31:41.758374 4899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bfa2f0d4c904b4e8c657a70d778cac4" candidate_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2acaef350d0a4af9b06f6624b3423c3c"
I20260808 02:31:41.758549 5106 raft_consensus.cc:3037] T 3bfa2f0d4c904b4e8c657a70d778cac4 P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:41.758579 4899 raft_consensus.cc:3037] T 3bfa2f0d4c904b4e8c657a70d778cac4 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:41.761785 5106 raft_consensus.cc:2454] T 3bfa2f0d4c904b4e8c657a70d778cac4 P b54c7d3bd3024f569cf64e3aa51ee945 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ee14ed64b344b59d9dda2d88c154fc in term 1.
I20260808 02:31:41.761828 4899 raft_consensus.cc:2454] T 3bfa2f0d4c904b4e8c657a70d778cac4 P 2acaef350d0a4af9b06f6624b3423c3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ee14ed64b344b59d9dda2d88c154fc in term 1.
I20260808 02:31:41.762261 4571 leader_election.cc:302] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2acaef350d0a4af9b06f6624b3423c3c, c2ee14ed64b344b59d9dda2d88c154fc; no voters:
I20260808 02:31:41.762599 5239 raft_consensus.cc:2781] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:31:41.763172 5239 raft_consensus.cc:686] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc [term 1 LEADER]: Becoming Leader. State: Replica: c2ee14ed64b344b59d9dda2d88c154fc, State: Running, Role: LEADER
I20260808 02:31:41.763665 5239 consensus_queue.cc:237] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:41.767769 4440 catalog_manager.cc:5495] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc reported cstate change: term changed from 0 to 1, leader changed from <none> to c2ee14ed64b344b59d9dda2d88c154fc (127.24.116.193). New cstate: current_term: 1 leader_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } health_report { overall_health: UNKNOWN } } }
Aug 08 02:31:41 dist-test-slave-45dx krb5kdc[4366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156299, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.254@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM
I20260808 02:31:41.857667 5295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.827109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33147 (local address 127.0.0.1:42696)
0808 02:31:41.840045 (+ 12936us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:41.840068 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:41.840262 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:41.840745 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:41.840754 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:41.841810 (+ 1056us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:41.842132 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:41.842147 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.843690 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.843697 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:41.845464 (+ 1767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:41.845481 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.846426 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.846436 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:41.846672 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.847562 (+ 890us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:41.847590 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:41.850764 (+ 3174us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:41.854984 (+ 4220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:41.854997 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:41.855005 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:41.855524 (+ 519us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:41.855905 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:41.855910 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:41.855913 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:41.856061 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:41.856689 (+ 628us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:41.856695 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:41.856862 (+ 167us) client_negotiation.cc:769] Sending connection context
0808 02:31:41.857026 (+ 164us) client_negotiation.cc:240] Negotiation successful
0808 02:31:41.857300 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12777,"thread_start_us":13179,"threads_started":1}
I20260808 02:31:41.858753 5296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.827123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42696 (local address 127.24.116.254:33147)
0808 02:31:41.839533 (+ 12410us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:41.839540 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:41.840228 (+ 688us) server_negotiation.cc:407] Connection header received
0808 02:31:41.840467 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:41.840473 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:41.840545 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:41.840649 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:41.842324 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.843515 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.845631 (+ 2116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.846235 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.846365 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.851024 (+ 4659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:41.851032 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:41.851038 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:41.851081 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:41.854832 (+ 3751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:41.855647 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:41.855652 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:41.855655 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:41.855789 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:41.856160 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:41.856164 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:41.856166 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:41.856501 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:41.856634 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:41.858168 (+ 1534us) server_negotiation.cc:299] Negotiation successful
0808 02:31:41.858363 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12222,"thread_start_us":12377,"threads_started":1}
I20260808 02:31:41.865115 4440 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:42696:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 02:31:41.866307 4440 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:31:41.875957 5073 tablet_service.cc:1467] Processing CreateTablet for tablet e5763f035cc14a53afc8e47727455c8f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8b880b035f0d476698cd9b628f140442]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 02:31:41.875957 4860 tablet_service.cc:1467] Processing CreateTablet for tablet e5763f035cc14a53afc8e47727455c8f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8b880b035f0d476698cd9b628f140442]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 02:31:41.876618 4860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5763f035cc14a53afc8e47727455c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:41.876616 5073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5763f035cc14a53afc8e47727455c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:41.881165 4640 tablet_service.cc:1467] Processing CreateTablet for tablet e5763f035cc14a53afc8e47727455c8f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8b880b035f0d476698cd9b628f140442]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 02:31:41.881790 4640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5763f035cc14a53afc8e47727455c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:41.884454 5226 tablet_bootstrap.cc:492] T e5763f035cc14a53afc8e47727455c8f P 2acaef350d0a4af9b06f6624b3423c3c: Bootstrap starting.
I20260808 02:31:41.884486 5231 tablet_bootstrap.cc:492] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945: Bootstrap starting.
I20260808 02:31:41.886052 5226 tablet_bootstrap.cc:654] T e5763f035cc14a53afc8e47727455c8f P 2acaef350d0a4af9b06f6624b3423c3c: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:41.886404 5231 tablet_bootstrap.cc:654] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:41.889009 5226 tablet_bootstrap.cc:492] T e5763f035cc14a53afc8e47727455c8f P 2acaef350d0a4af9b06f6624b3423c3c: No bootstrap required, opened a new log
I20260808 02:31:41.889230 5226 ts_tablet_manager.cc:1397] T e5763f035cc14a53afc8e47727455c8f P 2acaef350d0a4af9b06f6624b3423c3c: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s
I20260808 02:31:41.890102 5226 raft_consensus.cc:348] T e5763f035cc14a53afc8e47727455c8f P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:41.890391 5226 raft_consensus.cc:374] T e5763f035cc14a53afc8e47727455c8f P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:41.890486 5226 raft_consensus.cc:729] T e5763f035cc14a53afc8e47727455c8f P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2acaef350d0a4af9b06f6624b3423c3c, State: Initialized, Role: FOLLOWER
I20260808 02:31:41.891781 5226 consensus_queue.cc:260] T e5763f035cc14a53afc8e47727455c8f P 2acaef350d0a4af9b06f6624b3423c3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:41.892477 5226 ts_tablet_manager.cc:1428] T e5763f035cc14a53afc8e47727455c8f P 2acaef350d0a4af9b06f6624b3423c3c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 02:31:41.892339 5238 tablet_replica.cc:439] T e5763f035cc14a53afc8e47727455c8f P 2acaef350d0a4af9b06f6624b3423c3c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } } }
I20260808 02:31:41.892638 5238 tablet_replica.cc:442] T e5763f035cc14a53afc8e47727455c8f P 2acaef350d0a4af9b06f6624b3423c3c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:31:41.896613 5227 tablet_bootstrap.cc:492] T e5763f035cc14a53afc8e47727455c8f P c2ee14ed64b344b59d9dda2d88c154fc: Bootstrap starting.
I20260808 02:31:41.898329 5231 tablet_bootstrap.cc:492] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945: No bootstrap required, opened a new log
I20260808 02:31:41.898531 5227 tablet_bootstrap.cc:654] T e5763f035cc14a53afc8e47727455c8f P c2ee14ed64b344b59d9dda2d88c154fc: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:41.898728 5231 ts_tablet_manager.cc:1397] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260808 02:31:41.899701 5231 raft_consensus.cc:348] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:41.899957 5231 raft_consensus.cc:374] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:41.900040 5231 raft_consensus.cc:729] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b54c7d3bd3024f569cf64e3aa51ee945, State: Initialized, Role: FOLLOWER
I20260808 02:31:41.900318 5231 consensus_queue.cc:260] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:41.901095 5227 tablet_bootstrap.cc:492] T e5763f035cc14a53afc8e47727455c8f P c2ee14ed64b344b59d9dda2d88c154fc: No bootstrap required, opened a new log
I20260808 02:31:41.900826 5241 tablet_replica.cc:439] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } } }
I20260808 02:31:41.901219 5241 tablet_replica.cc:442] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:31:41.901479 5227 ts_tablet_manager.cc:1397] T e5763f035cc14a53afc8e47727455c8f P c2ee14ed64b344b59d9dda2d88c154fc: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 02:31:41.901981 5231 ts_tablet_manager.cc:1428] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 02:31:41.902385 5227 raft_consensus.cc:348] T e5763f035cc14a53afc8e47727455c8f P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:41.902596 5227 raft_consensus.cc:374] T e5763f035cc14a53afc8e47727455c8f P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:41.902647 5227 raft_consensus.cc:729] T e5763f035cc14a53afc8e47727455c8f P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2ee14ed64b344b59d9dda2d88c154fc, State: Initialized, Role: FOLLOWER
I20260808 02:31:41.902879 5227 consensus_queue.cc:260] T e5763f035cc14a53afc8e47727455c8f P c2ee14ed64b344b59d9dda2d88c154fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:41.903630 5227 ts_tablet_manager.cc:1428] T e5763f035cc14a53afc8e47727455c8f P c2ee14ed64b344b59d9dda2d88c154fc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 02:31:41.903499 5239 tablet_replica.cc:439] T e5763f035cc14a53afc8e47727455c8f P c2ee14ed64b344b59d9dda2d88c154fc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } } }
I20260808 02:31:41.903811 5239 tablet_replica.cc:442] T e5763f035cc14a53afc8e47727455c8f P c2ee14ed64b344b59d9dda2d88c154fc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:31:41.906262 5241 raft_consensus.cc:482] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:31:41.906493 5241 raft_consensus.cc:504] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:41.908197 5241 leader_election.cc:288] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2ee14ed64b344b59d9dda2d88c154fc (127.24.116.193:36405), 2acaef350d0a4af9b06f6624b3423c3c (127.24.116.194:34063)
I20260808 02:31:41.917765 5218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.909344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:45841 (local address 127.24.116.193:36405)
0808 02:31:41.909515 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:41.909519 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:41.910523 (+ 1004us) server_negotiation.cc:407] Connection header received
0808 02:31:41.910731 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:41.910739 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:41.910843 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:41.910971 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:41.911673 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.913029 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.915390 (+ 2361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.916662 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.916817 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.916903 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:41.917310 (+ 407us) server_negotiation.cc:299] Negotiation successful
0808 02:31:41.917444 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 02:31:41.917791 5302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.908419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:36405 (local address 127.24.116.195:45841)
0808 02:31:41.910402 (+ 1983us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:41.910424 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:41.910572 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:41.911007 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:41.911012 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:41.911043 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:41.911476 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:41.911491 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.913194 (+ 1703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.913200 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:41.915211 (+ 2011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:41.915224 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.916927 (+ 1703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.916935 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:41.917120 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.917163 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 02:31:41.917282 (+ 119us) client_negotiation.cc:240] Negotiation successful
0808 02:31:41.917445 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1345,"thread_start_us":479,"threads_started":1}
I20260808 02:31:41.918668 4680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5763f035cc14a53afc8e47727455c8f" candidate_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" is_pre_election: true
I20260808 02:31:41.918952 4680 raft_consensus.cc:2454] T e5763f035cc14a53afc8e47727455c8f P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b54c7d3bd3024f569cf64e3aa51ee945 in term 0.
I20260808 02:31:41.919478 4997 leader_election.cc:302] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b54c7d3bd3024f569cf64e3aa51ee945, c2ee14ed64b344b59d9dda2d88c154fc; no voters:
I20260808 02:31:41.919929 5241 raft_consensus.cc:2781] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:31:41.920065 5241 raft_consensus.cc:482] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:31:41.920176 5241 raft_consensus.cc:3037] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:41.920275 5214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.908614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:45921 (local address 127.24.116.194:34063)
0808 02:31:41.909099 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:41.909106 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:41.912990 (+ 3884us) server_negotiation.cc:407] Connection header received
0808 02:31:41.913142 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:41.913147 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:41.913236 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:41.913349 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:31:41.914112 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.915198 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.917701 (+ 2503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.918919 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.919072 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.919145 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:41.919846 (+ 701us) server_negotiation.cc:299] Negotiation successful
0808 02:31:41.919988 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320}
I20260808 02:31:41.920557 5304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.908743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:34063 (local address 127.24.116.195:45921)
0808 02:31:41.912865 (+ 4122us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:41.912885 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:41.913017 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:41.913402 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:41.913407 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:41.913438 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:31:41.913923 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:41.913937 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.915372 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.915379 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:41.917512 (+ 2133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:41.917526 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.919520 (+ 1994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.919524 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:41.919679 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.919717 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 02:31:41.919805 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 02:31:41.919931 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3999,"mutex_wait_us":4,"thread_start_us":3796,"threads_started":1}
I20260808 02:31:41.921151 4899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5763f035cc14a53afc8e47727455c8f" candidate_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2acaef350d0a4af9b06f6624b3423c3c" is_pre_election: true
I20260808 02:31:41.921419 4899 raft_consensus.cc:2454] T e5763f035cc14a53afc8e47727455c8f P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b54c7d3bd3024f569cf64e3aa51ee945 in term 0.
I20260808 02:31:41.923482 5241 raft_consensus.cc:504] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:41.924192 5241 leader_election.cc:288] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945 [CANDIDATE]: Term 1 election: Requested vote from peers c2ee14ed64b344b59d9dda2d88c154fc (127.24.116.193:36405), 2acaef350d0a4af9b06f6624b3423c3c (127.24.116.194:34063)
I20260808 02:31:41.924641 4899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5763f035cc14a53afc8e47727455c8f" candidate_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2acaef350d0a4af9b06f6624b3423c3c"
I20260808 02:31:41.924734 4680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5763f035cc14a53afc8e47727455c8f" candidate_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ee14ed64b344b59d9dda2d88c154fc"
I20260808 02:31:41.924880 4899 raft_consensus.cc:3037] T e5763f035cc14a53afc8e47727455c8f P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:41.924942 4680 raft_consensus.cc:3037] T e5763f035cc14a53afc8e47727455c8f P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:41.927908 4680 raft_consensus.cc:2454] T e5763f035cc14a53afc8e47727455c8f P c2ee14ed64b344b59d9dda2d88c154fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b54c7d3bd3024f569cf64e3aa51ee945 in term 1.
I20260808 02:31:41.928159 4899 raft_consensus.cc:2454] T e5763f035cc14a53afc8e47727455c8f P 2acaef350d0a4af9b06f6624b3423c3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b54c7d3bd3024f569cf64e3aa51ee945 in term 1.
I20260808 02:31:41.928464 4997 leader_election.cc:302] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b54c7d3bd3024f569cf64e3aa51ee945, c2ee14ed64b344b59d9dda2d88c154fc; no voters:
I20260808 02:31:41.928877 5241 raft_consensus.cc:2781] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:31:41.929383 5241 raft_consensus.cc:686] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945 [term 1 LEADER]: Becoming Leader. State: Replica: b54c7d3bd3024f569cf64e3aa51ee945, State: Running, Role: LEADER
I20260808 02:31:41.929836 5241 consensus_queue.cc:237] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:41.932806 5305 tablet_replica.cc:439] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945: TxnStatusTablet state changed. Reason: New leader b54c7d3bd3024f569cf64e3aa51ee945. Latest consensus state: current_term: 1 leader_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } } }
I20260808 02:31:41.933219 5305 tablet_replica.cc:442] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945: This TxnStatusTablet replica's current role is: LEADER
I20260808 02:31:41.934120 5309 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 02:31:41.934384 5309 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 02:31:41.934185 4435 catalog_manager.cc:5495] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945 reported cstate change: term changed from 0 to 1, leader changed from <none> to b54c7d3bd3024f569cf64e3aa51ee945 (127.24.116.195). New cstate: current_term: 1 leader_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } health_report { overall_health: HEALTHY } } }
I20260808 02:31:41.958768 5220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.950933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57260 (local address 127.24.116.195:37807)
0808 02:31:41.951121 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:41.951127 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:41.951442 (+ 315us) server_negotiation.cc:407] Connection header received
0808 02:31:41.951729 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:41.951735 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:41.951847 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:41.952014 (+ 167us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:31:41.952451 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.953675 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.955722 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.956513 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.956658 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.957241 (+ 583us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:31:41.958035 (+ 794us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:31:41.958204 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:41.958324 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 02:31:41.958426 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 02:31:41.958793 5295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.951003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:37807 (local address 127.0.0.1:57260)
0808 02:31:41.951325 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:41.951346 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:41.951501 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:41.952054 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:41.952060 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:41.952074 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:31:41.952277 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:41.952292 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.953832 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.953838 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:41.955541 (+ 1703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:41.955560 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.956688 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:41.956695 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:41.956938 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:41.957017 (+ 79us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:31:41.958167 (+ 1150us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:31:41.958192 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 02:31:41.958290 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 02:31:41.958459 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146}
I20260808 02:31:41.964152 4680 raft_consensus.cc:1261] T e5763f035cc14a53afc8e47727455c8f P c2ee14ed64b344b59d9dda2d88c154fc [term 1 FOLLOWER]: Refusing update from remote peer b54c7d3bd3024f569cf64e3aa51ee945: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:31:41.964562 4899 raft_consensus.cc:1261] T e5763f035cc14a53afc8e47727455c8f P 2acaef350d0a4af9b06f6624b3423c3c [term 1 FOLLOWER]: Refusing update from remote peer b54c7d3bd3024f569cf64e3aa51ee945: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:31:41.965495 5241 consensus_queue.cc:1035] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:31:41.965915 5305 consensus_queue.cc:1035] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:31:41.976794 5239 tablet_replica.cc:439] T e5763f035cc14a53afc8e47727455c8f P c2ee14ed64b344b59d9dda2d88c154fc: TxnStatusTablet state changed. Reason: New leader b54c7d3bd3024f569cf64e3aa51ee945. Latest consensus state: current_term: 1 leader_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } } }
I20260808 02:31:41.977169 5239 tablet_replica.cc:442] T e5763f035cc14a53afc8e47727455c8f P c2ee14ed64b344b59d9dda2d88c154fc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:31:41.978413 5238 tablet_replica.cc:439] T e5763f035cc14a53afc8e47727455c8f P 2acaef350d0a4af9b06f6624b3423c3c: TxnStatusTablet state changed. Reason: New leader b54c7d3bd3024f569cf64e3aa51ee945. Latest consensus state: current_term: 1 leader_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } } }
I20260808 02:31:41.978749 5238 tablet_replica.cc:442] T e5763f035cc14a53afc8e47727455c8f P 2acaef350d0a4af9b06f6624b3423c3c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:31:41.980895 5241 tablet_replica.cc:439] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } } }
I20260808 02:31:41.981217 5241 tablet_replica.cc:442] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945: This TxnStatusTablet replica's current role is: LEADER
I20260808 02:31:41.984714 5238 tablet_replica.cc:439] T e5763f035cc14a53afc8e47727455c8f P 2acaef350d0a4af9b06f6624b3423c3c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } } }
I20260808 02:31:41.985011 5238 tablet_replica.cc:442] T e5763f035cc14a53afc8e47727455c8f P 2acaef350d0a4af9b06f6624b3423c3c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:31:41.987777 5305 tablet_replica.cc:439] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } } }
I20260808 02:31:41.988082 5305 tablet_replica.cc:442] T e5763f035cc14a53afc8e47727455c8f P b54c7d3bd3024f569cf64e3aa51ee945: This TxnStatusTablet replica's current role is: LEADER
I20260808 02:31:41.989466 5252 mvcc.cc:205] Tried to move back new op lower bound from 7316096212836257792 to 7316096212709625856. Current Snapshot: MvccSnapshot[applied={T|T < 7316096212836257792}]
I20260808 02:31:41.990018 5239 tablet_replica.cc:439] T e5763f035cc14a53afc8e47727455c8f P c2ee14ed64b344b59d9dda2d88c154fc: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } } }
I20260808 02:31:41.990365 5239 tablet_replica.cc:442] T e5763f035cc14a53afc8e47727455c8f P c2ee14ed64b344b59d9dda2d88c154fc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:31:42.004455 5218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:41.995903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38610 (local address 127.24.116.193:36405)
0808 02:31:41.996082 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:41.996088 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:41.996107 (+ 19us) server_negotiation.cc:407] Connection header received
0808 02:31:41.996237 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:41.996244 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:41.996438 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:41.996601 (+ 163us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:31:41.997281 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:41.998455 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.000595 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.001290 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.001455 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:42.002256 (+ 801us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:31:42.003121 (+ 865us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:31:42.003281 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:42.004002 (+ 721us) server_negotiation.cc:299] Negotiation successful
0808 02:31:42.004102 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 02:31:42.026292 5220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:42.018541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:40435 (local address 127.24.116.195:37807)
0808 02:31:42.018747 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:42.018753 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:42.019282 (+ 529us) server_negotiation.cc:407] Connection header received
0808 02:31:42.019506 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:42.019516 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:42.019617 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:42.019744 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:31:42.020386 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.021570 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.023604 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.024479 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.024574 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:42.025298 (+ 724us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:31:42.025474 (+ 176us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:31:42.025581 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:42.025811 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 02:31:42.025913 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 02:31:42.027431 5316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:42.018017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:37807 (local address 127.24.116.193:40435)
0808 02:31:42.019143 (+ 1126us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:42.019169 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:42.019336 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:42.019764 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:42.019771 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:42.019785 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:31:42.020152 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:42.020164 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.021735 (+ 1571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.021741 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:42.023431 (+ 1690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:42.023450 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.024771 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.024777 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:42.024980 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:42.025051 (+ 71us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:31:42.025644 (+ 593us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:31:42.025658 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 02:31:42.026829 (+ 1171us) client_negotiation.cc:240] Negotiation successful
0808 02:31:42.026988 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":953,"thread_start_us":812,"threads_started":1}
I20260808 02:31:42.042531 4898 raft_consensus.cc:1261] T 3bfa2f0d4c904b4e8c657a70d778cac4 P 2acaef350d0a4af9b06f6624b3423c3c [term 1 FOLLOWER]: Refusing update from remote peer c2ee14ed64b344b59d9dda2d88c154fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:31:42.042749 5106 raft_consensus.cc:1261] T 3bfa2f0d4c904b4e8c657a70d778cac4 P b54c7d3bd3024f569cf64e3aa51ee945 [term 1 FOLLOWER]: Refusing update from remote peer c2ee14ed64b344b59d9dda2d88c154fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:31:42.043537 5239 consensus_queue.cc:1035] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:31:42.044222 5281 consensus_queue.cc:1035] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:31:42.063270 5250 mvcc.cc:205] Tried to move back new op lower bound from 7316096213157789696 to 7316096212028780544. Current Snapshot: MvccSnapshot[applied={T|T < 7316096213157789696}]
I20260808 02:31:42.129005 5218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:42.102806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:53383 (local address 127.24.116.193:36405)
0808 02:31:42.103003 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:42.103011 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:42.118811 (+ 15800us) server_negotiation.cc:407] Connection header received
0808 02:31:42.119184 (+ 373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:42.119192 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:42.119311 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:42.119402 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:31:42.120444 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.121885 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.126724 (+ 4839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.127410 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.127544 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:42.128143 (+ 599us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:31:42.128282 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:31:42.128403 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:42.128569 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 02:31:42.128661 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 02:31:42.129115 5322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:42.102441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:36405 (local address 127.24.116.195:53383)
0808 02:31:42.118665 (+ 16224us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:42.118695 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:42.118965 (+ 270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:42.119661 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:42.119669 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:42.119687 (+ 18us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:31:42.120164 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:42.120179 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.122077 (+ 1898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.122082 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:42.126521 (+ 4439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:42.126553 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.127621 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.127628 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:42.127828 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:42.127920 (+ 92us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:31:42.128419 (+ 499us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:31:42.128431 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 02:31:42.128511 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 02:31:42.128667 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15592,"thread_start_us":15299,"threads_started":1}
I20260808 02:31:42.186465 4440 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42682:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:31:42.186754 4440 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42682:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:31:42.190794 4440 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc: Sending DeleteTablet for 3 replicas of tablet 3bfa2f0d4c904b4e8c657a70d778cac4
I20260808 02:31:42.191884 4640 tablet_service.cc:1514] Processing DeleteTablet for tablet 3bfa2f0d4c904b4e8c657a70d778cac4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:42 UTC) from {username='oryx', principal='oryx/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:38608
I20260808 02:31:42.191989 4860 tablet_service.cc:1514] Processing DeleteTablet for tablet 3bfa2f0d4c904b4e8c657a70d778cac4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:42 UTC) from {username='oryx', principal='oryx/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:38762
I20260808 02:31:42.192680 5073 tablet_service.cc:1514] Processing DeleteTablet for tablet 3bfa2f0d4c904b4e8c657a70d778cac4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:42 UTC) from {username='oryx', principal='oryx/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:57246
I20260808 02:31:42.200853 5334 tablet_replica.cc:330] T 3bfa2f0d4c904b4e8c657a70d778cac4 P b54c7d3bd3024f569cf64e3aa51ee945: stopping tablet replica
I20260808 02:31:42.201133 5334 raft_consensus.cc:2229] T 3bfa2f0d4c904b4e8c657a70d778cac4 P b54c7d3bd3024f569cf64e3aa51ee945 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:31:42.201463 5334 raft_consensus.cc:2258] T 3bfa2f0d4c904b4e8c657a70d778cac4 P b54c7d3bd3024f569cf64e3aa51ee945 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:42.202798 5334 ts_tablet_manager.cc:1905] T 3bfa2f0d4c904b4e8c657a70d778cac4 P b54c7d3bd3024f569cf64e3aa51ee945: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:42.212146 5334 ts_tablet_manager.cc:1918] T 3bfa2f0d4c904b4e8c657a70d778cac4 P b54c7d3bd3024f569cf64e3aa51ee945: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:31:42.220757 5331 tablet_replica.cc:330] T 3bfa2f0d4c904b4e8c657a70d778cac4 P 2acaef350d0a4af9b06f6624b3423c3c: stopping tablet replica
I20260808 02:31:42.221107 5331 raft_consensus.cc:2229] T 3bfa2f0d4c904b4e8c657a70d778cac4 P 2acaef350d0a4af9b06f6624b3423c3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:31:42.221477 5331 raft_consensus.cc:2258] T 3bfa2f0d4c904b4e8c657a70d778cac4 P 2acaef350d0a4af9b06f6624b3423c3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:42.222822 5331 ts_tablet_manager.cc:1905] T 3bfa2f0d4c904b4e8c657a70d778cac4 P 2acaef350d0a4af9b06f6624b3423c3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:42.224382 5334 log.cc:1196] T 3bfa2f0d4c904b4e8c657a70d778cac4 P b54c7d3bd3024f569cf64e3aa51ee945: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/3bfa2f0d4c904b4e8c657a70d778cac4
I20260808 02:31:42.225044 5334 ts_tablet_manager.cc:1939] T 3bfa2f0d4c904b4e8c657a70d778cac4 P b54c7d3bd3024f569cf64e3aa51ee945: Deleting consensus metadata
I20260808 02:31:42.225610 5329 tablet_replica.cc:330] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc: stopping tablet replica
I20260808 02:31:42.226424 4417 catalog_manager.cc:4841] TS b54c7d3bd3024f569cf64e3aa51ee945 (127.24.116.195:37807): tablet 3bfa2f0d4c904b4e8c657a70d778cac4 (table test-table [id=8dc7bdfaf44f4489a87d1bc2e4b4b438]) successfully deleted
I20260808 02:31:42.226814 5329 raft_consensus.cc:2229] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:31:42.227558 5329 raft_consensus.cc:2258] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:42.232929 5331 ts_tablet_manager.cc:1918] T 3bfa2f0d4c904b4e8c657a70d778cac4 P 2acaef350d0a4af9b06f6624b3423c3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:31:42.233085 5331 log.cc:1196] T 3bfa2f0d4c904b4e8c657a70d778cac4 P 2acaef350d0a4af9b06f6624b3423c3c: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/3bfa2f0d4c904b4e8c657a70d778cac4
I20260808 02:31:42.233582 5331 ts_tablet_manager.cc:1939] T 3bfa2f0d4c904b4e8c657a70d778cac4 P 2acaef350d0a4af9b06f6624b3423c3c: Deleting consensus metadata
I20260808 02:31:42.234843 4417 catalog_manager.cc:4841] TS 2acaef350d0a4af9b06f6624b3423c3c (127.24.116.194:34063): tablet 3bfa2f0d4c904b4e8c657a70d778cac4 (table test-table [id=8dc7bdfaf44f4489a87d1bc2e4b4b438]) successfully deleted
I20260808 02:31:42.235257 5329 ts_tablet_manager.cc:1905] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:42.243202 5329 ts_tablet_manager.cc:1918] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:31:42.243439 5329 log.cc:1196] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/3bfa2f0d4c904b4e8c657a70d778cac4
I20260808 02:31:42.244024 5329 ts_tablet_manager.cc:1939] T 3bfa2f0d4c904b4e8c657a70d778cac4 P c2ee14ed64b344b59d9dda2d88c154fc: Deleting consensus metadata
I20260808 02:31:42.245388 4415 catalog_manager.cc:4841] TS c2ee14ed64b344b59d9dda2d88c154fc (127.24.116.193:36405): tablet 3bfa2f0d4c904b4e8c657a70d778cac4 (table test-table [id=8dc7bdfaf44f4489a87d1bc2e4b4b438]) successfully deleted
Aug 08 02:31:42 dist-test-slave-45dx krb5kdc[4366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156302, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 02:31:42 dist-test-slave-45dx krb5kdc[4366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:42 dist-test-slave-45dx krb5kdc[4366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 02:31:42.298369 5296 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:42.284337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43316 (local address 127.24.116.254:33147)
0808 02:31:42.284535 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:42.284542 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:42.285120 (+ 578us) server_negotiation.cc:407] Connection header received
0808 02:31:42.285305 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:42.285311 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:42.285419 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:42.285532 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:42.287502 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.288779 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.290692 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.291384 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.291526 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:42.298118 (+ 6592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43316: BlockingRecv error: recv got EOF from 127.0.0.1:43316 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 08 02:31:42 dist-test-slave-45dx krb5kdc[4366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156302, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM
I20260808 02:31:42.325902 5296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:42.306884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43328 (local address 127.24.116.254:33147)
0808 02:31:42.307121 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:42.307127 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:42.307773 (+ 646us) server_negotiation.cc:407] Connection header received
0808 02:31:42.307839 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:42.307844 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:42.307941 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:42.308031 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:42.309880 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.310975 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.312866 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.313526 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.313666 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:42.319084 (+ 5418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:42.319093 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:42.319100 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:42.319156 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:42.322843 (+ 3687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:42.323701 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:42.323708 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:42.323712 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:42.323875 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:42.324374 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:42.324379 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:42.324383 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:42.324727 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:42.324999 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:42.325298 (+ 299us) server_negotiation.cc:299] Negotiation successful
0808 02:31:42.325526 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260808 02:31:42.330084 4440 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43328:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:31:42.330884 4440 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:31:42.338822 4640 tablet_service.cc:1467] Processing CreateTablet for tablet 5340cec5eb744451bb5e72262d0a8317 (DEFAULT_TABLE table=test-table [id=39518589f77343baaa00808bbebca9b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:31:42.339171 5073 tablet_service.cc:1467] Processing CreateTablet for tablet 5340cec5eb744451bb5e72262d0a8317 (DEFAULT_TABLE table=test-table [id=39518589f77343baaa00808bbebca9b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:31:42.339355 4640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5340cec5eb744451bb5e72262d0a8317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:42.339636 5073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5340cec5eb744451bb5e72262d0a8317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:42.345005 4860 tablet_service.cc:1467] Processing CreateTablet for tablet 5340cec5eb744451bb5e72262d0a8317 (DEFAULT_TABLE table=test-table [id=39518589f77343baaa00808bbebca9b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:31:42.345438 4860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5340cec5eb744451bb5e72262d0a8317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:42.348567 5227 tablet_bootstrap.cc:492] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc: Bootstrap starting.
I20260808 02:31:42.350320 5227 tablet_bootstrap.cc:654] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:42.351545 5231 tablet_bootstrap.cc:492] T 5340cec5eb744451bb5e72262d0a8317 P b54c7d3bd3024f569cf64e3aa51ee945: Bootstrap starting.
I20260808 02:31:42.353432 5231 tablet_bootstrap.cc:654] T 5340cec5eb744451bb5e72262d0a8317 P b54c7d3bd3024f569cf64e3aa51ee945: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:42.360589 5227 tablet_bootstrap.cc:492] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc: No bootstrap required, opened a new log
I20260808 02:31:42.360937 5227 ts_tablet_manager.cc:1397] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20260808 02:31:42.362746 5227 raft_consensus.cc:348] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:42.363987 5227 raft_consensus.cc:374] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:42.364202 5227 raft_consensus.cc:729] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2ee14ed64b344b59d9dda2d88c154fc, State: Initialized, Role: FOLLOWER
I20260808 02:31:42.364646 5227 consensus_queue.cc:260] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:42.367988 5231 tablet_bootstrap.cc:492] T 5340cec5eb744451bb5e72262d0a8317 P b54c7d3bd3024f569cf64e3aa51ee945: No bootstrap required, opened a new log
I20260808 02:31:42.368178 5231 ts_tablet_manager.cc:1397] T 5340cec5eb744451bb5e72262d0a8317 P b54c7d3bd3024f569cf64e3aa51ee945: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.010s
I20260808 02:31:42.369109 5231 raft_consensus.cc:348] T 5340cec5eb744451bb5e72262d0a8317 P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:42.369401 5231 raft_consensus.cc:374] T 5340cec5eb744451bb5e72262d0a8317 P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:42.369518 5231 raft_consensus.cc:729] T 5340cec5eb744451bb5e72262d0a8317 P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b54c7d3bd3024f569cf64e3aa51ee945, State: Initialized, Role: FOLLOWER
I20260808 02:31:42.369546 5227 ts_tablet_manager.cc:1428] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260808 02:31:42.369809 5231 consensus_queue.cc:260] T 5340cec5eb744451bb5e72262d0a8317 P b54c7d3bd3024f569cf64e3aa51ee945 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:42.371445 5231 ts_tablet_manager.cc:1428] T 5340cec5eb744451bb5e72262d0a8317 P b54c7d3bd3024f569cf64e3aa51ee945: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 02:31:42.372772 5226 tablet_bootstrap.cc:492] T 5340cec5eb744451bb5e72262d0a8317 P 2acaef350d0a4af9b06f6624b3423c3c: Bootstrap starting.
I20260808 02:31:42.374577 5226 tablet_bootstrap.cc:654] T 5340cec5eb744451bb5e72262d0a8317 P 2acaef350d0a4af9b06f6624b3423c3c: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:42.378995 5323 raft_consensus.cc:482] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:31:42.379283 5323 raft_consensus.cc:504] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:42.381053 4898 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5340cec5eb744451bb5e72262d0a8317" candidate_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2acaef350d0a4af9b06f6624b3423c3c" is_pre_election: true
I20260808 02:31:42.382673 5106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5340cec5eb744451bb5e72262d0a8317" candidate_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" is_pre_election: true
I20260808 02:31:42.383011 5106 raft_consensus.cc:2454] T 5340cec5eb744451bb5e72262d0a8317 P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2ee14ed64b344b59d9dda2d88c154fc in term 0.
I20260808 02:31:42.380288 5323 leader_election.cc:288] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2acaef350d0a4af9b06f6624b3423c3c (127.24.116.194:34063), b54c7d3bd3024f569cf64e3aa51ee945 (127.24.116.195:37807)
W20260808 02:31:42.382174 4571 leader_election.cc:341] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2acaef350d0a4af9b06f6624b3423c3c (127.24.116.194:34063): Illegal state: must be running to vote when last-logged opid is not known
I20260808 02:31:42.384363 4571 leader_election.cc:302] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b54c7d3bd3024f569cf64e3aa51ee945, c2ee14ed64b344b59d9dda2d88c154fc; no voters: 2acaef350d0a4af9b06f6624b3423c3c
I20260808 02:31:42.385046 5323 raft_consensus.cc:2781] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:31:42.385187 5323 raft_consensus.cc:482] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:31:42.385295 5323 raft_consensus.cc:3037] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:42.386562 5226 tablet_bootstrap.cc:492] T 5340cec5eb744451bb5e72262d0a8317 P 2acaef350d0a4af9b06f6624b3423c3c: No bootstrap required, opened a new log
I20260808 02:31:42.386725 5226 ts_tablet_manager.cc:1397] T 5340cec5eb744451bb5e72262d0a8317 P 2acaef350d0a4af9b06f6624b3423c3c: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.002s
I20260808 02:31:42.387527 5226 raft_consensus.cc:348] T 5340cec5eb744451bb5e72262d0a8317 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:42.387809 5226 raft_consensus.cc:374] T 5340cec5eb744451bb5e72262d0a8317 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:42.387923 5226 raft_consensus.cc:729] T 5340cec5eb744451bb5e72262d0a8317 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2acaef350d0a4af9b06f6624b3423c3c, State: Initialized, Role: FOLLOWER
I20260808 02:31:42.388152 5226 consensus_queue.cc:260] T 5340cec5eb744451bb5e72262d0a8317 P 2acaef350d0a4af9b06f6624b3423c3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:42.388828 5226 ts_tablet_manager.cc:1428] T 5340cec5eb744451bb5e72262d0a8317 P 2acaef350d0a4af9b06f6624b3423c3c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 02:31:42.389640 5323 raft_consensus.cc:504] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:42.390588 5323 leader_election.cc:288] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc [CANDIDATE]: Term 1 election: Requested vote from peers 2acaef350d0a4af9b06f6624b3423c3c (127.24.116.194:34063), b54c7d3bd3024f569cf64e3aa51ee945 (127.24.116.195:37807)
I20260808 02:31:42.391167 4898 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5340cec5eb744451bb5e72262d0a8317" candidate_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2acaef350d0a4af9b06f6624b3423c3c"
I20260808 02:31:42.391288 5106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5340cec5eb744451bb5e72262d0a8317" candidate_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b54c7d3bd3024f569cf64e3aa51ee945"
I20260808 02:31:42.391379 4898 raft_consensus.cc:3037] T 5340cec5eb744451bb5e72262d0a8317 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:42.391505 5106 raft_consensus.cc:3037] T 5340cec5eb744451bb5e72262d0a8317 P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:42.394428 4898 raft_consensus.cc:2454] T 5340cec5eb744451bb5e72262d0a8317 P 2acaef350d0a4af9b06f6624b3423c3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ee14ed64b344b59d9dda2d88c154fc in term 1.
I20260808 02:31:42.394686 5106 raft_consensus.cc:2454] T 5340cec5eb744451bb5e72262d0a8317 P b54c7d3bd3024f569cf64e3aa51ee945 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ee14ed64b344b59d9dda2d88c154fc in term 1.
I20260808 02:31:42.395509 4571 leader_election.cc:302] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b54c7d3bd3024f569cf64e3aa51ee945, c2ee14ed64b344b59d9dda2d88c154fc; no voters:
I20260808 02:31:42.396152 5323 raft_consensus.cc:2781] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:31:42.396770 5323 raft_consensus.cc:686] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc [term 1 LEADER]: Becoming Leader. State: Replica: c2ee14ed64b344b59d9dda2d88c154fc, State: Running, Role: LEADER
I20260808 02:31:42.397089 5323 consensus_queue.cc:237] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:42.400187 4440 catalog_manager.cc:5495] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc reported cstate change: term changed from 0 to 1, leader changed from <none> to c2ee14ed64b344b59d9dda2d88c154fc (127.24.116.193). New cstate: current_term: 1 leader_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } health_report { overall_health: UNKNOWN } } }
I20260808 02:31:42.432210 5218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:42.425489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45668 (local address 127.24.116.193:36405)
0808 02:31:42.425654 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:42.425660 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:42.425678 (+ 18us) server_negotiation.cc:407] Connection header received
0808 02:31:42.425753 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:42.425758 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:42.425835 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:42.425935 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:31:42.426516 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.427652 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.429680 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.430352 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.430462 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:42.431076 (+ 614us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:31:42.431235 (+ 159us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:31:42.431310 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:42.431838 (+ 528us) server_negotiation.cc:299] Negotiation successful
0808 02:31:42.431925 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 02:31:42.435703 5106 raft_consensus.cc:1261] T 5340cec5eb744451bb5e72262d0a8317 P b54c7d3bd3024f569cf64e3aa51ee945 [term 1 FOLLOWER]: Refusing update from remote peer c2ee14ed64b344b59d9dda2d88c154fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:31:42.436383 4898 raft_consensus.cc:1261] T 5340cec5eb744451bb5e72262d0a8317 P 2acaef350d0a4af9b06f6624b3423c3c [term 1 FOLLOWER]: Refusing update from remote peer c2ee14ed64b344b59d9dda2d88c154fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:31:42.437114 5323 consensus_queue.cc:1035] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:31:42.438481 5323 consensus_queue.cc:1035] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:31:42.460215 4435 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43328:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:31:42.460558 4435 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43328:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:31:42.464665 5251 mvcc.cc:205] Tried to move back new op lower bound from 7316096214768611328 to 7316096214621278208. Current Snapshot: MvccSnapshot[applied={T|T < 7316096214768611328 or (T in {7316096214768611328})}]
I20260808 02:31:42.468809 4640 tablet_service.cc:1514] Processing DeleteTablet for tablet 5340cec5eb744451bb5e72262d0a8317 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:42 UTC) from {username='oryx', principal='oryx/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:38608
I20260808 02:31:42.468977 4435 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc: Sending DeleteTablet for 3 replicas of tablet 5340cec5eb744451bb5e72262d0a8317
I20260808 02:31:42.469144 4860 tablet_service.cc:1514] Processing DeleteTablet for tablet 5340cec5eb744451bb5e72262d0a8317 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:42 UTC) from {username='oryx', principal='oryx/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:38762
I20260808 02:31:42.469425 5331 tablet_replica.cc:330] T 5340cec5eb744451bb5e72262d0a8317 P 2acaef350d0a4af9b06f6624b3423c3c: stopping tablet replica
I20260808 02:31:42.469453 5329 tablet_replica.cc:330] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc: stopping tablet replica
I20260808 02:31:42.469628 5331 raft_consensus.cc:2229] T 5340cec5eb744451bb5e72262d0a8317 P 2acaef350d0a4af9b06f6624b3423c3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:31:42.469669 5329 raft_consensus.cc:2229] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:31:42.469863 5331 raft_consensus.cc:2258] T 5340cec5eb744451bb5e72262d0a8317 P 2acaef350d0a4af9b06f6624b3423c3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:42.470000 5329 raft_consensus.cc:2258] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:42.470556 5073 tablet_service.cc:1514] Processing DeleteTablet for tablet 5340cec5eb744451bb5e72262d0a8317 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:42 UTC) from {username='oryx', principal='oryx/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:57246
I20260808 02:31:42.470849 5334 tablet_replica.cc:330] T 5340cec5eb744451bb5e72262d0a8317 P b54c7d3bd3024f569cf64e3aa51ee945: stopping tablet replica
I20260808 02:31:42.471072 5334 raft_consensus.cc:2229] T 5340cec5eb744451bb5e72262d0a8317 P b54c7d3bd3024f569cf64e3aa51ee945 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:31:42.471181 4860 tablet_service.cc:1514] Processing DeleteTablet for tablet 5340cec5eb744451bb5e72262d0a8317 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:42 UTC) from {username='oryx', principal='oryx/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:38762
I20260808 02:31:42.471292 5334 raft_consensus.cc:2258] T 5340cec5eb744451bb5e72262d0a8317 P b54c7d3bd3024f569cf64e3aa51ee945 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:42.471495 5331 ts_tablet_manager.cc:1905] T 5340cec5eb744451bb5e72262d0a8317 P 2acaef350d0a4af9b06f6624b3423c3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:42.472419 4640 tablet_service.cc:1514] Processing DeleteTablet for tablet 5340cec5eb744451bb5e72262d0a8317 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:42 UTC) from {username='oryx', principal='oryx/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:38608
I20260808 02:31:42.473446 5334 ts_tablet_manager.cc:1905] T 5340cec5eb744451bb5e72262d0a8317 P b54c7d3bd3024f569cf64e3aa51ee945: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:42.474534 4440 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43328:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:31:42.475286 4440 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:31:42.476974 5329 ts_tablet_manager.cc:1905] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:42.478260 5331 ts_tablet_manager.cc:1918] T 5340cec5eb744451bb5e72262d0a8317 P 2acaef350d0a4af9b06f6624b3423c3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:31:42.478400 5331 log.cc:1196] T 5340cec5eb744451bb5e72262d0a8317 P 2acaef350d0a4af9b06f6624b3423c3c: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/5340cec5eb744451bb5e72262d0a8317
I20260808 02:31:42.478807 5331 ts_tablet_manager.cc:1939] T 5340cec5eb744451bb5e72262d0a8317 P 2acaef350d0a4af9b06f6624b3423c3c: Deleting consensus metadata
I20260808 02:31:42.479909 4417 catalog_manager.cc:4841] TS 2acaef350d0a4af9b06f6624b3423c3c (127.24.116.194:34063): tablet 5340cec5eb744451bb5e72262d0a8317 (table test-table [id=39518589f77343baaa00808bbebca9b3]) successfully deleted
I20260808 02:31:42.482127 5334 ts_tablet_manager.cc:1918] T 5340cec5eb744451bb5e72262d0a8317 P b54c7d3bd3024f569cf64e3aa51ee945: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:31:42.482295 5334 log.cc:1196] T 5340cec5eb744451bb5e72262d0a8317 P b54c7d3bd3024f569cf64e3aa51ee945: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/5340cec5eb744451bb5e72262d0a8317
I20260808 02:31:42.482805 5334 ts_tablet_manager.cc:1939] T 5340cec5eb744451bb5e72262d0a8317 P b54c7d3bd3024f569cf64e3aa51ee945: Deleting consensus metadata
I20260808 02:31:42.483932 4417 catalog_manager.cc:4841] TS b54c7d3bd3024f569cf64e3aa51ee945 (127.24.116.195:37807): tablet 5340cec5eb744451bb5e72262d0a8317 (table test-table [id=39518589f77343baaa00808bbebca9b3]) successfully deleted
I20260808 02:31:42.487072 5329 ts_tablet_manager.cc:1918] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:31:42.487377 5329 log.cc:1196] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/5340cec5eb744451bb5e72262d0a8317
I20260808 02:31:42.488088 5329 ts_tablet_manager.cc:1939] T 5340cec5eb744451bb5e72262d0a8317 P c2ee14ed64b344b59d9dda2d88c154fc: Deleting consensus metadata
I20260808 02:31:42.488466 5073 tablet_service.cc:1467] Processing CreateTablet for tablet 03709455ed344a8598f50fbd078da8e3 (DEFAULT_TABLE table=test-table [id=60bb9f5a4c804902a5b45d9753f57608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:31:42.488955 5073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03709455ed344a8598f50fbd078da8e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:42.490374 4860 tablet_service.cc:1467] Processing CreateTablet for tablet 03709455ed344a8598f50fbd078da8e3 (DEFAULT_TABLE table=test-table [id=60bb9f5a4c804902a5b45d9753f57608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:31:42.490821 4860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03709455ed344a8598f50fbd078da8e3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260808 02:31:42.493077 4417 catalog_manager.cc:4808] TS 2acaef350d0a4af9b06f6624b3423c3c (127.24.116.194:34063): delete failed for tablet 5340cec5eb744451bb5e72262d0a8317 because the tablet was not found. No further retry: Not found: Tablet not found: 5340cec5eb744451bb5e72262d0a8317
I20260808 02:31:42.493606 4415 catalog_manager.cc:4841] TS c2ee14ed64b344b59d9dda2d88c154fc (127.24.116.193:36405): tablet 5340cec5eb744451bb5e72262d0a8317 (table test-table [id=39518589f77343baaa00808bbebca9b3]) successfully deleted
W20260808 02:31:42.493862 4415 catalog_manager.cc:4808] TS c2ee14ed64b344b59d9dda2d88c154fc (127.24.116.193:36405): delete failed for tablet 5340cec5eb744451bb5e72262d0a8317 because the tablet was not found. No further retry: Not found: Tablet not found: 5340cec5eb744451bb5e72262d0a8317
I20260808 02:31:42.494596 4640 tablet_service.cc:1467] Processing CreateTablet for tablet 03709455ed344a8598f50fbd078da8e3 (DEFAULT_TABLE table=test-table [id=60bb9f5a4c804902a5b45d9753f57608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:31:42.495007 4640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03709455ed344a8598f50fbd078da8e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:42.500429 5226 tablet_bootstrap.cc:492] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c: Bootstrap starting.
I20260808 02:31:42.502157 5226 tablet_bootstrap.cc:654] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:42.503314 5227 tablet_bootstrap.cc:492] T 03709455ed344a8598f50fbd078da8e3 P c2ee14ed64b344b59d9dda2d88c154fc: Bootstrap starting.
I20260808 02:31:42.505677 5227 tablet_bootstrap.cc:654] T 03709455ed344a8598f50fbd078da8e3 P c2ee14ed64b344b59d9dda2d88c154fc: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:42.507186 5231 tablet_bootstrap.cc:492] T 03709455ed344a8598f50fbd078da8e3 P b54c7d3bd3024f569cf64e3aa51ee945: Bootstrap starting.
I20260808 02:31:42.509663 5231 tablet_bootstrap.cc:654] T 03709455ed344a8598f50fbd078da8e3 P b54c7d3bd3024f569cf64e3aa51ee945: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:42.518026 5227 tablet_bootstrap.cc:492] T 03709455ed344a8598f50fbd078da8e3 P c2ee14ed64b344b59d9dda2d88c154fc: No bootstrap required, opened a new log
I20260808 02:31:42.518256 5227 ts_tablet_manager.cc:1397] T 03709455ed344a8598f50fbd078da8e3 P c2ee14ed64b344b59d9dda2d88c154fc: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.000s
I20260808 02:31:42.519177 5227 raft_consensus.cc:348] T 03709455ed344a8598f50fbd078da8e3 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:42.519472 5227 raft_consensus.cc:374] T 03709455ed344a8598f50fbd078da8e3 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:42.519569 5227 raft_consensus.cc:729] T 03709455ed344a8598f50fbd078da8e3 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2ee14ed64b344b59d9dda2d88c154fc, State: Initialized, Role: FOLLOWER
I20260808 02:31:42.519878 5227 consensus_queue.cc:260] T 03709455ed344a8598f50fbd078da8e3 P c2ee14ed64b344b59d9dda2d88c154fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:42.521909 5227 ts_tablet_manager.cc:1428] T 03709455ed344a8598f50fbd078da8e3 P c2ee14ed64b344b59d9dda2d88c154fc: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260808 02:31:42.522316 5226 tablet_bootstrap.cc:492] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c: No bootstrap required, opened a new log
I20260808 02:31:42.522522 5226 ts_tablet_manager.cc:1397] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c: Time spent bootstrapping tablet: real 0.022s user 0.014s sys 0.007s
I20260808 02:31:42.523252 5226 raft_consensus.cc:348] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:42.523500 5226 raft_consensus.cc:374] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:42.523572 5226 raft_consensus.cc:729] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2acaef350d0a4af9b06f6624b3423c3c, State: Initialized, Role: FOLLOWER
I20260808 02:31:42.524927 5231 tablet_bootstrap.cc:492] T 03709455ed344a8598f50fbd078da8e3 P b54c7d3bd3024f569cf64e3aa51ee945: No bootstrap required, opened a new log
I20260808 02:31:42.525110 5231 ts_tablet_manager.cc:1397] T 03709455ed344a8598f50fbd078da8e3 P b54c7d3bd3024f569cf64e3aa51ee945: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.009s
I20260808 02:31:42.525673 5226 consensus_queue.cc:260] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:42.526243 5226 ts_tablet_manager.cc:1428] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260808 02:31:42.525864 5231 raft_consensus.cc:348] T 03709455ed344a8598f50fbd078da8e3 P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:42.526701 5231 raft_consensus.cc:374] T 03709455ed344a8598f50fbd078da8e3 P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:42.526811 5231 raft_consensus.cc:729] T 03709455ed344a8598f50fbd078da8e3 P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b54c7d3bd3024f569cf64e3aa51ee945, State: Initialized, Role: FOLLOWER
I20260808 02:31:42.527432 5231 consensus_queue.cc:260] T 03709455ed344a8598f50fbd078da8e3 P b54c7d3bd3024f569cf64e3aa51ee945 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:42.528985 5231 ts_tablet_manager.cc:1428] T 03709455ed344a8598f50fbd078da8e3 P b54c7d3bd3024f569cf64e3aa51ee945: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260808 02:31:42.582178 5238 raft_consensus.cc:482] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:31:42.582437 5238 raft_consensus.cc:504] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:42.583256 5238 leader_election.cc:288] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2ee14ed64b344b59d9dda2d88c154fc (127.24.116.193:36405), b54c7d3bd3024f569cf64e3aa51ee945 (127.24.116.195:37807)
I20260808 02:31:42.583819 4680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03709455ed344a8598f50fbd078da8e3" candidate_uuid: "2acaef350d0a4af9b06f6624b3423c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" is_pre_election: true
I20260808 02:31:42.583880 5106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03709455ed344a8598f50fbd078da8e3" candidate_uuid: "2acaef350d0a4af9b06f6624b3423c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" is_pre_election: true
I20260808 02:31:42.584043 4680 raft_consensus.cc:2454] T 03709455ed344a8598f50fbd078da8e3 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2acaef350d0a4af9b06f6624b3423c3c in term 0.
I20260808 02:31:42.584131 5106 raft_consensus.cc:2454] T 03709455ed344a8598f50fbd078da8e3 P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2acaef350d0a4af9b06f6624b3423c3c in term 0.
I20260808 02:31:42.584511 4783 leader_election.cc:302] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2acaef350d0a4af9b06f6624b3423c3c, c2ee14ed64b344b59d9dda2d88c154fc; no voters:
I20260808 02:31:42.584777 5238 raft_consensus.cc:2781] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:31:42.584918 5238 raft_consensus.cc:482] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:31:42.585038 5238 raft_consensus.cc:3037] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:42.587400 5238 raft_consensus.cc:504] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:42.588181 5238 leader_election.cc:288] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c [CANDIDATE]: Term 1 election: Requested vote from peers c2ee14ed64b344b59d9dda2d88c154fc (127.24.116.193:36405), b54c7d3bd3024f569cf64e3aa51ee945 (127.24.116.195:37807)
I20260808 02:31:42.588661 4680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03709455ed344a8598f50fbd078da8e3" candidate_uuid: "2acaef350d0a4af9b06f6624b3423c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ee14ed64b344b59d9dda2d88c154fc"
I20260808 02:31:42.588795 5106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03709455ed344a8598f50fbd078da8e3" candidate_uuid: "2acaef350d0a4af9b06f6624b3423c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b54c7d3bd3024f569cf64e3aa51ee945"
I20260808 02:31:42.588932 4680 raft_consensus.cc:3037] T 03709455ed344a8598f50fbd078da8e3 P c2ee14ed64b344b59d9dda2d88c154fc [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:42.589041 5106 raft_consensus.cc:3037] T 03709455ed344a8598f50fbd078da8e3 P b54c7d3bd3024f569cf64e3aa51ee945 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:42.591202 4680 raft_consensus.cc:2454] T 03709455ed344a8598f50fbd078da8e3 P c2ee14ed64b344b59d9dda2d88c154fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2acaef350d0a4af9b06f6624b3423c3c in term 1.
I20260808 02:31:42.591657 4783 leader_election.cc:302] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2acaef350d0a4af9b06f6624b3423c3c, c2ee14ed64b344b59d9dda2d88c154fc; no voters:
I20260808 02:31:42.591938 5238 raft_consensus.cc:2781] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:31:42.592248 5106 raft_consensus.cc:2454] T 03709455ed344a8598f50fbd078da8e3 P b54c7d3bd3024f569cf64e3aa51ee945 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2acaef350d0a4af9b06f6624b3423c3c in term 1.
I20260808 02:31:42.592504 5238 raft_consensus.cc:686] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c [term 1 LEADER]: Becoming Leader. State: Replica: 2acaef350d0a4af9b06f6624b3423c3c, State: Running, Role: LEADER
I20260808 02:31:42.592851 5238 consensus_queue.cc:237] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } }
I20260808 02:31:42.595693 4440 catalog_manager.cc:5495] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2acaef350d0a4af9b06f6624b3423c3c (127.24.116.194). New cstate: current_term: 1 leader_uuid: "2acaef350d0a4af9b06f6624b3423c3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2acaef350d0a4af9b06f6624b3423c3c" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 34063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 } health_report { overall_health: UNKNOWN } } }
I20260808 02:31:42.622007 5373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:42.615811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54472 (local address 127.24.116.194:34063)
0808 02:31:42.616500 (+ 689us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:42.616504 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:42.616520 (+ 16us) server_negotiation.cc:407] Connection header received
0808 02:31:42.616571 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:42.616575 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:42.616641 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:42.616725 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:31:42.617224 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.618005 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.620047 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.620541 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.620676 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:42.621215 (+ 539us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:31:42.621336 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:31:42.621405 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:42.621595 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 02:31:42.621656 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":404,"threads_started":1}
I20260808 02:31:42.638536 5378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:42.632849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:52077 (local address 127.24.116.195:37807)
0808 02:31:42.633705 (+ 856us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:42.633714 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:42.633736 (+ 22us) server_negotiation.cc:407] Connection header received
0808 02:31:42.633822 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:42.633826 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:42.633888 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:42.633997 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:31:42.634501 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.635205 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.636674 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.637115 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.637250 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:42.637736 (+ 486us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:31:42.637846 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:31:42.637947 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:42.638106 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 02:31:42.638187 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":736,"thread_start_us":620,"threads_started":1}
I20260808 02:31:42.638598 5377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:42.632784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:37807 (local address 127.24.116.194:52077)
0808 02:31:42.633495 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:42.633520 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:42.633667 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:42.634017 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:42.634022 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:42.634033 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:31:42.634330 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:42.634339 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.635373 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.635385 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:42.636521 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:42.636535 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.637323 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.637333 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:42.637468 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:42.637523 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:31:42.637952 (+ 429us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:31:42.637974 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 02:31:42.638077 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 02:31:42.638227 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":342,"threads_started":1}
I20260808 02:31:42.648216 5106 raft_consensus.cc:1261] T 03709455ed344a8598f50fbd078da8e3 P b54c7d3bd3024f569cf64e3aa51ee945 [term 1 FOLLOWER]: Refusing update from remote peer 2acaef350d0a4af9b06f6624b3423c3c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:31:42.648454 4680 raft_consensus.cc:1261] T 03709455ed344a8598f50fbd078da8e3 P c2ee14ed64b344b59d9dda2d88c154fc [term 1 FOLLOWER]: Refusing update from remote peer 2acaef350d0a4af9b06f6624b3423c3c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:31:42.648957 5238 consensus_queue.cc:1035] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b54c7d3bd3024f569cf64e3aa51ee945" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:31:42.649317 5370 consensus_queue.cc:1035] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2ee14ed64b344b59d9dda2d88c154fc" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 36405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:31:42.681227 5373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:42.674642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:54593 (local address 127.24.116.194:34063)
0808 02:31:42.674877 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:42.674887 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:42.675319 (+ 432us) server_negotiation.cc:407] Connection header received
0808 02:31:42.675504 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:42.675508 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:42.675571 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:42.675644 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:31:42.676239 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.677305 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.679360 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.679769 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.679897 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:42.680435 (+ 538us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:31:42.680556 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:31:42.680644 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:42.680864 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 02:31:42.680970 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 02:31:42.681996 5386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:42.674593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:34063 (local address 127.24.116.195:54593)
0808 02:31:42.675194 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:42.675217 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:42.675379 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:42.675699 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:42.675705 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:42.675719 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:31:42.676024 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:42.676037 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.677469 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.677475 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:42.679189 (+ 1714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:42.679206 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.679940 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.679947 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:42.680130 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:42.680205 (+ 75us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:31:42.680699 (+ 494us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:31:42.680713 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 02:31:42.681460 (+ 747us) client_negotiation.cc:240] Negotiation successful
0808 02:31:42.681612 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":297,"threads_started":1}
I20260808 02:31:42.712747 4440 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43328:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:31:42.713055 4440 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43328:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:31:42.716490 4440 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f32373aefd404e458d8777b277bc8dcc: Sending DeleteTablet for 3 replicas of tablet 03709455ed344a8598f50fbd078da8e3
I20260808 02:31:42.717418 4640 tablet_service.cc:1514] Processing DeleteTablet for tablet 03709455ed344a8598f50fbd078da8e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:42 UTC) from {username='oryx', principal='oryx/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:38608
I20260808 02:31:42.717446 4860 tablet_service.cc:1514] Processing DeleteTablet for tablet 03709455ed344a8598f50fbd078da8e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:42 UTC) from {username='oryx', principal='oryx/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:38762
I20260808 02:31:42.717734 5331 tablet_replica.cc:330] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c: stopping tablet replica
I20260808 02:31:42.717744 5329 tablet_replica.cc:330] T 03709455ed344a8598f50fbd078da8e3 P c2ee14ed64b344b59d9dda2d88c154fc: stopping tablet replica
I20260808 02:31:42.717921 5331 raft_consensus.cc:2229] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:31:42.717931 5329 raft_consensus.cc:2229] T 03709455ed344a8598f50fbd078da8e3 P c2ee14ed64b344b59d9dda2d88c154fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:31:42.718156 5329 raft_consensus.cc:2258] T 03709455ed344a8598f50fbd078da8e3 P c2ee14ed64b344b59d9dda2d88c154fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:42.718272 5331 raft_consensus.cc:2258] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:42.719627 5331 ts_tablet_manager.cc:1905] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:42.719662 5329 ts_tablet_manager.cc:1905] T 03709455ed344a8598f50fbd078da8e3 P c2ee14ed64b344b59d9dda2d88c154fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:42.726720 5331 ts_tablet_manager.cc:1918] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:31:42.726785 5329 ts_tablet_manager.cc:1918] T 03709455ed344a8598f50fbd078da8e3 P c2ee14ed64b344b59d9dda2d88c154fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:31:42.726893 5331 log.cc:1196] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/03709455ed344a8598f50fbd078da8e3
I20260808 02:31:42.726922 5329 log.cc:1196] T 03709455ed344a8598f50fbd078da8e3 P c2ee14ed64b344b59d9dda2d88c154fc: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/03709455ed344a8598f50fbd078da8e3
I20260808 02:31:42.727358 5331 ts_tablet_manager.cc:1939] T 03709455ed344a8598f50fbd078da8e3 P 2acaef350d0a4af9b06f6624b3423c3c: Deleting consensus metadata
I20260808 02:31:42.727386 5329 ts_tablet_manager.cc:1939] T 03709455ed344a8598f50fbd078da8e3 P c2ee14ed64b344b59d9dda2d88c154fc: Deleting consensus metadata
I20260808 02:31:42.727382 5073 tablet_service.cc:1514] Processing DeleteTablet for tablet 03709455ed344a8598f50fbd078da8e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:31:42 UTC) from {username='oryx', principal='oryx/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:57246
I20260808 02:31:42.727900 5334 tablet_replica.cc:330] T 03709455ed344a8598f50fbd078da8e3 P b54c7d3bd3024f569cf64e3aa51ee945: stopping tablet replica
I20260808 02:31:42.728092 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 4543
I20260808 02:31:42.728102 5334 raft_consensus.cc:2229] T 03709455ed344a8598f50fbd078da8e3 P b54c7d3bd3024f569cf64e3aa51ee945 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:31:42.728364 5334 raft_consensus.cc:2258] T 03709455ed344a8598f50fbd078da8e3 P b54c7d3bd3024f569cf64e3aa51ee945 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:31:42.729246 4415 catalog_manager.cc:4841] TS c2ee14ed64b344b59d9dda2d88c154fc (127.24.116.193:36405): tablet 03709455ed344a8598f50fbd078da8e3 (table test-table [id=60bb9f5a4c804902a5b45d9753f57608]) successfully deleted
I20260808 02:31:42.730502 5334 ts_tablet_manager.cc:1905] T 03709455ed344a8598f50fbd078da8e3 P b54c7d3bd3024f569cf64e3aa51ee945: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:31:42.733301 4417 catalog_manager.cc:4841] TS 2acaef350d0a4af9b06f6624b3423c3c (127.24.116.194:34063): tablet 03709455ed344a8598f50fbd078da8e3 (table test-table [id=60bb9f5a4c804902a5b45d9753f57608]) successfully deleted
I20260808 02:31:42.736933 5334 ts_tablet_manager.cc:1918] T 03709455ed344a8598f50fbd078da8e3 P b54c7d3bd3024f569cf64e3aa51ee945: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:31:42.737108 5334 log.cc:1196] T 03709455ed344a8598f50fbd078da8e3 P b54c7d3bd3024f569cf64e3aa51ee945: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/03709455ed344a8598f50fbd078da8e3
I20260808 02:31:42.737543 5334 ts_tablet_manager.cc:1939] T 03709455ed344a8598f50fbd078da8e3 P b54c7d3bd3024f569cf64e3aa51ee945: Deleting consensus metadata
I20260808 02:31:42.738600 4417 catalog_manager.cc:4841] TS b54c7d3bd3024f569cf64e3aa51ee945 (127.24.116.195:37807): tablet 03709455ed344a8598f50fbd078da8e3 (table test-table [id=60bb9f5a4c804902a5b45d9753f57608]) successfully deleted
Aug 08 02:31:42 dist-test-slave-45dx krb5kdc[4366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156302, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.116.193@KRBTEST.COM
I20260808 02:31:42.749342 5218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:42.730293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45672 (local address 127.24.116.193:36405)
0808 02:31:42.730492 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:42.730499 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:42.730522 (+ 23us) server_negotiation.cc:407] Connection header received
0808 02:31:42.730760 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:42.730766 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:42.730869 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:42.730956 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:42.732751 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.733929 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.735836 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.736538 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.736694 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:42.741770 (+ 5076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:42.741785 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:42.741801 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:42.741850 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:42.745290 (+ 3440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:42.746057 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:42.746065 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:42.746068 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:42.746220 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:42.746727 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:42.746733 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:42.746737 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:42.747356 (+ 619us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:42.747719 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:42.748436 (+ 717us) server_negotiation.cc:299] Negotiation successful
0808 02:31:42.748805 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 02:31:42.750406 4741 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:42.892549 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 4543
I20260808 02:31:42.920907 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 4756
Aug 08 02:31:42 dist-test-slave-45dx krb5kdc[4366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156302, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.116.194@KRBTEST.COM
I20260808 02:31:42.936048 5373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:42.921737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54478 (local address 127.24.116.194:34063)
0808 02:31:42.921954 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:42.921959 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:42.921978 (+ 19us) server_negotiation.cc:407] Connection header received
0808 02:31:42.922106 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:42.922110 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:42.922175 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:42.922275 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:42.923511 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.924246 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.925658 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:42.926098 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:42.926199 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:42.930325 (+ 4126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:42.930339 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:42.930356 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:42.930411 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:42.933286 (+ 2875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:42.933958 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:42.933965 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:42.933967 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:42.934107 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:42.934499 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:42.934503 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:42.934505 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:42.934908 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:42.935164 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:42.935559 (+ 395us) server_negotiation.cc:299] Negotiation successful
0808 02:31:42.935734 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260808 02:31:42.936892 4957 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:43.063547 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 4756
I20260808 02:31:43.097038 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 4971
Aug 08 02:31:43 dist-test-slave-45dx krb5kdc[4366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156302, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.116.195@KRBTEST.COM
I20260808 02:31:43.112677 5378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:43.097846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33982 (local address 127.24.116.195:37807)
0808 02:31:43.098052 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:43.098059 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:43.098299 (+ 240us) server_negotiation.cc:407] Connection header received
0808 02:31:43.098476 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:43.098480 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:43.098547 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:43.098666 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:43.100057 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:43.100804 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:43.102143 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:43.102575 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:43.102667 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:43.107102 (+ 4435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:43.107118 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:43.107134 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:43.107170 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:43.110256 (+ 3086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:43.110959 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:43.110966 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:43.110968 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:43.111096 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:43.111426 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:43.111429 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:43.111431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:43.111762 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:43.112010 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:43.112225 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 02:31:43.112440 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 02:31:43.113394 5183 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:43.240912 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 4971
I20260808 02:31:43.274834 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 4387
I20260808 02:31:43.276041 4496 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:43.392697 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 4387
2026-08-08T02:31:43Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (6386 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:31:43 dist-test-slave-45dx krb5kdc[5402](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:31:43 dist-test-slave-45dx krb5kdc[5402](info): set up 2 sockets
Aug 08 02:31:43 dist-test-slave-45dx krb5kdc[5402](info): commencing operation
krb5kdc: starting...
W20260808 02:31:44.735289 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.289s user 0.000s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:31:44 dist-test-slave-45dx krb5kdc[5402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156304, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:31:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:31:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:31:45.030169 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:35197
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:37147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:35197
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:45.379599 5420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:45.379891 5420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:45.379983 5420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:45.387326 5420 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:31:45.387444 5420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:45.387490 5420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:45.387548 5420 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:31:45.387596 5420 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:31:45.398166 5420 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:37147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:35197
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:35197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:45.399501 5420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:45.400902 5420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:45.412998 5429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:45.413156 5434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:45.413029 5430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:45.414182 5420 server_base.cc:1034] running on GCE node
I20260808 02:31:45.415019 5420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:45.416471 5420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:45.417699 5420 hybrid_clock.cc:648] HybridClock initialized: now 1786156305417657 us; error 49 us; skew 500 ppm
I20260808 02:31:45.418071 5420 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T02:31:45Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (2094 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:31:45 dist-test-slave-45dx krb5kdc[5441](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:31:45 dist-test-slave-45dx krb5kdc[5441](info): set up 2 sockets
Aug 08 02:31:45 dist-test-slave-45dx krb5kdc[5441](info): commencing operation
krb5kdc: starting...
W20260808 02:31:46.871975 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.331s user 0.001s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:31:47 dist-test-slave-45dx krb5kdc[5441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156307, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:31:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:31:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:31:47.169085 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:45947
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:33469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:45947
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:47.519032 5462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:47.519418 5462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:47.519587 5462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:47.527155 5462 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:31:47.527305 5462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:47.527431 5462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:47.527540 5462 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:31:47.527629 5462 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:31:47.537922 5462 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:33469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:45947
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:45947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:47.539373 5462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:47.540802 5462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:47.552934 5469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:47.552979 5470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:47.552898 5472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:47.554001 5462 server_base.cc:1034] running on GCE node
I20260808 02:31:47.554919 5462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:47.556529 5462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:47.557801 5462 hybrid_clock.cc:648] HybridClock initialized: now 1786156307557747 us; error 63 us; skew 500 ppm
I20260808 02:31:47.558209 5462 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:47 dist-test-slave-45dx krb5kdc[5441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156307, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:47.561673 5462 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:31:47.563331 5462 webserver.cc:460] Webserver started at http://127.24.116.254:41879/ using document root <none> and password file <none>
I20260808 02:31:47.564091 5462 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:47.564244 5462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:47.564602 5462 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:47.567770 5462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "4c7d422703224579b4e23f302d9d3b44"
format_stamp: "Formatted at 2026-08-08 02:31:47 on dist-test-slave-45dx"
server_key: "849beee14d2a763795021b6818d69e79"
server_key_iv: "3e12f4bbdecfa9ac4bff256f4bec7d82"
server_key_version: "encryptionkey@0"
I20260808 02:31:47.568627 5462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "4c7d422703224579b4e23f302d9d3b44"
format_stamp: "Formatted at 2026-08-08 02:31:47 on dist-test-slave-45dx"
server_key: "849beee14d2a763795021b6818d69e79"
server_key_iv: "3e12f4bbdecfa9ac4bff256f4bec7d82"
server_key_version: "encryptionkey@0"
I20260808 02:31:47.574116 5462 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 02:31:47.577730 5482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:47.579135 5462 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:31:47.579329 5462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "4c7d422703224579b4e23f302d9d3b44"
format_stamp: "Formatted at 2026-08-08 02:31:47 on dist-test-slave-45dx"
server_key: "849beee14d2a763795021b6818d69e79"
server_key_iv: "3e12f4bbdecfa9ac4bff256f4bec7d82"
server_key_version: "encryptionkey@0"
I20260808 02:31:47.579567 5462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:47.596532 5462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:47.600894 5462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:47.601194 5462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:47.620291 5462 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:45947
I20260808 02:31:47.620379 5568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:45947 every 8 connection(s)
I20260808 02:31:47.621794 5462 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:31:47.626008 5569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:31:47.628888 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 5462
I20260808 02:31:47.629134 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:31:47.629868 25043 external_mini_cluster.cc:1428] Setting key aeb1c4cb67005c1dbf28314232fcb453
I20260808 02:31:47.639783 5569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44: Bootstrap starting.
I20260808 02:31:47.644384 5569 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44: Neither blocks nor log segments found. Creating new log.
I20260808 02:31:47.645881 5569 log.cc:824] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44: Log is configured to *not* fsync() on all Append() calls
Aug 08 02:31:47 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156307, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:31:47.649231 5569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44: No bootstrap required, opened a new log
I20260808 02:31:47.654699 5573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:47.632064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50752 (local address 127.24.116.254:45947)
0808 02:31:47.632977 (+ 913us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:47.632990 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:47.633031 (+ 41us) server_negotiation.cc:407] Connection header received
0808 02:31:47.634791 (+ 1760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:47.634815 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:47.635223 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:47.635567 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:47.637767 (+ 2200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:47.639082 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:47.641071 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:47.641777 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:47.641945 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:47.647160 (+ 5215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:47.647168 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:47.647183 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:47.647224 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:47.650482 (+ 3258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:47.651203 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:47.651210 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:47.651217 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:47.651397 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:47.651806 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:47.651810 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:47.651812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:47.652443 (+ 631us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:47.652760 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:47.653229 (+ 469us) server_negotiation.cc:299] Negotiation successful
0808 02:31:47.653656 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":687,"thread_start_us":459,"threads_started":1}
I20260808 02:31:47.658149 5569 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c7d422703224579b4e23f302d9d3b44" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 45947 } }
I20260808 02:31:47.658532 5569 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:31:47.658664 5569 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c7d422703224579b4e23f302d9d3b44, State: Initialized, Role: FOLLOWER
I20260808 02:31:47.659251 5569 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c7d422703224579b4e23f302d9d3b44" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 45947 } }
I20260808 02:31:47.659514 5569 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:31:47.659698 5569 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:31:47.659902 5569 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:31:47.662417 5569 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c7d422703224579b4e23f302d9d3b44" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 45947 } }
I20260808 02:31:47.663035 5569 leader_election.cc:302] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c7d422703224579b4e23f302d9d3b44; no voters:
I20260808 02:31:47.663836 5569 leader_election.cc:288] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:31:47.663969 5576 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:31:47.664848 5576 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [term 1 LEADER]: Becoming Leader. State: Replica: 4c7d422703224579b4e23f302d9d3b44, State: Running, Role: LEADER
I20260808 02:31:47.665548 5576 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c7d422703224579b4e23f302d9d3b44" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 45947 } }
I20260808 02:31:47.666482 5569 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:31:47.668679 5578 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c7d422703224579b4e23f302d9d3b44. Latest consensus state: current_term: 1 leader_uuid: "4c7d422703224579b4e23f302d9d3b44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c7d422703224579b4e23f302d9d3b44" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 45947 } } }
I20260808 02:31:47.669093 5578 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:47.669601 5577 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c7d422703224579b4e23f302d9d3b44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c7d422703224579b4e23f302d9d3b44" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 45947 } } }
I20260808 02:31:47.669926 5577 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:47.671322 5589 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:31:47.676478 5589 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:31:47.686142 5589 catalog_manager.cc:1347] Generated new cluster ID: 432b1a6dc9fa4c799b473ac6f3813a9e
I20260808 02:31:47.686297 5589 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:31:47.719184 5589 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:31:47.720674 5589 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:31:47.736093 5589 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44: Generated new TSK 0
I20260808 02:31:47.737001 5589 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.116.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
I20260808 02:31:47.808976 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:45947
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:33469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:48.163331 5607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:48.163686 5607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:48.163861 5607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:48.171855 5607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:48.172022 5607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:48.172200 5607 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:31:48.182678 5607 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:33469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:45947
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:48.184363 5607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:48.185794 5607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:48.199594 5612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:48.199829 5613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:48.200269 5616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:48.200830 5607 server_base.cc:1034] running on GCE node
I20260808 02:31:48.201531 5607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:48.202569 5607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:48.203837 5607 hybrid_clock.cc:648] HybridClock initialized: now 1786156308203734 us; error 63 us; skew 500 ppm
I20260808 02:31:48.204200 5607 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:48 dist-test-slave-45dx krb5kdc[5441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156308, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:48.207744 5607 init.cc:377] Logged in from keytab as kudu/127.24.116.193@KRBTEST.COM (short username kudu)
I20260808 02:31:48.209697 5607 webserver.cc:460] Webserver started at http://127.24.116.193:35183/ using document root <none> and password file <none>
I20260808 02:31:48.210482 5607 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:48.210644 5607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:48.211005 5607 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:48.214298 5607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "cf15d63618b74b5f8f40f79466fcc064"
format_stamp: "Formatted at 2026-08-08 02:31:48 on dist-test-slave-45dx"
server_key: "5b8afcc906315af2a46dac20a67fbe2f"
server_key_iv: "a094a418e9026051442de8446d1ed65e"
server_key_version: "encryptionkey@0"
I20260808 02:31:48.215199 5607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "cf15d63618b74b5f8f40f79466fcc064"
format_stamp: "Formatted at 2026-08-08 02:31:48 on dist-test-slave-45dx"
server_key: "5b8afcc906315af2a46dac20a67fbe2f"
server_key_iv: "a094a418e9026051442de8446d1ed65e"
server_key_version: "encryptionkey@0"
I20260808 02:31:48.221171 5607 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 02:31:48.225121 5629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:48.226527 5607 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:31:48.226716 5607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "cf15d63618b74b5f8f40f79466fcc064"
format_stamp: "Formatted at 2026-08-08 02:31:48 on dist-test-slave-45dx"
server_key: "5b8afcc906315af2a46dac20a67fbe2f"
server_key_iv: "a094a418e9026051442de8446d1ed65e"
server_key_version: "encryptionkey@0"
I20260808 02:31:48.226944 5607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:48.243139 5607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:48.247777 5607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:48.248098 5607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:48.249212 5607 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:48.250651 5607 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:48.250756 5607 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:48.250907 5607 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:48.250980 5607 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:48.289630 5607 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:46865
I20260808 02:31:48.289691 5797 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:46865 every 8 connection(s)
I20260808 02:31:48.291026 5607 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:31:48.300895 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 5607
I20260808 02:31:48.301148 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:31:48.302088 25043 external_mini_cluster.cc:1428] Setting key 71a0d6e32c1b70d88e47860a8c559405
Aug 08 02:31:48 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156308, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:31:48.314540 5801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:48.293741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:56411 (local address 127.24.116.254:45947)
0808 02:31:48.294269 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:48.294274 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:48.295099 (+ 825us) server_negotiation.cc:407] Connection header received
0808 02:31:48.297222 (+ 2123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:48.297229 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:48.297346 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:48.297485 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:48.299168 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:48.299990 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:48.302741 (+ 2751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:48.303176 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:48.303289 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:48.307597 (+ 4308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:48.307603 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:48.307607 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:48.307646 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:48.310831 (+ 3185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:48.311891 (+ 1060us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:48.311895 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:48.311898 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:48.312045 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:48.312634 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:48.312638 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:48.312640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:48.312952 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:48.313079 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:48.314064 (+ 985us) server_negotiation.cc:299] Negotiation successful
0808 02:31:48.314264 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":301,"threads_started":1}
I20260808 02:31:48.316082 5802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:48.294152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.193:56411)
0808 02:31:48.294916 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:48.294958 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:48.296912 (+ 1954us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:48.297766 (+ 854us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:48.297775 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:48.298352 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:48.298971 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:48.298991 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:48.300189 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:48.300193 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:48.302577 (+ 2384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:48.302594 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:48.303447 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:48.303454 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:48.303683 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:48.304469 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:48.304508 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:48.307336 (+ 2828us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:48.310992 (+ 3656us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:48.311004 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:48.311024 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:48.311701 (+ 677us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:48.312168 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:48.312175 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:48.312181 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:48.312489 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:48.313088 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:48.313098 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:48.313606 (+ 508us) client_negotiation.cc:769] Sending connection context
0808 02:31:48.313942 (+ 336us) client_negotiation.cc:240] Negotiation successful
0808 02:31:48.314561 (+ 619us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":299,"threads_started":1}
I20260808 02:31:48.317902 5799 heartbeater.cc:347] Connected to a master server at 127.24.116.254:45947
I20260808 02:31:48.318222 5799 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:48.318969 5799 heartbeater.cc:511] Master 127.24.116.254:45947 requested a full tablet report, sending...
I20260808 02:31:48.321503 5504 ts_manager.cc:194] Registered new tserver with Master: cf15d63618b74b5f8f40f79466fcc064 (127.24.116.193:46865)
I20260808 02:31:48.323966 5504 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.193@KRBTEST.COM'} at 127.24.116.193:56411
WARNING: no policy specified for kudu/127.24.116.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
I20260808 02:31:48.371425 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:45947
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:33469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:48.720804 5805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:48.721087 5805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:48.721261 5805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:48.728570 5805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:48.728693 5805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:48.728893 5805 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:31:48.738853 5805 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:33469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:45947
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:48.740196 5805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:48.741592 5805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:48.754769 5811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:48.754974 5813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:48.754971 5819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:48.755960 5805 server_base.cc:1034] running on GCE node
I20260808 02:31:48.756661 5805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:48.757612 5805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:48.758868 5805 hybrid_clock.cc:648] HybridClock initialized: now 1786156308758783 us; error 52 us; skew 500 ppm
I20260808 02:31:48.759217 5805 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:48 dist-test-slave-45dx krb5kdc[5441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156308, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:48.762580 5805 init.cc:377] Logged in from keytab as kudu/127.24.116.194@KRBTEST.COM (short username kudu)
I20260808 02:31:48.764104 5805 webserver.cc:460] Webserver started at http://127.24.116.194:35955/ using document root <none> and password file <none>
I20260808 02:31:48.764878 5805 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:48.765023 5805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:48.765347 5805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:48.768286 5805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "9e569d13a77a494a98ffb8462827ceca"
format_stamp: "Formatted at 2026-08-08 02:31:48 on dist-test-slave-45dx"
server_key: "215d62fd8bffc620b7af70ffdb8d41f4"
server_key_iv: "97d5b6da7063220c1bfbcf74228c407c"
server_key_version: "encryptionkey@0"
I20260808 02:31:48.769178 5805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "9e569d13a77a494a98ffb8462827ceca"
format_stamp: "Formatted at 2026-08-08 02:31:48 on dist-test-slave-45dx"
server_key: "215d62fd8bffc620b7af70ffdb8d41f4"
server_key_iv: "97d5b6da7063220c1bfbcf74228c407c"
server_key_version: "encryptionkey@0"
I20260808 02:31:48.775548 5805 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260808 02:31:48.779253 5827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:48.780735 5805 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:31:48.780942 5805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "9e569d13a77a494a98ffb8462827ceca"
format_stamp: "Formatted at 2026-08-08 02:31:48 on dist-test-slave-45dx"
server_key: "215d62fd8bffc620b7af70ffdb8d41f4"
server_key_iv: "97d5b6da7063220c1bfbcf74228c407c"
server_key_version: "encryptionkey@0"
I20260808 02:31:48.781152 5805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:48.807117 5805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:48.811498 5805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:48.811805 5805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:48.812872 5805 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:48.814240 5805 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:48.814348 5805 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:48.814510 5805 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:48.814585 5805 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:48.849393 5805 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:44259
I20260808 02:31:48.849484 5981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:44259 every 8 connection(s)
I20260808 02:31:48.850695 5805 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:31:48.851205 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 5805
I20260808 02:31:48.851404 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:31:48.852028 25043 external_mini_cluster.cc:1428] Setting key 0b7748d7a1d5ec0a9d855ad5f1a76bde
Aug 08 02:31:48 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156308, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:31:48.872814 5986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:48.853470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:51481 (local address 127.24.116.254:45947)
0808 02:31:48.853932 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:48.853937 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:48.855319 (+ 1382us) server_negotiation.cc:407] Connection header received
0808 02:31:48.857279 (+ 1960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:48.857288 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:48.857402 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:48.857522 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:48.859009 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:48.860151 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:48.861751 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:48.862508 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:48.862651 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:48.866343 (+ 3692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:48.866347 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:48.866351 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:48.866382 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:48.869255 (+ 2873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:48.870274 (+ 1019us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:48.870278 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:48.870280 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:48.870448 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:48.870937 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:48.870942 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:48.870945 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:48.871206 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:48.871370 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:48.872295 (+ 925us) server_negotiation.cc:299] Negotiation successful
0808 02:31:48.872529 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":256,"threads_started":1}
I20260808 02:31:48.874395 5987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:48.854205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.194:51481)
0808 02:31:48.855129 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:48.855196 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:48.857010 (+ 1814us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:48.857714 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:48.857722 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:48.858273 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:48.858833 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:48.858851 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:48.860369 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:48.860373 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:48.861583 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:48.861600 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:48.862734 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:48.862739 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:48.862976 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:48.863699 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:48.863722 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:48.866097 (+ 2375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:48.869418 (+ 3321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:48.869430 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:48.869449 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:48.870155 (+ 706us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:48.870579 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:48.870584 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:48.870588 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:48.870803 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:48.871390 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:48.871401 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:48.871855 (+ 454us) client_negotiation.cc:769] Sending connection context
0808 02:31:48.872193 (+ 338us) client_negotiation.cc:240] Negotiation successful
0808 02:31:48.872809 (+ 616us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"thread_start_us":394,"threads_started":1}
I20260808 02:31:48.875881 5982 heartbeater.cc:347] Connected to a master server at 127.24.116.254:45947
I20260808 02:31:48.876194 5982 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:48.877022 5982 heartbeater.cc:511] Master 127.24.116.254:45947 requested a full tablet report, sending...
I20260808 02:31:48.878471 5504 ts_manager.cc:194] Registered new tserver with Master: 9e569d13a77a494a98ffb8462827ceca (127.24.116.194:44259)
I20260808 02:31:48.879287 5504 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.194@KRBTEST.COM'} at 127.24.116.194:51481
WARNING: no policy specified for kudu/127.24.116.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
I20260808 02:31:48.917982 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:45947
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:33469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:49.266355 5990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:49.266695 5990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:49.266817 5990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:49.274240 5990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:49.274348 5990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:49.274463 5990 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:31:49.284847 5990 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:33469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:45947
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:49.286136 5990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:49.287484 5990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:49.302423 5998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:49.302376 6002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:49.302460 5999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:49.303941 5990 server_base.cc:1034] running on GCE node
I20260808 02:31:49.304615 5990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:49.305624 5990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:49.306862 5990 hybrid_clock.cc:648] HybridClock initialized: now 1786156309306815 us; error 33 us; skew 500 ppm
I20260808 02:31:49.307193 5990 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:49 dist-test-slave-45dx krb5kdc[5441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156309, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:49.310482 5990 init.cc:377] Logged in from keytab as kudu/127.24.116.195@KRBTEST.COM (short username kudu)
I20260808 02:31:49.311990 5990 webserver.cc:460] Webserver started at http://127.24.116.195:35131/ using document root <none> and password file <none>
I20260808 02:31:49.312788 5990 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:49.312922 5990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:49.313258 5990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:31:49.316200 5990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "601ea4acfef847cf87ef97c95e73d7e9"
format_stamp: "Formatted at 2026-08-08 02:31:49 on dist-test-slave-45dx"
server_key: "7c92ba08950e21e968c7a2c297e2748d"
server_key_iv: "0b2f7b04394b159eb024b1f3f0ff6a53"
server_key_version: "encryptionkey@0"
I20260808 02:31:49.317114 5990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "601ea4acfef847cf87ef97c95e73d7e9"
format_stamp: "Formatted at 2026-08-08 02:31:49 on dist-test-slave-45dx"
server_key: "7c92ba08950e21e968c7a2c297e2748d"
server_key_iv: "0b2f7b04394b159eb024b1f3f0ff6a53"
server_key_version: "encryptionkey@0"
I20260808 02:31:49.322504 5990 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 02:31:49.326037 6011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:49.327147 5799 heartbeater.cc:503] Master 127.24.116.254:45947 was elected leader, sending a full tablet report...
I20260808 02:31:49.327495 5990 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 02:31:49.327674 5990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "601ea4acfef847cf87ef97c95e73d7e9"
format_stamp: "Formatted at 2026-08-08 02:31:49 on dist-test-slave-45dx"
server_key: "7c92ba08950e21e968c7a2c297e2748d"
server_key_iv: "0b2f7b04394b159eb024b1f3f0ff6a53"
server_key_version: "encryptionkey@0"
I20260808 02:31:49.327931 5990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:49.354970 5990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:49.359282 5990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:49.359549 5990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:49.360627 5990 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:49.362037 5990 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:49.362113 5990 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:49.362200 5990 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:49.362244 5990 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:49.400615 5990 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:32987
I20260808 02:31:49.400666 6178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:32987 every 8 connection(s)
I20260808 02:31:49.401994 5990 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:31:49.407177 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 5990
I20260808 02:31:49.407382 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:31:49.407871 25043 external_mini_cluster.cc:1428] Setting key 56b89022bf240bc342ed88e8bdc85ea7
Aug 08 02:31:49 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156309, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:31:49.423207 6183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:49.404689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:54345 (local address 127.24.116.254:45947)
0808 02:31:49.405224 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:49.405228 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:49.406118 (+ 890us) server_negotiation.cc:407] Connection header received
0808 02:31:49.408397 (+ 2279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:49.408403 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:49.408507 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:49.408636 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:49.410266 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:49.411092 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:49.412769 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:49.413183 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:49.413338 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:49.416974 (+ 3636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:49.416979 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:49.416982 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:49.417015 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:49.419811 (+ 2796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:49.420684 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:49.420689 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:49.420694 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:49.420874 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:49.421354 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:49.421358 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:49.421365 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:49.421628 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:49.421808 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:49.422544 (+ 736us) server_negotiation.cc:299] Negotiation successful
0808 02:31:49.422774 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":303,"threads_started":1}
I20260808 02:31:49.424242 6184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:49.405168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.195:54345)
0808 02:31:49.405947 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:49.405998 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:49.408076 (+ 2078us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:49.408942 (+ 866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:49.408952 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:49.409491 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:49.410083 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:49.410100 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:49.411256 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:49.411262 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:49.412611 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:49.412634 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:49.413433 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:49.413442 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:49.413685 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:49.414436 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:49.414465 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:49.416740 (+ 2275us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:31:49.419961 (+ 3221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:49.419971 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:49.419988 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:49.420534 (+ 546us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:49.420998 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:31:49.421003 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:31:49.421006 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:31:49.421206 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:31:49.421781 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:31:49.421797 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:31:49.422140 (+ 343us) client_negotiation.cc:769] Sending connection context
0808 02:31:49.422423 (+ 283us) client_negotiation.cc:240] Negotiation successful
0808 02:31:49.422984 (+ 561us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":279,"threads_started":1}
I20260808 02:31:49.425594 6181 heartbeater.cc:347] Connected to a master server at 127.24.116.254:45947
I20260808 02:31:49.425911 6181 heartbeater.cc:464] Registering TS with master...
I20260808 02:31:49.426626 6181 heartbeater.cc:511] Master 127.24.116.254:45947 requested a full tablet report, sending...
I20260808 02:31:49.428023 5504 ts_manager.cc:194] Registered new tserver with Master: 601ea4acfef847cf87ef97c95e73d7e9 (127.24.116.195:32987)
I20260808 02:31:49.428905 5504 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.195@KRBTEST.COM'} at 127.24.116.195:54345
I20260808 02:31:49.435879 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.24.116.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.116.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.116.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.193.keytab.
Entry for principal oryx/127.24.116.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.193.keytab.
WARNING: no policy specified for oryx/127.24.116.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.116.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.116.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.194.keytab.
Entry for principal oryx/127.24.116.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.194.keytab.
WARNING: no policy specified for oryx/127.24.116.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.116.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.116.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.195.keytab.
Entry for principal oryx/127.24.116.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.195.keytab.
I20260808 02:31:49.617072 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 5607
Aug 08 02:31:49 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156307, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.193@KRBTEST.COM
I20260808 02:31:49.636833 6195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:49.618263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46856 (local address 127.24.116.193:46865)
0808 02:31:49.619231 (+ 968us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:49.619239 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:49.619267 (+ 28us) server_negotiation.cc:407] Connection header received
0808 02:31:49.619336 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:49.619342 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:49.619555 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:49.619691 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:49.621676 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:49.622731 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:49.624647 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:49.625230 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:49.625342 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:49.630450 (+ 5108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:49.630464 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:49.630481 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:49.630522 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:49.633851 (+ 3329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:49.634616 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:49.634623 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:49.634625 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:49.634759 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:49.635164 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:49.635168 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:49.635171 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:49.635518 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:49.635847 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:49.636163 (+ 316us) server_negotiation.cc:299] Negotiation successful
0808 02:31:49.636465 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":806,"thread_start_us":621,"threads_started":1}
I20260808 02:31:49.638137 5791 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:49.724264 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 5607
I20260808 02:31:49.750866 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 5805
Aug 08 02:31:49 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156307, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.194@KRBTEST.COM
I20260808 02:31:49.768011 6197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:49.751853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49042 (local address 127.24.116.194:44259)
0808 02:31:49.752490 (+ 637us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:49.752497 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:49.752523 (+ 26us) server_negotiation.cc:407] Connection header received
0808 02:31:49.752588 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:49.752594 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:49.752808 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:49.752939 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:49.754267 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:49.755302 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:49.756674 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:49.757262 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:49.757379 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:49.761847 (+ 4468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:49.761861 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:49.761877 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:49.761913 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:49.765031 (+ 3118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:49.765784 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:49.765797 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:49.765799 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:49.765948 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:49.766331 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:49.766337 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:49.766340 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:49.766693 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:49.767038 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:49.767353 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 02:31:49.767627 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":331,"threads_started":1}
I20260808 02:31:49.769456 5977 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:49.863586 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 5805
I20260808 02:31:49.889449 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 5990
Aug 08 02:31:49 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156307, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.195@KRBTEST.COM
I20260808 02:31:49.907032 6202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:49.890669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56746 (local address 127.24.116.195:32987)
0808 02:31:49.891184 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:49.891192 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:49.891222 (+ 30us) server_negotiation.cc:407] Connection header received
0808 02:31:49.891283 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:49.891302 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:49.891521 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:49.891650 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:49.893224 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:49.894269 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:49.895542 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:49.896116 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:49.896222 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:49.901433 (+ 5211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:49.901447 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:49.901463 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:49.901499 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:49.904438 (+ 2939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:49.905109 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:49.905116 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:49.905118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:49.905269 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:49.905612 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:49.905615 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:49.905617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:49.905999 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:49.906236 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:49.906500 (+ 264us) server_negotiation.cc:299] Negotiation successful
0808 02:31:49.906707 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":238,"threads_started":1}
I20260808 02:31:49.908460 6174 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:49.991806 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 5990
I20260808 02:31:50.017719 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 5462
I20260808 02:31:50.019028 5562 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:31:50.123677 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 5462
I20260808 02:31:50.153780 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:45947
--webserver_interface=127.24.116.254
--webserver_port=41879
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:33469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:45947
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:31:50.518631 6205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:50.518927 6205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:50.519017 6205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:50.526152 6205 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:31:50.526252 6205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:50.526304 6205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:50.526365 6205 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:31:50.526410 6205 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:31:50.535944 6205 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:33469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:45947
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:45947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=41879
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:50.537353 6205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:50.538636 6205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:50.550613 6214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:50.550926 6220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:50.551450 6217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:50.551468 6205 server_base.cc:1034] running on GCE node
I20260808 02:31:50.552407 6205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:50.553828 6205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:50.555048 6205 hybrid_clock.cc:648] HybridClock initialized: now 1786156310554996 us; error 41 us; skew 500 ppm
I20260808 02:31:50.555411 6205 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:50 dist-test-slave-45dx krb5kdc[5441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156310, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:50.562731 6205 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:31:50.564421 6205 webserver.cc:460] Webserver started at http://127.24.116.254:41879/ using document root <none> and password file <none>
I20260808 02:31:50.565128 6205 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:50.565290 6205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:50.570951 6205 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 02:31:50.573944 6228 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:50.575490 6205 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 02:31:50.575697 6205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "4c7d422703224579b4e23f302d9d3b44"
format_stamp: "Formatted at 2026-08-08 02:31:47 on dist-test-slave-45dx"
server_key: "849beee14d2a763795021b6818d69e79"
server_key_iv: "3e12f4bbdecfa9ac4bff256f4bec7d82"
server_key_version: "encryptionkey@0"
I20260808 02:31:50.576787 6205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:50.598387 6205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:50.603086 6205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:50.603375 6205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:50.622411 6205 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:45947
I20260808 02:31:50.622447 6312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:45947 every 8 connection(s)
I20260808 02:31:50.623946 6205 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:31:50.631182 6313 sys_catalog.cc:263] Verifying existing consensus state
I20260808 02:31:50.631916 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 6205
I20260808 02:31:50.632982 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:46865
--local_ip_for_outbound_sockets=127.24.116.193
--tserver_master_addrs=127.24.116.254:45947
--webserver_port=35183
--webserver_interface=127.24.116.193
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:33469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.24.116.193
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.193.keytab with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:31:50.636449 6313 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44: Bootstrap starting.
I20260808 02:31:50.658229 6313 log.cc:824] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44: Log is configured to *not* fsync() on all Append() calls
I20260808 02:31:50.667503 6313 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 02:31:50.668076 6313 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44: Bootstrap complete.
I20260808 02:31:50.677533 6313 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c7d422703224579b4e23f302d9d3b44" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 45947 } }
I20260808 02:31:50.678356 6313 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c7d422703224579b4e23f302d9d3b44, State: Initialized, Role: FOLLOWER
I20260808 02:31:50.679008 6313 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c7d422703224579b4e23f302d9d3b44" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 45947 } }
I20260808 02:31:50.679248 6313 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:31:50.679405 6313 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:31:50.679598 6313 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [term 1 FOLLOWER]: Advancing to term 2
I20260808 02:31:50.683769 6313 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c7d422703224579b4e23f302d9d3b44" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 45947 } }
I20260808 02:31:50.684392 6313 leader_election.cc:302] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c7d422703224579b4e23f302d9d3b44; no voters:
I20260808 02:31:50.685061 6313 leader_election.cc:288] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 02:31:50.685211 6323 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 02:31:50.687505 6313 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:31:50.688596 6323 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [term 2 LEADER]: Becoming Leader. State: Replica: 4c7d422703224579b4e23f302d9d3b44, State: Running, Role: LEADER
I20260808 02:31:50.689333 6323 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c7d422703224579b4e23f302d9d3b44" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 45947 } }
I20260808 02:31:50.692639 6325 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4c7d422703224579b4e23f302d9d3b44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c7d422703224579b4e23f302d9d3b44" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 45947 } } }
I20260808 02:31:50.693104 6325 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:50.693689 6326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c7d422703224579b4e23f302d9d3b44. Latest consensus state: current_term: 2 leader_uuid: "4c7d422703224579b4e23f302d9d3b44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c7d422703224579b4e23f302d9d3b44" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 45947 } } }
I20260808 02:31:50.694087 6326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44 [sys.catalog]: This master's current role is: LEADER
I20260808 02:31:50.705358 6338 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:31:50.711225 6338 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:31:50.712700 6338 catalog_manager.cc:1259] Loaded cluster ID: 432b1a6dc9fa4c799b473ac6f3813a9e
I20260808 02:31:50.712873 6338 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:31:50.716892 6338 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:31:50.718570 6338 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4c7d422703224579b4e23f302d9d3b44: Loaded TSK: 0
I20260808 02:31:50.720286 6338 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 02:31:50.996928 6318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:50.997200 6318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:50.997365 6318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:51.004587 6318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:51.004695 6318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:51.004889 6318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:31:51.014559 6318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:33469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.193.keytab
--principal=oryx/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:46865
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=35183
--tserver_master_addrs=127.24.116.254:45947
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:51.015938 6318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:51.017313 6318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:51.030993 6356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:51.030948 6361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:51.031400 6355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:51.031947 6318 server_base.cc:1034] running on GCE node
I20260808 02:31:51.032648 6318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:51.033763 6318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:51.035006 6318 hybrid_clock.cc:648] HybridClock initialized: now 1786156311034939 us; error 56 us; skew 500 ppm
I20260808 02:31:51.035365 6318 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:51 dist-test-slave-45dx krb5kdc[5441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156311, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:51.039386 6318 init.cc:377] Logged in from keytab as oryx/127.24.116.193@KRBTEST.COM (short username oryx)
I20260808 02:31:51.041167 6318 webserver.cc:460] Webserver started at http://127.24.116.193:35183/ using document root <none> and password file <none>
I20260808 02:31:51.042109 6318 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:51.042255 6318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:51.049433 6318 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 02:31:51.052955 6374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:51.054713 6318 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:31:51.054932 6318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "cf15d63618b74b5f8f40f79466fcc064"
format_stamp: "Formatted at 2026-08-08 02:31:48 on dist-test-slave-45dx"
server_key: "5b8afcc906315af2a46dac20a67fbe2f"
server_key_iv: "a094a418e9026051442de8446d1ed65e"
server_key_version: "encryptionkey@0"
I20260808 02:31:51.056352 6318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:51.081673 6318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:51.086151 6318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:51.086396 6318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:51.087425 6318 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:51.089121 6318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:51.089222 6318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:51.089305 6318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:51.089362 6318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:51.123905 6318 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:46865
I20260808 02:31:51.124023 6553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:46865 every 8 connection(s)
I20260808 02:31:51.125415 6318 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:31:51.134027 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 6318
I20260808 02:31:51.134732 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:44259
--local_ip_for_outbound_sockets=127.24.116.194
--tserver_master_addrs=127.24.116.254:45947
--webserver_port=35955
--webserver_interface=127.24.116.194
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:33469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.24.116.194
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.194.keytab with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 02:31:51 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:51 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:51.144744 6557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:51.128705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.193:50989)
0808 02:31:51.129566 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:51.129617 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:51.131385 (+ 1768us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:51.132820 (+ 1435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:51.132830 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:51.133485 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:51.134009 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:51.134027 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:51.135770 (+ 1743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:51.135780 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:51.137051 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:51.137065 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:51.138114 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:51.138122 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:51.138395 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:51.139106 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:51.139128 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:51.143514 (+ 4386us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":372,"threads_started":1}
W20260808 02:31:51.145841 6554 heartbeater.cc:644] Failed to heartbeat to 127.24.116.254:45947 (0 consecutive failures): Not authorized: Failed to ping master at 127.24.116.254:45947: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
W20260808 02:31:51.146095 6556 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:51.128596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:50989 (local address 127.24.116.254:45947)
0808 02:31:51.129439 (+ 843us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:51.129454 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:51.129738 (+ 284us) server_negotiation.cc:407] Connection header received
0808 02:31:51.131950 (+ 2212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:51.131963 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:51.132263 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:51.132677 (+ 414us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:51.134259 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:51.135602 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:51.137201 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:51.137867 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:51.138067 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:51.144869 (+ 6802us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.193:50989: BlockingRecv error: recv got EOF from 127.24.116.193:50989 (error 108)
Metrics: {"server-negotiator.queue_time_us":581,"thread_start_us":321,"threads_started":1}
Aug 08 02:31:51 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:51 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:51.154798 6557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:51.146561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.193:46207)
0808 02:31:51.146745 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:51.146769 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:51.146853 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:51.147262 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:51.147267 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:51.147620 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:51.147750 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:51.147759 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:51.148856 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:51.148862 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:51.149732 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:51.149742 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:51.150410 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:51.150416 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:51.150586 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:51.151189 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:51.151206 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:51.154458 (+ 3252us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 02:31:51.154937 6556 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:51.146819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:46207 (local address 127.24.116.254:45947)
0808 02:31:51.147010 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:51.147020 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:51.147033 (+ 13us) server_negotiation.cc:407] Connection header received
0808 02:31:51.147076 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:51.147079 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:51.147131 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:51.147232 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:51.147891 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:51.148712 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:51.149875 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:51.150260 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:51.150392 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:51.154668 (+ 4276us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.193:46207: BlockingRecv error: recv got EOF from 127.24.116.193:46207 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 08 02:31:51 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:51 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 02:31:51.164746 6556 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:51.156104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:33651 (local address 127.24.116.254:45947)
0808 02:31:51.156254 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:51.156262 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:51.156279 (+ 17us) server_negotiation.cc:407] Connection header received
0808 02:31:51.156495 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:51.156502 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:51.156572 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:51.156673 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:51.157277 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:51.158033 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:51.159213 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:51.159611 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:51.159754 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:51.164555 (+ 4801us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.193:33651: BlockingRecv error: recv got EOF from 127.24.116.193:33651 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 02:31:51.164772 6557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:51.156027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.193:33651)
0808 02:31:51.156215 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:51.156234 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:51.156373 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:51.156698 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:51.156702 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:51.157004 (+ 302us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:51.157141 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:51.157148 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:51.158177 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:51.158182 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:51.159074 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:51.159085 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:51.159784 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:51.159790 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:51.159960 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:51.160589 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:51.160620 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:51.164411 (+ 3791us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":65}
W20260808 02:31:51.165143 6554 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 02:31:51.484882 6559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:51.485221 6559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:51.485366 6559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:51.492987 6559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:51.493090 6559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:51.493250 6559 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:31:51.503055 6559 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:33469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.194.keytab
--principal=oryx/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:44259
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=35955
--tserver_master_addrs=127.24.116.254:45947
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:51.504421 6559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:51.505687 6559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:51.520141 6568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:51.520196 6567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:51.520103 6571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:51.525823 6559 server_base.cc:1034] running on GCE node
I20260808 02:31:51.526646 6559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:51.527688 6559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:51.528944 6559 hybrid_clock.cc:648] HybridClock initialized: now 1786156311528882 us; error 52 us; skew 500 ppm
I20260808 02:31:51.529313 6559 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:51 dist-test-slave-45dx krb5kdc[5441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156311, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:51.533171 6559 init.cc:377] Logged in from keytab as oryx/127.24.116.194@KRBTEST.COM (short username oryx)
I20260808 02:31:51.534729 6559 webserver.cc:460] Webserver started at http://127.24.116.194:35955/ using document root <none> and password file <none>
I20260808 02:31:51.535537 6559 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:51.535707 6559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:51.541316 6559 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 02:31:51.544118 6582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:51.545722 6559 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 02:31:51.545934 6559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "9e569d13a77a494a98ffb8462827ceca"
format_stamp: "Formatted at 2026-08-08 02:31:48 on dist-test-slave-45dx"
server_key: "215d62fd8bffc620b7af70ffdb8d41f4"
server_key_iv: "97d5b6da7063220c1bfbcf74228c407c"
server_key_version: "encryptionkey@0"
I20260808 02:31:51.547030 6559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:51.590718 6559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:51.595861 6559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:51.596153 6559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:51.597290 6559 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:51.598675 6559 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:51.598783 6559 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:51.598863 6559 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:51.598927 6559 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:51.637861 6559 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:44259
I20260808 02:31:51.637964 6753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:44259 every 8 connection(s)
I20260808 02:31:51.639357 6559 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:31:51.647064 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 6559
I20260808 02:31:51.647881 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:32987
--local_ip_for_outbound_sockets=127.24.116.195
--tserver_master_addrs=127.24.116.254:45947
--webserver_port=35131
--webserver_interface=127.24.116.195
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:33469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.24.116.195
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.195.keytab with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 02:31:51 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:51 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 02:31:51.656208 6556 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:51.642160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:38969 (local address 127.24.116.254:45947)
0808 02:31:51.642401 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:51.642407 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:51.643602 (+ 1195us) server_negotiation.cc:407] Connection header received
0808 02:31:51.645483 (+ 1881us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:51.645487 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:51.645554 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:51.645645 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:51.647118 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:51.648234 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:51.649850 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:51.650565 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:51.650705 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:51.655907 (+ 5202us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.194:38969: BlockingRecv error: recv got EOF from 127.24.116.194:38969 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 02:31:51.656697 6756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:51.642699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.194:38969)
0808 02:31:51.643429 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:51.643469 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:51.645222 (+ 1753us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:51.645893 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:51.645901 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:51.646405 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:51.646936 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:51.646954 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:51.648429 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:51.648434 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:51.649685 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:51.649698 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:51.650882 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:51.650891 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:51.651111 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:51.651925 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:51.651973 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:51.655643 (+ 3670us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":286,"threads_started":1}
W20260808 02:31:51.657459 6754 heartbeater.cc:644] Failed to heartbeat to 127.24.116.254:45947 (0 consecutive failures): Not authorized: Failed to ping master at 127.24.116.254:45947: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Aug 08 02:31:51 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:51 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:51.666957 6756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:51.658067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.194:38899)
0808 02:31:51.658273 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:51.658296 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:51.658400 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:51.658703 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:51.658710 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:51.659157 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:51.659362 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:51.659378 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:51.660898 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:51.660902 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:51.661926 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:51.661939 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:51.662701 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:51.662707 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:51.662887 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:51.663491 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:51.663509 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:51.666608 (+ 3099us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":59}
W20260808 02:31:51.667069 6556 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:51.658176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:38899 (local address 127.24.116.254:45947)
0808 02:31:51.658331 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:51.658335 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:51.658351 (+ 16us) server_negotiation.cc:407] Connection header received
0808 02:31:51.658512 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:51.658516 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:51.658570 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:51.658653 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:51.659517 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:51.660748 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:51.662074 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:51.662549 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:51.662689 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:51.666826 (+ 4137us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.194:38899: BlockingRecv error: recv got EOF from 127.24.116.194:38899 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 02:31:51 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:51 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:51.676530 6756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:51.667919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.194:40295)
0808 02:31:51.668084 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:51.668110 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:51.668189 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:51.668542 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:51.668546 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:51.668808 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:51.668950 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:51.668957 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:51.670469 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:51.670473 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:51.671413 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:51.671424 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:51.672469 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:51.672473 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:51.672614 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:51.673237 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:51.673255 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:51.676226 (+ 2971us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 02:31:51.676873 6754 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 02:31:51.677215 6556 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:51.668005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:40295 (local address 127.24.116.254:45947)
0808 02:31:51.668201 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:51.668208 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:51.668229 (+ 21us) server_negotiation.cc:407] Connection header received
0808 02:31:51.668284 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:51.668321 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:51.668403 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:51.668510 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:51.669102 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:51.670320 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:51.671567 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:51.672321 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:51.672482 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:51.676575 (+ 4093us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.194:40295: BlockingRecv error: recv got EOF from 127.24.116.194:40295 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260808 02:31:52.005383 6758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:31:52.005664 6758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:31:52.005760 6758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:31:52.013019 6758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:31:52.013139 6758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:31:52.013260 6758 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:31:52.023268 6758 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:33469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/krb5kdc/oryx_127.24.116.195.keytab
--principal=oryx/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:32987
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=35131
--tserver_master_addrs=127.24.116.254:45947
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:31:52.024616 6758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:31:52.025899 6758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:31:52.039387 6774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:52.039350 6771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:31:52.039438 6770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:31:52.045615 6758 server_base.cc:1034] running on GCE node
I20260808 02:31:52.046689 6758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:31:52.047760 6758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:31:52.048990 6758 hybrid_clock.cc:648] HybridClock initialized: now 1786156312048921 us; error 66 us; skew 500 ppm
I20260808 02:31:52.049353 6758 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:31:52 dist-test-slave-45dx krb5kdc[5441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156312, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:31:52.052886 6758 init.cc:377] Logged in from keytab as oryx/127.24.116.195@KRBTEST.COM (short username oryx)
I20260808 02:31:52.054464 6758 webserver.cc:460] Webserver started at http://127.24.116.195:35131/ using document root <none> and password file <none>
I20260808 02:31:52.055199 6758 fs_manager.cc:359] Metadata directory not provided
I20260808 02:31:52.055371 6758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:31:52.061352 6758 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 02:31:52.064143 6784 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:52.065500 6758 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 02:31:52.065690 6758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "601ea4acfef847cf87ef97c95e73d7e9"
format_stamp: "Formatted at 2026-08-08 02:31:49 on dist-test-slave-45dx"
server_key: "7c92ba08950e21e968c7a2c297e2748d"
server_key_iv: "0b2f7b04394b159eb024b1f3f0ff6a53"
server_key_version: "encryptionkey@0"
I20260808 02:31:52.066666 6758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:31:52.079527 6758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:31:52.083781 6758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:31:52.084080 6758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:31:52.085131 6758 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:31:52.086481 6758 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:31:52.086609 6758 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:52.086740 6758 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:31:52.086834 6758 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:31:52.121582 6758 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:32987
I20260808 02:31:52.121671 6949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:32987 every 8 connection(s)
I20260808 02:31:52.123065 6758 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:31:52.130523 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 6758
Aug 08 02:31:52 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:52 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 02:31:52.142254 6556 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:52.126153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:48081 (local address 127.24.116.254:45947)
0808 02:31:52.126404 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:52.126410 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:52.127631 (+ 1221us) server_negotiation.cc:407] Connection header received
0808 02:31:52.130279 (+ 2648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:52.130287 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:52.130402 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:52.130519 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:52.132428 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:52.133535 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:52.135482 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:52.136054 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:52.136180 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:52.142022 (+ 5842us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.195:48081: BlockingRecv error: recv got EOF from 127.24.116.195:48081 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 02:31:52.143168 6954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:52.126602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.195:48081)
0808 02:31:52.127448 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:52.127503 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:52.129924 (+ 2421us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:52.130779 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:52.130788 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:52.131398 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:52.132205 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:52.132232 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:52.133701 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:52.133705 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:52.135312 (+ 1607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:52.135329 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:52.136283 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:52.136289 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:52.136548 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:52.137281 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:52.137304 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:52.141722 (+ 4418us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":312,"threads_started":1}
W20260808 02:31:52.143877 6952 heartbeater.cc:644] Failed to heartbeat to 127.24.116.254:45947 (0 consecutive failures): Not authorized: Failed to ping master at 127.24.116.254:45947: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
I20260808 02:31:52.148408 6956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:52.131602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50754 (local address 127.24.116.254:45947)
0808 02:31:52.132682 (+ 1080us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:52.132686 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:52.132699 (+ 13us) server_negotiation.cc:407] Connection header received
0808 02:31:52.132740 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:52.132751 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:52.132798 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:52.132882 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:52.134601 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:52.135678 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:52.137115 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:52.137543 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:52.137635 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:52.140670 (+ 3035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:31:52.140683 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:31:52.140707 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:31:52.140755 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:31:52.144729 (+ 3974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:52.145598 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:52.145607 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:52.145615 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:52.145841 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:31:52.146311 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:31:52.146315 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:31:52.146317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:31:52.146775 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:31:52.147093 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0808 02:31:52.147524 (+ 431us) server_negotiation.cc:299] Negotiation successful
0808 02:31:52.147944 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":989,"thread_start_us":846,"threads_started":1}
Aug 08 02:31:52 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:52 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:52.153581 6954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:52.144521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.195:48847)
0808 02:31:52.144717 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:52.144738 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:52.144867 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:52.145207 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:52.145210 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:52.145524 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:52.145718 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:52.145730 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:52.146980 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:52.146986 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:52.148444 (+ 1458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:52.148461 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:52.149313 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:52.149317 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:52.149440 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:52.149967 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:52.149989 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:52.153387 (+ 3398us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":60}
W20260808 02:31:52.153829 6556 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:52.144599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:48847 (local address 127.24.116.254:45947)
0808 02:31:52.144743 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:52.144747 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:52.144822 (+ 75us) server_negotiation.cc:407] Connection header received
0808 02:31:52.144984 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:52.144991 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:52.145076 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:52.145179 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:52.145958 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:52.146808 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:52.148608 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:52.149068 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:52.149137 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:52.153591 (+ 4454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.195:48847: BlockingRecv error: recv got EOF from 127.24.116.195:48847 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 02:31:52 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:52 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:52.161549 6954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:52.154376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.195:51417)
0808 02:31:52.154554 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:52.154569 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:52.154645 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:52.154978 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:52.154981 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:52.155241 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:52.155398 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:52.155406 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:52.156451 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:52.156455 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:52.157355 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:52.157365 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:52.158024 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:52.158028 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:52.158173 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:52.158700 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:52.158716 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:52.161320 (+ 2604us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":59}
W20260808 02:31:52.161868 6952 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 02:31:52.161937 6556 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:52.154494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:51417 (local address 127.24.116.254:45947)
0808 02:31:52.154709 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:52.154714 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:52.154765 (+ 51us) server_negotiation.cc:407] Connection header received
0808 02:31:52.154804 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:52.154807 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:52.154856 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:52.154936 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:52.155518 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:52.156260 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:52.157487 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:52.157901 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:52.157994 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:52.161622 (+ 3628us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.195:51417: BlockingRecv error: recv got EOF from 127.24.116.195:51417 (error 108)
Metrics: {"server-negotiator.queue_time_us":116}
Aug 08 02:31:52 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:52 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:52.174225 6958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:52.165716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.193:57195)
0808 02:31:52.166244 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:52.166269 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:52.166391 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:52.166671 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:52.166674 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:52.167156 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:52.167350 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:52.167359 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:52.168383 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:52.168388 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:52.169360 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:52.169371 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:52.170093 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:52.170098 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:52.170226 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:52.170852 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:52.170870 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:52.173999 (+ 3129us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":244,"threads_started":1}
W20260808 02:31:52.174417 6556 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:52.165764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:57195 (local address 127.24.116.254:45947)
0808 02:31:52.166007 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:52.166014 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:52.166354 (+ 340us) server_negotiation.cc:407] Connection header received
0808 02:31:52.166486 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:52.166490 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:52.166546 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:52.166625 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:52.167475 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:52.168194 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:52.169484 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:52.169933 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:52.170023 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:52.174206 (+ 4183us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.193:57195: BlockingRecv error: recv got EOF from 127.24.116.193:57195 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Aug 08 02:31:52 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:52 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:52.686839 6960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:52.677566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.194:39903)
0808 02:31:52.678148 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:52.678165 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:52.678286 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:52.678652 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:52.678655 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:52.679131 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:52.679349 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:52.679360 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:52.680750 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:52.680772 (+ 22us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:52.682189 (+ 1417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:52.682213 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:52.682944 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:52.682948 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:52.683067 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:52.683658 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:52.683675 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:52.686606 (+ 2931us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":311,"threads_started":1}
W20260808 02:31:52.687178 6961 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:52.677628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:39903 (local address 127.24.116.254:45947)
0808 02:31:52.678200 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:52.678205 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:52.678226 (+ 21us) server_negotiation.cc:407] Connection header received
0808 02:31:52.678430 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:52.678435 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:52.678503 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:52.678612 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:52.679497 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:52.680583 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:52.682339 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:52.682763 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:52.682878 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:52.686855 (+ 3977us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.194:39903: BlockingRecv error: recv got EOF from 127.24.116.194:39903 (error 108)
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":339,"threads_started":1}
Aug 08 02:31:53 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:53 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:53.171296 6962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:53.162486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.195:50615)
0808 02:31:53.162994 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:53.163011 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:53.163129 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:53.163478 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:53.163483 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:53.164117 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:53.164417 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:53.164433 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:53.165659 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:53.165663 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:53.166623 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:53.166635 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:53.167357 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:53.167362 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:53.167507 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:53.168083 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:53.168101 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:53.171003 (+ 2902us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":290,"threads_started":1}
W20260808 02:31:53.171538 6961 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:53.162574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:50615 (local address 127.24.116.254:45947)
0808 02:31:53.162850 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:53.162856 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:53.163092 (+ 236us) server_negotiation.cc:407] Connection header received
0808 02:31:53.163234 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:53.163238 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:53.163305 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:53.163387 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:53.164576 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:53.165521 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:53.166749 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:53.167190 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:53.167285 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:53.171284 (+ 3999us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.195:50615: BlockingRecv error: recv got EOF from 127.24.116.195:50615 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 08 02:31:53 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:53 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:53.184594 6963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:53.175235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.193:56659)
0808 02:31:53.175957 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:53.175977 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:53.176136 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:53.176534 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:53.176539 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:53.176976 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:53.177147 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:53.177157 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:53.178158 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:53.178164 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:53.179084 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:53.179096 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:53.179903 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:53.179910 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:53.180080 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:53.180682 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:53.180780 (+ 98us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:53.184276 (+ 3496us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":460,"threads_started":1}
W20260808 02:31:53.184887 6961 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:53.175460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:56659 (local address 127.24.116.254:45947)
0808 02:31:53.175688 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:53.175696 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:53.176067 (+ 371us) server_negotiation.cc:407] Connection header received
0808 02:31:53.176268 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:53.176279 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:53.176390 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:53.176492 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:53.177297 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:53.178003 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:53.179230 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:53.179718 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:53.179867 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:53.184551 (+ 4684us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.193:56659: BlockingRecv error: recv got EOF from 127.24.116.193:56659 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 08 02:31:53 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:53 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:53.696976 6964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:53.687843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.194:51479)
0808 02:31:53.688465 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:53.688488 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:53.688663 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:53.689069 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:53.689073 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:53.689526 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:53.689700 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:53.689710 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:53.690841 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:53.690845 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:53.691769 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:53.691781 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:53.692681 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:53.692686 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:53.692832 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:53.693600 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:53.693619 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:53.696725 (+ 3106us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":286,"threads_started":1}
W20260808 02:31:53.697319 6965 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:53.687883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:51479 (local address 127.24.116.254:45947)
0808 02:31:53.688466 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:53.688473 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:53.688583 (+ 110us) server_negotiation.cc:407] Connection header received
0808 02:31:53.688848 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:53.688852 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:53.688930 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:53.689023 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:53.689879 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:53.690707 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:53.691917 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:53.692510 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:53.692612 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:53.696934 (+ 4322us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.194:51479: BlockingRecv error: recv got EOF from 127.24.116.194:51479 (error 108)
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":339,"threads_started":1}
Aug 08 02:31:54 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:54 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:54.181263 6967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:54.172531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.195:49829)
0808 02:31:54.173060 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:54.173077 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:54.173192 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:54.173492 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:54.173496 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:54.173906 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:54.174080 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:54.174089 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:54.175149 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:54.175153 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:54.176064 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:54.176075 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:54.176830 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:54.176835 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:54.176954 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:54.177574 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:54.177591 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:54.180803 (+ 3212us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":315,"threads_started":1}
W20260808 02:31:54.181284 6965 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:54.172743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:49829 (local address 127.24.116.254:45947)
0808 02:31:54.173017 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:54.173024 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:54.173154 (+ 130us) server_negotiation.cc:407] Connection header received
0808 02:31:54.173290 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:54.173295 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:54.173359 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:54.173439 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:54.174209 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:54.175000 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:54.176197 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:54.176680 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:54.176779 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:54.181058 (+ 4279us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.195:49829: BlockingRecv error: recv got EOF from 127.24.116.195:49829 (error 108)
Metrics: {"server-negotiator.queue_time_us":139}
Aug 08 02:31:54 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:54 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:54.194737 6968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:54.185513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.193:43975)
0808 02:31:54.186008 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:54.186031 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:54.186191 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:54.186553 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:54.186560 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:54.186931 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:54.187120 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:54.187130 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:54.188332 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:54.188339 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:54.189327 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:54.189340 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:54.190055 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:54.190061 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:54.190227 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:54.190884 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:54.190904 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:54.194485 (+ 3581us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":256,"threads_started":1}
W20260808 02:31:54.195003 6965 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:54.185567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:43975 (local address 127.24.116.254:45947)
0808 02:31:54.185766 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:54.185773 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:54.186118 (+ 345us) server_negotiation.cc:407] Connection header received
0808 02:31:54.186333 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:54.186345 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:54.186405 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:54.186516 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:54.187279 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:54.188158 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:54.189478 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:54.189897 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:54.190030 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:54.194711 (+ 4681us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.193:43975: BlockingRecv error: recv got EOF from 127.24.116.193:43975 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 02:31:54 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:54 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:54.707295 6970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:54.698068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.194:49105)
0808 02:31:54.698571 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:54.698589 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:54.698713 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:54.699260 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:54.699265 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:54.699607 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:54.700030 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:54.700047 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:54.701397 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:54.701404 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:54.702377 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:54.702389 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:54.703093 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:54.703099 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:54.703284 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:54.703946 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:54.703964 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:54.707015 (+ 3051us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":277,"threads_started":1}
W20260808 02:31:54.707525 6971 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:54.698185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:49105 (local address 127.24.116.254:45947)
0808 02:31:54.698957 (+ 772us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:54.698961 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:54.698978 (+ 17us) server_negotiation.cc:407] Connection header received
0808 02:31:54.699027 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:54.699031 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:54.699090 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:54.699181 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:54.700222 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:54.701253 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:54.702520 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:54.702935 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:54.703067 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:54.707218 (+ 4151us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.194:49105: BlockingRecv error: recv got EOF from 127.24.116.194:49105 (error 108)
Metrics: {"server-negotiator.queue_time_us":663,"thread_start_us":578,"threads_started":1}
Aug 08 02:31:55 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:55 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:55.191531 6972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:55.182466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.195:36285)
0808 02:31:55.183073 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:55.183089 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:55.183256 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:55.183601 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:55.183605 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:55.184012 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:55.184188 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:55.184198 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:55.185257 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:55.185265 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:55.186168 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:55.186179 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:55.186866 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:55.186873 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:55.187052 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:55.187972 (+ 920us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:55.188002 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:55.191251 (+ 3249us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":404,"threads_started":1}
W20260808 02:31:55.191813 6971 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:55.182548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:36285 (local address 127.24.116.254:45947)
0808 02:31:55.182797 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:55.182803 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:55.183185 (+ 382us) server_negotiation.cc:407] Connection header received
0808 02:31:55.183388 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:55.183400 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:55.183462 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:55.183566 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:55.184376 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:55.185107 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:55.186319 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:55.186712 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:55.186849 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:55.191487 (+ 4638us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.195:36285: BlockingRecv error: recv got EOF from 127.24.116.195:36285 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 08 02:31:55 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:55 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:55.204843 6973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:55.195643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.193:53137)
0808 02:31:55.196138 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:55.196160 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:55.196283 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:55.196690 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:55.196694 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:55.197084 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:55.197244 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:55.197253 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:55.198320 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:55.198324 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:55.199597 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:55.199613 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:55.200532 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:55.200537 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:55.200680 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:55.201417 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:55.201437 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:55.204496 (+ 3059us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":274,"threads_started":1}
W20260808 02:31:55.204967 6971 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:55.195684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:53137 (local address 127.24.116.254:45947)
0808 02:31:55.195987 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:55.195993 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:55.196247 (+ 254us) server_negotiation.cc:407] Connection header received
0808 02:31:55.196499 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:55.196503 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:55.196560 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:55.196641 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:55.197389 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:55.198176 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:55.199730 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:55.200357 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:55.200461 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:55.204699 (+ 4238us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.193:53137: BlockingRecv error: recv got EOF from 127.24.116.193:53137 (error 108)
Metrics: {"server-negotiator.queue_time_us":162}
Aug 08 02:31:55 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:55 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:55.721993 6974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:55.708217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.194:47857)
0808 02:31:55.708797 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:55.708820 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:55.708930 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:55.709257 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:55.709260 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:55.709676 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:55.709830 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:55.709840 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:55.710858 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:55.710862 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:55.712035 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:55.712070 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:55.713047 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:55.713051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:55.713171 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:55.718657 (+ 5486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:55.718676 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:55.721699 (+ 3023us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":344,"threads_started":1}
W20260808 02:31:55.722330 6975 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:55.708403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:47857 (local address 127.24.116.254:45947)
0808 02:31:55.708855 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:55.708859 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:55.708877 (+ 18us) server_negotiation.cc:407] Connection header received
0808 02:31:55.709039 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:55.709042 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:55.709117 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:55.709208 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:55.709970 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:55.710723 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:55.712241 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:55.712907 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:55.713008 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:55.722037 (+ 9029us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.194:47857: BlockingRecv error: recv got EOF from 127.24.116.194:47857 (error 108)
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":252,"threads_started":1}
Aug 08 02:31:56 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:56 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:56.201788 6978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:56.192623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.195:35067)
0808 02:31:56.193184 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:56.193207 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:56.193364 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:56.193753 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:56.193759 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:56.194241 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:56.194401 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:56.194411 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:56.195678 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:56.195686 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:56.196722 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:56.196734 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:56.197470 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:56.197476 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:56.197661 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:56.198235 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:56.198252 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:56.201435 (+ 3183us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":331,"threads_started":1}
W20260808 02:31:56.201884 6975 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:56.192717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:35067 (local address 127.24.116.254:45947)
0808 02:31:56.192926 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:56.192935 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:56.193307 (+ 372us) server_negotiation.cc:407] Connection header received
0808 02:31:56.193482 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:56.193488 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:56.193586 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:56.193682 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:56.194564 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:56.195454 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:56.196874 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:56.197302 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:56.197456 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:56.201640 (+ 4184us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.195:35067: BlockingRecv error: recv got EOF from 127.24.116.195:35067 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 02:31:56 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:56 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:56.213830 6979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:56.205904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.193:51141)
0808 02:31:56.206399 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:56.206419 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:56.206525 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:56.206792 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:56.206795 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:56.207169 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:56.207332 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:56.207340 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:56.208249 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:56.208253 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:56.209222 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:56.209234 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:56.209903 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:56.209907 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:56.210022 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:56.210653 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:56.210671 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:56.213455 (+ 2784us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":254,"threads_started":1}
W20260808 02:31:56.213896 6975 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:56.205929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:51141 (local address 127.24.116.254:45947)
0808 02:31:56.206121 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:56.206130 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:56.206496 (+ 366us) server_negotiation.cc:407] Connection header received
0808 02:31:56.206610 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:56.206613 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:56.206676 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:56.206752 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:56.207464 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:56.208131 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:56.209346 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:56.209759 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:56.209858 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:56.213651 (+ 3793us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.193:51141: BlockingRecv error: recv got EOF from 127.24.116.193:51141 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 08 02:31:56 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:56 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:56.731521 6984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:56.723079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.194:53565)
0808 02:31:56.723651 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:56.723673 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:56.723854 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:56.724213 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:56.724217 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:56.724687 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:56.724879 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:56.724889 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:56.725880 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:56.725884 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:56.726821 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:56.726833 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:56.727484 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:56.727488 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:56.727607 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:56.728237 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:56.728256 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:56.731266 (+ 3010us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":267,"threads_started":1}
W20260808 02:31:56.731899 6985 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:56.723299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:53565 (local address 127.24.116.254:45947)
0808 02:31:56.723824 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:56.723829 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:56.723846 (+ 17us) server_negotiation.cc:407] Connection header received
0808 02:31:56.723988 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:56.723992 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:56.724058 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:56.724149 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:56.725025 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:56.725753 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:56.726945 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:56.727355 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:56.727451 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:56.731503 (+ 4052us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.194:53565: BlockingRecv error: recv got EOF from 127.24.116.194:53565 (error 108)
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":305,"threads_started":1}
Aug 08 02:31:57 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:57 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:57.211737 6986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:57.202923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.195:48771)
0808 02:31:57.203487 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:57.203505 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:57.203620 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:57.203927 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:57.203931 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:57.204405 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:57.204573 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:57.204583 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:57.205625 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:57.205629 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:57.206598 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:57.206610 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:57.207293 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:57.207298 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:57.207451 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:57.208166 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:57.208185 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:57.211485 (+ 3300us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":279,"threads_started":1}
W20260808 02:31:57.212126 6985 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:57.202993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:48771 (local address 127.24.116.254:45947)
0808 02:31:57.203186 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:57.203190 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:57.203584 (+ 394us) server_negotiation.cc:407] Connection header received
0808 02:31:57.203721 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:57.203725 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:57.203785 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:57.203875 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:57.204710 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:57.205483 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:57.206724 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:57.207126 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:57.207223 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:57.211727 (+ 4504us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.195:48771: BlockingRecv error: recv got EOF from 127.24.116.195:48771 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 08 02:31:57 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:57 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:57.223428 6987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:57.214799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.193:36131)
0808 02:31:57.215309 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:57.215345 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:57.215459 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:57.215768 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:57.215771 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:57.216123 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:57.216281 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:57.216289 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:57.217479 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:57.217483 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:57.218408 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:57.218421 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:57.219169 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:57.219173 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:57.219298 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:57.219984 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:57.220002 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:57.223200 (+ 3198us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":268,"threads_started":1}
W20260808 02:31:57.223675 6985 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:57.214798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:36131 (local address 127.24.116.254:45947)
0808 02:31:57.215025 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:57.215035 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:57.215429 (+ 394us) server_negotiation.cc:407] Connection header received
0808 02:31:57.215560 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:57.215564 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:57.215640 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:57.215727 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:57.216485 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:57.217330 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:57.218561 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:57.219021 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:57.219126 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:57.223411 (+ 4285us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.193:36131: BlockingRecv error: recv got EOF from 127.24.116.193:36131 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 08 02:31:57 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:57 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:57.740625 6989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:57.732560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.194:35085)
0808 02:31:57.733281 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:57.733298 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:57.733412 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:57.733720 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:57.733723 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:57.734146 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:57.734300 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:57.734309 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:57.735242 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:57.735245 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:57.736131 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:57.736142 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:57.736885 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:57.736889 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:57.737009 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:57.737610 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:57.737627 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:57.740279 (+ 2652us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":480,"threads_started":1}
W20260808 02:31:57.740861 6991 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:57.732593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:35085 (local address 127.24.116.254:45947)
0808 02:31:57.732983 (+ 390us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:57.732987 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:57.733371 (+ 384us) server_negotiation.cc:407] Connection header received
0808 02:31:57.733506 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:57.733510 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:57.733584 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:57.733670 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:57.734435 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:57.735119 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:57.736259 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:57.736743 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:57.736837 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:57.740597 (+ 3760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.194:35085: BlockingRecv error: recv got EOF from 127.24.116.194:35085 (error 108)
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":220,"threads_started":1}
Aug 08 02:31:58 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:58 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:58.221493 6992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:58.212695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.195:46899)
0808 02:31:58.213254 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:58.213271 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:58.213393 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:58.213704 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:58.213708 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:58.214134 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:58.214311 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:58.214321 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:58.215707 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:58.215717 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:58.216750 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:58.216764 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:58.217506 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:58.217512 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:58.217686 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:58.218377 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:58.218395 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:58.221266 (+ 2871us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":328,"threads_started":1}
W20260808 02:31:58.221706 6991 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:58.212782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:46899 (local address 127.24.116.254:45947)
0808 02:31:58.213042 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:58.213049 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:58.213357 (+ 308us) server_negotiation.cc:407] Connection header received
0808 02:31:58.213500 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:58.213503 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:58.213564 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:58.213647 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:58.214482 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:58.215545 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:58.216914 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:58.217346 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:58.217481 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:58.221467 (+ 3986us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.195:46899: BlockingRecv error: recv got EOF from 127.24.116.195:46899 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 08 02:31:58 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:58 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:58.233003 6993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:58.224429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.193:45275)
0808 02:31:58.224991 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:58.225011 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:58.225164 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:58.225515 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:58.225520 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:58.225972 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:58.226141 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:58.226152 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:58.227334 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:58.227339 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:58.228276 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:58.228290 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:58.229069 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:58.229075 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:58.229246 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:58.229873 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:58.229892 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:58.232734 (+ 2842us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":237,"threads_started":1}
W20260808 02:31:58.233181 6991 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:58.224500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:45275 (local address 127.24.116.254:45947)
0808 02:31:58.224666 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:58.224672 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:58.225095 (+ 423us) server_negotiation.cc:407] Connection header received
0808 02:31:58.225285 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:58.225306 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:58.225377 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:58.225476 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:58.226298 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:58.227179 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:58.228469 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:58.228910 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:58.229045 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:58.232936 (+ 3891us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.193:45275: BlockingRecv error: recv got EOF from 127.24.116.193:45275 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 08 02:31:58 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:58 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:58.751042 6995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:58.741640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.194:58703)
0808 02:31:58.742248 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:58.742265 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:58.742386 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:58.742997 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:58.743001 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:58.743413 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:58.743589 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:58.743598 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:58.744752 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:58.744758 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:58.746163 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:58.746177 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:58.746898 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:58.746903 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:58.747015 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:58.747625 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:58.747644 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:58.750783 (+ 3139us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":253,"threads_started":1}
W20260808 02:31:58.751246 6996 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:58.741713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:58703 (local address 127.24.116.254:45947)
0808 02:31:58.742705 (+ 992us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:58.742709 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:58.742723 (+ 14us) server_negotiation.cc:407] Connection header received
0808 02:31:58.742766 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:58.742769 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:58.742837 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:58.742924 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:58.743715 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:58.744574 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:58.746307 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:58.746740 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:58.746833 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:58.750959 (+ 4126us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.194:58703: BlockingRecv error: recv got EOF from 127.24.116.194:58703 (error 108)
Metrics: {"server-negotiator.queue_time_us":901,"thread_start_us":771,"threads_started":1}
Aug 08 02:31:59 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:59 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:59.231295 6998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:59.222426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.195:41709)
0808 02:31:59.223080 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:59.223096 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:59.223215 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:59.223537 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:59.223541 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:59.223983 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:59.224166 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:59.224176 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:59.225210 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:59.225214 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:59.226154 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:59.226165 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:59.226829 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:59.226834 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:59.226965 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:59.227674 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:59.227700 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:59.231038 (+ 3338us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":297,"threads_started":1}
W20260808 02:31:59.231436 6996 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:59.222536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:41709 (local address 127.24.116.254:45947)
0808 02:31:59.222752 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:59.222756 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:59.223195 (+ 439us) server_negotiation.cc:407] Connection header received
0808 02:31:59.223328 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:59.223332 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:59.223401 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:59.223488 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:59.224332 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:59.225080 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:59.226301 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:59.226696 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:59.226805 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:59.231227 (+ 4422us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.195:41709: BlockingRecv error: recv got EOF from 127.24.116.195:41709 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 08 02:31:59 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:59 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:59.243649 6999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:59.233853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.193:36937)
0808 02:31:59.234470 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:59.234493 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:59.234654 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:59.235047 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:59.235055 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:59.235490 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:59.235649 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:59.235658 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:59.237013 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:59.237019 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:59.238046 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:59.238060 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:59.238931 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:59.238938 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:59.239170 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:59.239934 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:59.239954 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:59.243281 (+ 3327us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":329,"threads_started":1}
W20260808 02:31:59.243829 6996 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:59.234037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:36937 (local address 127.24.116.254:45947)
0808 02:31:59.234281 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:59.234288 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:59.234582 (+ 294us) server_negotiation.cc:407] Connection header received
0808 02:31:59.234830 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:59.234835 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:59.234899 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:59.235010 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:59.235959 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:59.236856 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:59.238210 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:59.238695 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:59.238854 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:59.243504 (+ 4650us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.193:36937: BlockingRecv error: recv got EOF from 127.24.116.193:36937 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 08 02:31:59 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:31:59 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:31:59.761531 7000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:31:59.752060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.194:44385)
0808 02:31:59.752683 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0808 02:31:59.752701 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:31:59.752829 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:31:59.753131 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:31:59.753134 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:31:59.753595 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:31:59.753759 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:59.753770 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:59.754959 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:59.754964 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:59.756002 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:31:59.756015 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:31:59.756859 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:31:59.756864 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:31:59.756988 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:59.757789 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:31:59.757815 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:31:59.761273 (+ 3458us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":328,"threads_started":1}
W20260808 02:31:59.761870 7002 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:31:59.752138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:44385 (local address 127.24.116.254:45947)
0808 02:31:59.752639 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0808 02:31:59.752644 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:31:59.752807 (+ 163us) server_negotiation.cc:407] Connection header received
0808 02:31:59.752922 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:31:59.752925 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:31:59.752990 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:31:59.753087 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:31:59.753902 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:59.754828 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:59.756168 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:31:59.756653 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:31:59.756768 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:31:59.761484 (+ 4716us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.194:44385: BlockingRecv error: recv got EOF from 127.24.116.194:44385 (error 108)
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":299,"threads_started":1}
Aug 08 02:32:00 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:32:00 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:32:00.241348 7003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:00.232471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.195:48833)
0808 02:32:00.233075 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:00.233091 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:00.233251 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:00.233597 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:00.233602 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:00.234062 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:00.234214 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:00.234224 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:00.235260 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:00.235270 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:00.236189 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:00.236201 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:00.236960 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:00.236966 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:00.237130 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:00.237831 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:32:00.237853 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:00.241092 (+ 3239us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":341,"threads_started":1}
W20260808 02:32:00.241565 7002 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:32:00.232533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:48833 (local address 127.24.116.254:45947)
0808 02:32:00.232764 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:00.232769 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:00.233178 (+ 409us) server_negotiation.cc:407] Connection header received
0808 02:32:00.233378 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:00.233384 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:00.233451 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:00.233555 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:00.234376 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:00.235105 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:00.236355 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:00.236770 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:00.236919 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:00.241329 (+ 4410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.195:48833: BlockingRecv error: recv got EOF from 127.24.116.195:48833 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 08 02:32:00 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:32:00 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:32:00.253738 7005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:00.244706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.193:37219)
0808 02:32:00.245346 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:00.245375 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:00.245521 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:00.245879 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:00.245884 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:00.246297 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:00.246470 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:00.246480 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:00.247495 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:00.247501 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:00.248510 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:00.248529 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:00.249258 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:00.249263 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:00.249412 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:00.250018 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:32:00.250036 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:00.253350 (+ 3314us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":378,"threads_started":1}
W20260808 02:32:00.253903 7002 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:32:00.244728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:37219 (local address 127.24.116.254:45947)
0808 02:32:00.244958 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:00.244967 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:00.245462 (+ 495us) server_negotiation.cc:407] Connection header received
0808 02:32:00.245654 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:00.245659 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:00.245741 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:00.245848 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:00.246613 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:00.247347 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:00.248663 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:00.249090 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:00.249194 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:00.253557 (+ 4363us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.193:37219: BlockingRecv error: recv got EOF from 127.24.116.193:37219 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
Aug 08 02:32:00 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:32:00 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:32:00.777549 7006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:00.762659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.194:36503)
0808 02:32:00.763158 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:00.763176 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:00.763280 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:00.763960 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:00.763964 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:00.764585 (+ 621us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:00.764841 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:00.764855 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:00.765995 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:00.766000 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:00.767018 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:00.767031 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:00.767767 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:00.767772 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:00.767909 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:00.774127 (+ 6218us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:32:00.774146 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:00.777279 (+ 3133us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":273,"threads_started":1}
W20260808 02:32:00.777843 7010 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:32:00.762685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:36503 (local address 127.24.116.254:45947)
0808 02:32:00.763623 (+ 938us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:00.763627 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:00.763641 (+ 14us) server_negotiation.cc:407] Connection header received
0808 02:32:00.763685 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:00.763689 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:00.763758 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:00.763843 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:00.765006 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:00.765823 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:00.767163 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:00.767620 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:00.767713 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:00.777524 (+ 9811us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.194:36503: BlockingRecv error: recv got EOF from 127.24.116.194:36503 (error 108)
Metrics: {"server-negotiator.queue_time_us":848,"thread_start_us":757,"threads_started":1}
Aug 08 02:32:01 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:32:01 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:32:01.251521 7011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:01.242427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.195:36741)
0808 02:32:01.242989 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:01.243005 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:01.243123 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:01.243465 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:01.243469 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:01.243925 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:01.244098 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:01.244108 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:01.245300 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:01.245308 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:01.246411 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:01.246427 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:01.247162 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:01.247166 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:01.247320 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:01.247943 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:32:01.247962 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:01.251173 (+ 3211us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":307,"threads_started":1}
W20260808 02:32:01.251654 7010 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:32:01.242487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:36741 (local address 127.24.116.254:45947)
0808 02:32:01.242685 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:01.242690 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:01.243092 (+ 402us) server_negotiation.cc:407] Connection header received
0808 02:32:01.243223 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:01.243227 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:01.243315 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:01.243402 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:01.244275 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:01.245130 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:01.246578 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:01.246984 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:01.247082 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:01.251393 (+ 4311us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.195:36741: BlockingRecv error: recv got EOF from 127.24.116.195:36741 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 08 02:32:01 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:32:01 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:32:01.262650 7012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:01.254733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.193:46245)
0808 02:32:01.255197 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:01.255217 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:01.255338 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:01.255628 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:01.255631 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:01.256029 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:01.256182 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:01.256191 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:01.257208 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:01.257212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:01.258153 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:01.258165 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:01.258834 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:01.258838 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:01.258952 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:01.259505 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:32:01.259522 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:01.262428 (+ 2906us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":270,"threads_started":1}
W20260808 02:32:01.262952 7010 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:32:01.254826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:46245 (local address 127.24.116.254:45947)
0808 02:32:01.255065 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:01.255071 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:01.255293 (+ 222us) server_negotiation.cc:407] Connection header received
0808 02:32:01.255430 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:01.255434 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:01.255503 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:01.255582 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:01.256353 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:01.257078 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:01.258275 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:01.258671 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:01.258762 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:01.262609 (+ 3847us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.193:46245: BlockingRecv error: recv got EOF from 127.24.116.193:46245 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 08 02:32:01 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:32:01 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:32:01.787067 7013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:01.778522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.194:39419)
0808 02:32:01.779093 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:01.779110 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:01.779220 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:01.779552 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:01.779555 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:01.779933 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:01.780078 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:01.780087 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:01.781196 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:01.781200 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:01.782214 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:01.782227 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:01.782912 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:01.782916 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:01.783025 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:01.783614 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:32:01.783631 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:01.786829 (+ 3198us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":331,"threads_started":1}
W20260808 02:32:01.787410 7015 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:32:01.778610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:39419 (local address 127.24.116.254:45947)
0808 02:32:01.779084 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:01.779088 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:01.779181 (+ 93us) server_negotiation.cc:407] Connection header received
0808 02:32:01.779314 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:01.779317 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:01.779412 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:01.779502 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:01.780205 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:01.781062 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:01.782342 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:01.782763 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:01.782872 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:01.787105 (+ 4233us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.194:39419: BlockingRecv error: recv got EOF from 127.24.116.194:39419 (error 108)
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":284,"threads_started":1}
Aug 08 02:32:02 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:32:02 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:32:02.261952 7016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:02.252769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.195:46695)
0808 02:32:02.253320 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:02.253346 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:02.253464 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:02.253765 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:02.253769 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:02.254186 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:02.254345 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:02.254355 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:02.255548 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:02.255552 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:02.256597 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:02.256609 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:02.257558 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:02.257565 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:02.257743 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:02.258418 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:32:02.258437 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:02.261599 (+ 3162us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":321,"threads_started":1}
W20260808 02:32:02.262045 7015 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:32:02.252982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:46695 (local address 127.24.116.254:45947)
0808 02:32:02.253152 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:02.253157 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:02.253421 (+ 264us) server_negotiation.cc:407] Connection header received
0808 02:32:02.253563 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:02.253566 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:02.253628 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:02.253712 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:02.254539 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:02.255397 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:02.256751 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:02.257400 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:02.257538 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:02.261805 (+ 4267us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.195:46695: BlockingRecv error: recv got EOF from 127.24.116.195:46695 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 08 02:32:02 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:32:02 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:32:02.278044 7017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:02.263508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.193:46099)
0808 02:32:02.266115 (+ 2607us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:02.266140 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:02.266281 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:02.268453 (+ 2172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:02.268459 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:02.268978 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:02.269222 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:02.269234 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:02.270777 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:02.270782 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:02.272259 (+ 1477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:02.272277 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:02.273531 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:02.273536 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:02.273739 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:02.274476 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:32:02.274501 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:02.277656 (+ 3155us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":2490,"thread_start_us":2365,"threads_started":1}
W20260808 02:32:02.278122 7015 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:32:02.263599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:46099 (local address 127.24.116.254:45947)
0808 02:32:02.263828 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:02.263835 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:02.266234 (+ 2399us) server_negotiation.cc:407] Connection header received
0808 02:32:02.266437 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:02.266442 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:02.266514 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:02.266603 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:02.269394 (+ 2791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:02.270574 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:02.272452 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:02.273171 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:02.273268 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:02.277850 (+ 4582us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.193:46099: BlockingRecv error: recv got EOF from 127.24.116.193:46099 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 08 02:32:02 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:32:02 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:32:02.798030 7019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:02.788191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.194:57841)
0808 02:32:02.788857 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:02.788882 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:02.789045 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:02.789466 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:02.789471 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:02.789937 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:02.790143 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:02.790154 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:02.791393 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:02.791402 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:02.792941 (+ 1539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:02.792959 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:02.793853 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:02.793858 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:02.793997 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:02.794617 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:32:02.794635 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:02.797756 (+ 3121us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":322,"threads_started":1}
W20260808 02:32:02.798237 7022 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:32:02.788274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:57841 (local address 127.24.116.254:45947)
0808 02:32:02.788940 (+ 666us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:02.788949 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:02.788972 (+ 23us) server_negotiation.cc:407] Connection header received
0808 02:32:02.789223 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:02.789227 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:02.789298 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:02.789423 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:02.790308 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:02.791214 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:02.793100 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:02.793663 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:02.793766 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:02.797970 (+ 4204us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.194:57841: BlockingRecv error: recv got EOF from 127.24.116.194:57841 (error 108)
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":308,"threads_started":1}
Aug 08 02:32:03 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:32:03 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:32:03.272931 7023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:03.263173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.195:34959)
0808 02:32:03.263721 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:03.263738 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:03.263915 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:03.264256 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:03.264260 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:03.264754 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:03.264956 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:03.264966 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:03.266004 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:03.266009 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:03.266902 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:03.266913 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:03.267961 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:03.267967 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:03.268156 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:03.268882 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:32:03.268906 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:03.272555 (+ 3649us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":308,"threads_started":1}
W20260808 02:32:03.273025 7022 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:32:03.263258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:34959 (local address 127.24.116.254:45947)
0808 02:32:03.263536 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:03.263546 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:03.263866 (+ 320us) server_negotiation.cc:407] Connection header received
0808 02:32:03.264057 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:03.264061 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:03.264122 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:03.264220 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:03.265113 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:03.265868 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:03.267065 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:03.267785 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:03.267943 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:03.272759 (+ 4816us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.195:34959: BlockingRecv error: recv got EOF from 127.24.116.195:34959 (error 108)
Metrics: {"server-negotiator.queue_time_us":108}
Aug 08 02:32:03 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:32:03 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:32:03.287779 7024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:03.278978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.193:42735)
0808 02:32:03.279530 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:03.279560 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:03.279674 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:03.279990 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:03.279993 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:03.280481 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:03.280637 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:03.280645 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:03.281854 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:03.281862 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:03.283032 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:03.283045 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:03.283786 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:03.283790 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:03.283921 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:03.284568 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:32:03.284586 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:03.287404 (+ 2818us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":338,"threads_started":1}
W20260808 02:32:03.288017 7022 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:32:03.279085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:42735 (local address 127.24.116.254:45947)
0808 02:32:03.279279 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:03.279283 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:03.279631 (+ 348us) server_negotiation.cc:407] Connection header received
0808 02:32:03.279771 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:03.279774 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:03.279860 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:03.279947 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:03.280774 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:03.281698 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:03.283186 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:03.283660 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:03.283760 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:03.287656 (+ 3896us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.193:42735: BlockingRecv error: recv got EOF from 127.24.116.193:42735 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 08 02:32:03 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:32:03 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:32:03.808012 7027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:03.799113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.194:56039)
0808 02:32:03.799717 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:03.799733 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:03.799845 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:03.800172 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:03.800175 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:03.800693 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:03.800856 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:03.800866 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:03.802004 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:03.802008 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:03.802911 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:03.802923 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:03.803816 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:03.803822 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:03.803979 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:03.804764 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:32:03.804784 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:03.807752 (+ 2968us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":364,"threads_started":1}
W20260808 02:32:03.808200 7026 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:32:03.799141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:56039 (local address 127.24.116.254:45947)
0808 02:32:03.799611 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:03.799615 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:03.799802 (+ 187us) server_negotiation.cc:407] Connection header received
0808 02:32:03.799962 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:03.799965 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:03.800042 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:03.800130 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:03.801022 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:03.801877 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:03.803051 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:03.803491 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:03.803634 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:03.807954 (+ 4320us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.194:56039: BlockingRecv error: recv got EOF from 127.24.116.194:56039 (error 108)
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":274,"threads_started":1}
Aug 08 02:32:04 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:32:04 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:32:04.283278 7029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:04.274470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.195:55407)
0808 02:32:04.275045 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:04.275062 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:04.275192 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:04.275488 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:04.275491 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:04.275953 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:04.276117 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:04.276125 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:04.277227 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:04.277231 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:04.278193 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:04.278205 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:04.278866 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:04.278870 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:04.278998 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:04.279708 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:32:04.279735 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:04.283040 (+ 3305us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":361,"threads_started":1}
W20260808 02:32:04.283457 7026 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:32:04.274497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:55407 (local address 127.24.116.254:45947)
0808 02:32:04.274714 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:04.274723 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:04.275146 (+ 423us) server_negotiation.cc:407] Connection header received
0808 02:32:04.275280 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:04.275284 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:04.275352 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:04.275436 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:04.276252 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:04.277096 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:04.278342 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:04.278734 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:04.278845 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:04.283241 (+ 4396us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.195:55407: BlockingRecv error: recv got EOF from 127.24.116.195:55407 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 08 02:32:04 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:32:04 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:32:04.297796 7033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:04.288822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.193:40187)
0808 02:32:04.289416 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:04.289435 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:04.289592 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:04.289934 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:04.289939 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:04.290355 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:04.290510 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:04.290518 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:04.291531 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:04.291542 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:04.292894 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:04.292908 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:04.293800 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:04.293818 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:04.293979 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:04.294552 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:32:04.294570 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:04.297540 (+ 2970us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":304,"threads_started":1}
W20260808 02:32:04.297961 7026 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:32:04.288910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:40187 (local address 127.24.116.254:45947)
0808 02:32:04.289139 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:04.289147 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:04.289521 (+ 374us) server_negotiation.cc:407] Connection header received
0808 02:32:04.289712 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:04.289718 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:04.289801 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:04.289905 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:04.290647 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:04.291391 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:04.293031 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:04.293612 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:04.293736 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:04.297702 (+ 3966us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.193:40187: BlockingRecv error: recv got EOF from 127.24.116.193:40187 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 02:32:04 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:32:04 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:32:04.818347 7039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:04.809088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.194:44629)
0808 02:32:04.809681 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:04.809700 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:04.809819 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:04.810158 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:04.810162 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:04.810626 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:04.810829 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:04.810839 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:04.811952 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:04.811957 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:04.813017 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:04.813031 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:04.813752 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:04.813756 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:04.813896 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:04.814531 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:32:04.814550 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:04.817940 (+ 3390us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":316,"threads_started":1}
W20260808 02:32:04.818511 7041 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:32:04.809267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:44629 (local address 127.24.116.254:45947)
0808 02:32:04.809805 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:04.809809 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:04.809826 (+ 17us) server_negotiation.cc:407] Connection header received
0808 02:32:04.809927 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:04.809930 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:04.810004 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:04.810095 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:04.811008 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:04.811793 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:04.813176 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:04.813595 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:04.813697 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:04.818172 (+ 4475us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.194:44629: BlockingRecv error: recv got EOF from 127.24.116.194:44629 (error 108)
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":323,"threads_started":1}
Aug 08 02:32:05 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:32:05 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:32:05.292869 7042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:05.284212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.195:54289)
0808 02:32:05.284863 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:05.284879 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:05.284996 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:05.285279 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:05.285282 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:05.285704 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:05.285868 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:05.285877 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:05.286838 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:05.286842 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:05.287848 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:05.287864 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:05.288707 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:05.288712 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:05.288835 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:05.289510 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:32:05.289528 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:05.292619 (+ 3091us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":368,"threads_started":1}
W20260808 02:32:05.293129 7041 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:32:05.284279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:54289 (local address 127.24.116.254:45947)
0808 02:32:05.284481 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:05.284489 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:05.284974 (+ 485us) server_negotiation.cc:407] Connection header received
0808 02:32:05.285092 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:05.285095 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:05.285156 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:05.285236 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:05.285987 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:05.286701 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:05.287992 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:05.288539 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:05.288627 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:05.292838 (+ 4211us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.195:54289: BlockingRecv error: recv got EOF from 127.24.116.195:54289 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 08 02:32:05 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:32:05 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:32:05.306973 7043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:05.298754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.193:44127)
0808 02:32:05.299242 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:05.299262 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:05.299411 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:05.299744 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:05.299750 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:05.300146 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:05.300388 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:05.300399 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:05.301369 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:05.301374 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:05.302293 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:05.302304 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:05.303019 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:05.303024 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:05.303194 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:05.303776 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:32:05.303793 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:05.306609 (+ 2816us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":266,"threads_started":1}
W20260808 02:32:05.307044 7041 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:32:05.298827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:44127 (local address 127.24.116.254:45947)
0808 02:32:05.299118 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:05.299124 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:05.299358 (+ 234us) server_negotiation.cc:407] Connection header received
0808 02:32:05.299538 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:05.299542 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:05.299611 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:05.299709 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:05.300522 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:05.301222 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:05.302431 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:05.302876 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:05.303006 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:05.306799 (+ 3793us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.193:44127: BlockingRecv error: recv got EOF from 127.24.116.193:44127 (error 108)
Metrics: {"server-negotiator.queue_time_us":142}
Aug 08 02:32:05 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:32:05 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:32:05.835191 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:05.819373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.194:47837)
0808 02:32:05.819948 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:05.819967 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:05.820086 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:05.820464 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:05.820467 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:05.820888 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:05.821084 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:05.821095 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:05.822386 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:05.822390 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:05.823442 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:05.823459 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:05.824290 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:05.824294 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:05.824506 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:05.831276 (+ 6770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:32:05.831301 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:05.834922 (+ 3621us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":291,"threads_started":1}
W20260808 02:32:05.835474 7045 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:32:05.819470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:47837 (local address 127.24.116.254:45947)
0808 02:32:05.819985 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:05.819990 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:05.820026 (+ 36us) server_negotiation.cc:407] Connection header received
0808 02:32:05.820207 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:05.820211 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:05.820273 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:05.820419 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:05.821231 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:05.822230 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:05.823605 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:05.824057 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:05.824172 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:05.835189 (+ 11017us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.194:47837: BlockingRecv error: recv got EOF from 127.24.116.194:47837 (error 108)
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":276,"threads_started":1}
Aug 08 02:32:06 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:32:06 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.195@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:32:06.302708 7046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:06.293909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.195:38633)
0808 02:32:06.294686 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:06.294703 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:06.294860 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:06.295209 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:06.295214 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:06.295630 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:06.295807 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:06.295819 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:06.296990 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:06.296996 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:06.297900 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:06.297910 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:06.298597 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:06.298603 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:06.298773 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:06.299432 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:32:06.299449 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:06.302348 (+ 2899us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":659,"thread_start_us":535,"threads_started":1}
W20260808 02:32:06.302762 7045 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:32:06.294029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:38633 (local address 127.24.116.254:45947)
0808 02:32:06.294226 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:06.294232 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:06.294792 (+ 560us) server_negotiation.cc:407] Connection header received
0808 02:32:06.294998 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:06.295003 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:06.295074 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:06.295174 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:06.295953 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:06.296848 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:06.298039 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:06.298447 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:06.298571 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:06.302546 (+ 3975us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.195:38633: BlockingRecv error: recv got EOF from 127.24.116.195:38633 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 08 02:32:06 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:32:06 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.193@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:32:06.315936 7048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:06.308034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.193:47293)
0808 02:32:06.308631 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:06.308651 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:06.308759 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:06.309063 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:06.309067 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:06.309464 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:06.309628 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:06.309636 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:06.310564 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:06.310568 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:06.311493 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:06.311505 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:06.312166 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:06.312170 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:06.312283 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:06.312995 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:32:06.313013 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:06.315655 (+ 2642us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":348,"threads_started":1}
W20260808 02:32:06.316075 7045 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:32:06.308103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:47293 (local address 127.24.116.254:45947)
0808 02:32:06.308264 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:06.308268 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:06.308719 (+ 451us) server_negotiation.cc:407] Connection header received
0808 02:32:06.308867 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:06.308871 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:06.308940 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:06.309020 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:06.309741 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:06.310434 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:06.311612 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:06.312040 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:06.312132 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:06.315843 (+ 3711us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.193:47293: BlockingRecv error: recv got EOF from 127.24.116.193:47293 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 08 02:32:06 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:32:06 dist-test-slave-45dx krb5kdc[5441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.116.194@KRBTEST.COM for oryx/127.24.116.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:32:06.846933 7049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:06.836697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45947 (local address 127.24.116.194:38147)
0808 02:32:06.837581 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:06.837606 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:06.837772 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:06.838226 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:06.838232 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:06.838731 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:06.838907 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:06.838917 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:06.840054 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:06.840060 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:06.841425 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:06.841442 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:06.842479 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:06.842486 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:06.842671 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:06.843448 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:32:06.843472 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:06.846558 (+ 3086us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.116.254:45947: Server oryx/127.24.116.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":715,"thread_start_us":338,"threads_started":1}
W20260808 02:32:06.847065 7051 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:32:06.836763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:38147 (local address 127.24.116.254:45947)
0808 02:32:06.837656 (+ 893us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:06.837665 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:06.837687 (+ 22us) server_negotiation.cc:407] Connection header received
0808 02:32:06.837945 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:06.837950 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:06.838053 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:06.838175 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:06.839060 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:06.839904 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:06.841595 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:06.842298 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:06.842443 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:06.846799 (+ 4356us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.116.194:38147: BlockingRecv error: recv got EOF from 127.24.116.194:38147 (error 108)
Metrics: {"server-negotiator.queue_time_us":737,"thread_start_us":630,"threads_started":1}
I20260808 02:32:07.140931 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 6318
I20260808 02:32:07.153396 7054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:07.141990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34054 (local address 127.24.116.193:46865)
0808 02:32:07.142511 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:07.142519 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:07.142545 (+ 26us) server_negotiation.cc:407] Connection header received
0808 02:32:07.142603 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:07.142610 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:07.142821 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:07.142982 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:07.144481 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:07.145519 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:07.146813 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:07.147374 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:07.147477 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:07.150004 (+ 2527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:07.150013 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:07.150025 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:32:07.150058 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:07.152783 (+ 2725us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.24.116.193@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 02:32:07.153069 (+ 286us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34054: Request ticket server kudu/127.24.116.193@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":238,"threads_started":1}
W20260808 02:32:07.153522 7054 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34054: Request ticket server kudu/127.24.116.193@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 02:32:07.153493 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 6318: Not authorized: Client connection negotiation failed: client connection to 127.24.116.193:46865: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.24.116.193@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 02:32:07.153726 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 6318
I20260808 02:32:07.183694 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 6559
I20260808 02:32:07.196485 7056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:07.184991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38996 (local address 127.24.116.194:44259)
0808 02:32:07.185559 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:07.185567 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:07.185598 (+ 31us) server_negotiation.cc:407] Connection header received
0808 02:32:07.185661 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:07.185668 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:07.185879 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:07.186038 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:07.187334 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:07.188543 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:07.189921 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:07.190456 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:07.190573 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:07.193257 (+ 2684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:07.193267 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:07.193281 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:32:07.193311 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:07.195877 (+ 2566us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.24.116.194@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 02:32:07.196152 (+ 275us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38996: Request ticket server kudu/127.24.116.194@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":243,"threads_started":1}
W20260808 02:32:07.196602 7056 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38996: Request ticket server kudu/127.24.116.194@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 02:32:07.196642 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 6559: Not authorized: Client connection negotiation failed: client connection to 127.24.116.194:44259: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.24.116.194@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 02:32:07.196794 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 6559
I20260808 02:32:07.225318 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 6758
I20260808 02:32:07.237569 7058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:07.226423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47006 (local address 127.24.116.195:32987)
0808 02:32:07.227069 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:07.227076 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:07.227105 (+ 29us) server_negotiation.cc:407] Connection header received
0808 02:32:07.227168 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:07.227174 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:07.227404 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:07.227564 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:07.228988 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:07.229996 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:07.231113 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:07.231689 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:07.231784 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:07.234441 (+ 2657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:07.234450 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:07.234464 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:32:07.234496 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:07.237078 (+ 2582us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.24.116.195@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 02:32:07.237322 (+ 244us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47006: Request ticket server kudu/127.24.116.195@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":483,"thread_start_us":311,"threads_started":1}
W20260808 02:32:07.237691 7058 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47006: Request ticket server kudu/127.24.116.195@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 02:32:07.237725 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 6758: Not authorized: Client connection negotiation failed: client connection to 127.24.116.195:32987: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.24.116.195@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 02:32:07.237921 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 6758
I20260808 02:32:07.264628 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 6205
I20260808 02:32:07.266001 6304 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:32:07.386591 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 6205
2026-08-08T02:32:07Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21905 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T02:32:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:32:07Z Disabled control of system clock
I20260808 02:32:07.490414 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:39861
--webserver_interface=127.24.116.254
--webserver_port=0
--builtin_ntp_servers=127.24.116.212:35541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:39861
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 02:32:07.829457 7065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:32:07.829741 7065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:32:07.829821 7065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:32:07.837073 7065 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:32:07.837185 7065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:32:07.837224 7065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:32:07.837275 7065 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:32:07.837319 7065 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:32:07.847913 7065 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:35541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:39861
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:39861
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:32:07.849231 7065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:32:07.850965 7065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:32:07.863082 7075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:32:07.863153 7077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:32:07.863461 7072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:32:07.863955 7065 server_base.cc:1034] running on GCE node
I20260808 02:32:07.864814 7065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:32:07.866251 7065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:32:07.867511 7065 hybrid_clock.cc:648] HybridClock initialized: now 1786156327867449 us; error 50 us; skew 500 ppm
I20260808 02:32:07.867950 7065 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:32:07.870450 7065 webserver.cc:460] Webserver started at http://127.24.116.254:44197/ using document root <none> and password file <none>
I20260808 02:32:07.871218 7065 fs_manager.cc:359] Metadata directory not provided
I20260808 02:32:07.871368 7065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:32:07.871763 7065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:32:07.875069 7065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "0de4f11f111342a99ad45c91c60a401d"
format_stamp: "Formatted at 2026-08-08 02:32:07 on dist-test-slave-45dx"
server_key: "881acc8101f0e0bc8f0de4dcab98bd25"
server_key_iv: "c69969e6572ec56d159e528e75091b8d"
server_key_version: "encryptionkey@0"
I20260808 02:32:07.875959 7065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "0de4f11f111342a99ad45c91c60a401d"
format_stamp: "Formatted at 2026-08-08 02:32:07 on dist-test-slave-45dx"
server_key: "881acc8101f0e0bc8f0de4dcab98bd25"
server_key_iv: "c69969e6572ec56d159e528e75091b8d"
server_key_version: "encryptionkey@0"
I20260808 02:32:07.881557 7065 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260808 02:32:07.885324 7084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:07.886736 7065 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 02:32:07.886960 7065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "0de4f11f111342a99ad45c91c60a401d"
format_stamp: "Formatted at 2026-08-08 02:32:07 on dist-test-slave-45dx"
server_key: "881acc8101f0e0bc8f0de4dcab98bd25"
server_key_iv: "c69969e6572ec56d159e528e75091b8d"
server_key_version: "encryptionkey@0"
I20260808 02:32:07.887203 7065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:32:07.907971 7065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:32:07.908937 7065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:32:07.909267 7065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:32:07.930302 7065 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:39861
I20260808 02:32:07.930308 7164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:39861 every 8 connection(s)
I20260808 02:32:07.931772 7065 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:32:07.935554 7165 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:32:07.936246 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 7065
I20260808 02:32:07.936517 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:32:07.937193 25043 external_mini_cluster.cc:1428] Setting key a230e6ab2bdaca96a527cef681b2970f
I20260808 02:32:07.950155 7165 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0de4f11f111342a99ad45c91c60a401d: Bootstrap starting.
I20260808 02:32:07.952584 7170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:07.939293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57888 (local address 127.24.116.254:39861)
0808 02:32:07.940483 (+ 1190us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:07.940498 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:07.940554 (+ 56us) server_negotiation.cc:407] Connection header received
0808 02:32:07.942452 (+ 1898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:07.942480 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:07.943065 (+ 585us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:07.943511 (+ 446us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:07.944018 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:07.945944 (+ 1926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:07.947321 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:07.948399 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:07.948577 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:07.949703 (+ 1126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:07.949716 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:07.949734 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:32:07.950434 (+ 700us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:07.950533 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:32:07.950563 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:32:07.950671 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:07.950921 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 02:32:07.951233 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":335,"threads_started":1}
I20260808 02:32:07.953987 7165 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0de4f11f111342a99ad45c91c60a401d: Neither blocks nor log segments found. Creating new log.
I20260808 02:32:07.955338 7165 log.cc:824] T 00000000000000000000000000000000 P 0de4f11f111342a99ad45c91c60a401d: Log is configured to *not* fsync() on all Append() calls
I20260808 02:32:07.957957 7165 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0de4f11f111342a99ad45c91c60a401d: No bootstrap required, opened a new log
I20260808 02:32:07.965152 7165 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0de4f11f111342a99ad45c91c60a401d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0de4f11f111342a99ad45c91c60a401d" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39861 } }
I20260808 02:32:07.965509 7165 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0de4f11f111342a99ad45c91c60a401d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:32:07.965626 7165 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0de4f11f111342a99ad45c91c60a401d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0de4f11f111342a99ad45c91c60a401d, State: Initialized, Role: FOLLOWER
I20260808 02:32:07.966221 7165 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0de4f11f111342a99ad45c91c60a401d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0de4f11f111342a99ad45c91c60a401d" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39861 } }
I20260808 02:32:07.966466 7165 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0de4f11f111342a99ad45c91c60a401d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:32:07.966619 7165 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0de4f11f111342a99ad45c91c60a401d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:32:07.966818 7165 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0de4f11f111342a99ad45c91c60a401d [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:32:07.969053 7165 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0de4f11f111342a99ad45c91c60a401d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0de4f11f111342a99ad45c91c60a401d" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39861 } }
I20260808 02:32:07.969532 7165 leader_election.cc:302] T 00000000000000000000000000000000 P 0de4f11f111342a99ad45c91c60a401d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0de4f11f111342a99ad45c91c60a401d; no voters:
I20260808 02:32:07.970110 7165 leader_election.cc:288] T 00000000000000000000000000000000 P 0de4f11f111342a99ad45c91c60a401d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:32:07.970283 7175 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0de4f11f111342a99ad45c91c60a401d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:32:07.971006 7175 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0de4f11f111342a99ad45c91c60a401d [term 1 LEADER]: Becoming Leader. State: Replica: 0de4f11f111342a99ad45c91c60a401d, State: Running, Role: LEADER
I20260808 02:32:07.971549 7175 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0de4f11f111342a99ad45c91c60a401d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0de4f11f111342a99ad45c91c60a401d" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39861 } }
I20260808 02:32:07.972106 7165 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0de4f11f111342a99ad45c91c60a401d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:32:07.974469 7177 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0de4f11f111342a99ad45c91c60a401d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0de4f11f111342a99ad45c91c60a401d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0de4f11f111342a99ad45c91c60a401d" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39861 } } }
I20260808 02:32:07.974566 7179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0de4f11f111342a99ad45c91c60a401d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0de4f11f111342a99ad45c91c60a401d. Latest consensus state: current_term: 1 leader_uuid: "0de4f11f111342a99ad45c91c60a401d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0de4f11f111342a99ad45c91c60a401d" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 39861 } } }
I20260808 02:32:07.974869 7177 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0de4f11f111342a99ad45c91c60a401d [sys.catalog]: This master's current role is: LEADER
I20260808 02:32:07.974915 7179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0de4f11f111342a99ad45c91c60a401d [sys.catalog]: This master's current role is: LEADER
I20260808 02:32:07.976475 7184 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:32:07.980922 7184 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:32:07.989179 7184 catalog_manager.cc:1347] Generated new cluster ID: 5dc3902cd4de4abc954b3cfe3169cf95
I20260808 02:32:07.989295 7184 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:32:08.001951 7184 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:32:08.003787 7184 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:32:08.026793 7184 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0de4f11f111342a99ad45c91c60a401d: Generated new TSK 0
I20260808 02:32:08.027916 7184 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:32:08.037429 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:39861
--builtin_ntp_servers=127.24.116.212:35541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 02:32:08.401448 7206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:32:08.401834 7206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:32:08.402004 7206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:32:08.409436 7206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:32:08.409570 7206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:32:08.409757 7206 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:32:08.419214 7206 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:35541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:39861
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:32:08.420573 7206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:32:08.422426 7206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:32:08.435799 7217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:32:08.435874 7219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:32:08.435830 7223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:32:08.436739 7206 server_base.cc:1034] running on GCE node
I20260808 02:32:08.437503 7206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:32:08.438498 7206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:32:08.439700 7206 hybrid_clock.cc:648] HybridClock initialized: now 1786156328439649 us; error 42 us; skew 500 ppm
I20260808 02:32:08.440037 7206 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:32:08.442457 7206 webserver.cc:460] Webserver started at http://127.24.116.193:41401/ using document root <none> and password file <none>
I20260808 02:32:08.443192 7206 fs_manager.cc:359] Metadata directory not provided
I20260808 02:32:08.443328 7206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:32:08.443681 7206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:32:08.446656 7206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "d06d39c031a34c95bf612bbe270ab877"
format_stamp: "Formatted at 2026-08-08 02:32:08 on dist-test-slave-45dx"
server_key: "1c249854a758b5f20ca314ef3df070e3"
server_key_iv: "23e2247b66d2d4f6a24ef470c26b4743"
server_key_version: "encryptionkey@0"
I20260808 02:32:08.447501 7206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "d06d39c031a34c95bf612bbe270ab877"
format_stamp: "Formatted at 2026-08-08 02:32:08 on dist-test-slave-45dx"
server_key: "1c249854a758b5f20ca314ef3df070e3"
server_key_iv: "23e2247b66d2d4f6a24ef470c26b4743"
server_key_version: "encryptionkey@0"
I20260808 02:32:08.453262 7206 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260808 02:32:08.456889 7229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:08.458397 7206 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 02:32:08.458539 7206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "d06d39c031a34c95bf612bbe270ab877"
format_stamp: "Formatted at 2026-08-08 02:32:08 on dist-test-slave-45dx"
server_key: "1c249854a758b5f20ca314ef3df070e3"
server_key_iv: "23e2247b66d2d4f6a24ef470c26b4743"
server_key_version: "encryptionkey@0"
I20260808 02:32:08.458771 7206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:32:08.483065 7206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:32:08.483894 7206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:32:08.484186 7206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:32:08.485189 7206 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:32:08.486599 7206 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:32:08.486698 7206 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:08.486799 7206 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:32:08.486855 7206 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:08.520974 7206 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:36181
I20260808 02:32:08.521072 7399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:36181 every 8 connection(s)
I20260808 02:32:08.522395 7206 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:32:08.529908 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 7206
I20260808 02:32:08.530124 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:32:08.530776 25043 external_mini_cluster.cc:1428] Setting key 360eb27e8d729fd826893ec517da5ac9
I20260808 02:32:08.533607 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:39861
--builtin_ntp_servers=127.24.116.212:35541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 02:32:08.536257 7402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:08.525286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:54739 (local address 127.24.116.254:39861)
0808 02:32:08.525783 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:08.525787 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:08.527114 (+ 1327us) server_negotiation.cc:407] Connection header received
0808 02:32:08.529074 (+ 1960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:08.529080 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:08.529172 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:08.529295 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:08.530523 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:08.531329 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:08.533183 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:08.533586 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:08.533684 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:08.535439 (+ 1755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:08.535444 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:08.535447 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:32:08.535466 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:08.535509 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:32:08.535521 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:32:08.535598 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:08.535906 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 02:32:08.535986 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":277,"threads_started":1}
I20260808 02:32:08.537691 7405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:08.525984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:39861 (local address 127.24.116.193:54739)
0808 02:32:08.526951 (+ 967us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:08.526995 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:08.528791 (+ 1796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:08.529559 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:08.529567 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:08.529693 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:08.530355 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:08.530374 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:08.531504 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:08.531508 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:08.533023 (+ 1515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:08.533038 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:08.533853 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:08.533863 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:08.534202 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:08.535054 (+ 852us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:32:08.535060 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:08.535116 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:32:08.535229 (+ 113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:32:08.535626 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:32:08.535640 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:32:08.535653 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 02:32:08.535857 (+ 204us) client_negotiation.cc:240] Negotiation successful
0808 02:32:08.536280 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":326,"threads_started":1}
I20260808 02:32:08.539239 7400 heartbeater.cc:347] Connected to a master server at 127.24.116.254:39861
I20260808 02:32:08.539556 7400 heartbeater.cc:464] Registering TS with master...
I20260808 02:32:08.540293 7400 heartbeater.cc:511] Master 127.24.116.254:39861 requested a full tablet report, sending...
I20260808 02:32:08.542676 7110 ts_manager.cc:194] Registered new tserver with Master: d06d39c031a34c95bf612bbe270ab877 (127.24.116.193:36181)
I20260808 02:32:08.544128 7110 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.116.193:54739
W20260808 02:32:08.882752 7406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:32:08.883059 7406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:32:08.883217 7406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:32:08.890511 7406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:32:08.890623 7406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:32:08.890803 7406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:32:08.900373 7406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:35541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:39861
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:32:08.901803 7406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:32:08.903654 7406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:32:08.917101 7416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:32:08.917132 7415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:32:08.917347 7419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:32:08.917904 7406 server_base.cc:1034] running on GCE node
I20260808 02:32:08.918516 7406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:32:08.919471 7406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:32:08.920737 7406 hybrid_clock.cc:648] HybridClock initialized: now 1786156328920662 us; error 66 us; skew 500 ppm
I20260808 02:32:08.921085 7406 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:32:08.923493 7406 webserver.cc:460] Webserver started at http://127.24.116.194:39077/ using document root <none> and password file <none>
I20260808 02:32:08.924257 7406 fs_manager.cc:359] Metadata directory not provided
I20260808 02:32:08.924431 7406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:32:08.924784 7406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:32:08.927769 7406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "17f238f9333d481fa8039c534d561e75"
format_stamp: "Formatted at 2026-08-08 02:32:08 on dist-test-slave-45dx"
server_key: "99f6b77384c922eedd80fcaca2c74426"
server_key_iv: "4bb6e5edc37227b3ffb9f27531a901cb"
server_key_version: "encryptionkey@0"
I20260808 02:32:08.928718 7406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "17f238f9333d481fa8039c534d561e75"
format_stamp: "Formatted at 2026-08-08 02:32:08 on dist-test-slave-45dx"
server_key: "99f6b77384c922eedd80fcaca2c74426"
server_key_iv: "4bb6e5edc37227b3ffb9f27531a901cb"
server_key_version: "encryptionkey@0"
I20260808 02:32:08.935441 7406 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.005s
I20260808 02:32:08.940075 7431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:08.941767 7406 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:32:08.941952 7406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "17f238f9333d481fa8039c534d561e75"
format_stamp: "Formatted at 2026-08-08 02:32:08 on dist-test-slave-45dx"
server_key: "99f6b77384c922eedd80fcaca2c74426"
server_key_iv: "4bb6e5edc37227b3ffb9f27531a901cb"
server_key_version: "encryptionkey@0"
I20260808 02:32:08.942194 7406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:32:08.969421 7406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:32:08.970307 7406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:32:08.970645 7406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:32:08.971614 7406 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:32:08.973313 7406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:32:08.973403 7406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:08.973587 7406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:32:08.973654 7406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:09.009078 7406 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:32837
I20260808 02:32:09.009179 7617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:32837 every 8 connection(s)
I20260808 02:32:09.010445 7406 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:32:09.015615 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 7406
I20260808 02:32:09.015784 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:32:09.016259 25043 external_mini_cluster.cc:1428] Setting key b3dc9d59aee308c4f7aad68688ed6e0c
I20260808 02:32:09.019043 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:39861
--builtin_ntp_servers=127.24.116.212:35541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 02:32:09.023320 7402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:09.013404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:51951 (local address 127.24.116.254:39861)
0808 02:32:09.013622 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:09.013627 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:09.015003 (+ 1376us) server_negotiation.cc:407] Connection header received
0808 02:32:09.016927 (+ 1924us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:09.016932 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:09.017002 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:09.017132 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:09.018187 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:09.018910 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:09.020576 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:09.020962 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:09.021097 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:09.022522 (+ 1425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:09.022527 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:09.022530 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:32:09.022549 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:09.022580 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:32:09.022593 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:32:09.022688 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:09.022908 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 02:32:09.023006 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 02:32:09.024384 7621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:09.013905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:39861 (local address 127.24.116.194:51951)
0808 02:32:09.014848 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:09.014885 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:09.016634 (+ 1749us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:09.017378 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:09.017386 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:09.017474 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:09.018013 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:09.018029 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:09.019065 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:09.019070 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:09.020430 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:09.020443 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:09.021184 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:09.021191 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:09.021443 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:09.022191 (+ 748us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:32:09.022194 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:09.022232 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:32:09.022323 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:32:09.022690 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:32:09.022705 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:32:09.022714 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 02:32:09.022896 (+ 182us) client_negotiation.cc:240] Negotiation successful
0808 02:32:09.023294 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":301,"threads_started":1}
I20260808 02:32:09.025838 7619 heartbeater.cc:347] Connected to a master server at 127.24.116.254:39861
I20260808 02:32:09.026176 7619 heartbeater.cc:464] Registering TS with master...
I20260808 02:32:09.027148 7619 heartbeater.cc:511] Master 127.24.116.254:39861 requested a full tablet report, sending...
I20260808 02:32:09.028759 7110 ts_manager.cc:194] Registered new tserver with Master: 17f238f9333d481fa8039c534d561e75 (127.24.116.194:32837)
I20260808 02:32:09.029944 7110 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.116.194:51951
W20260808 02:32:09.365897 7622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:32:09.366302 7622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:32:09.366448 7622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:32:09.374107 7622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:32:09.374207 7622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:32:09.374385 7622 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:32:09.383589 7622 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:35541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:39861
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:32:09.384963 7622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:32:09.386809 7622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:32:09.400573 7635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:32:09.400614 7630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:32:09.400664 7632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:32:09.401510 7622 server_base.cc:1034] running on GCE node
I20260808 02:32:09.402248 7622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:32:09.403236 7622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:32:09.404493 7622 hybrid_clock.cc:648] HybridClock initialized: now 1786156329404436 us; error 57 us; skew 500 ppm
I20260808 02:32:09.404863 7622 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:32:09.407109 7622 webserver.cc:460] Webserver started at http://127.24.116.195:37185/ using document root <none> and password file <none>
I20260808 02:32:09.407797 7622 fs_manager.cc:359] Metadata directory not provided
I20260808 02:32:09.407893 7622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:32:09.408178 7622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:32:09.411151 7622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "6d7c2674453b46d89ab25fc054b0044d"
format_stamp: "Formatted at 2026-08-08 02:32:09 on dist-test-slave-45dx"
server_key: "d7043bb26e2acd50e756c0093fd786e6"
server_key_iv: "c65a999c6beac1150931cd6b077316c6"
server_key_version: "encryptionkey@0"
I20260808 02:32:09.411912 7622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "6d7c2674453b46d89ab25fc054b0044d"
format_stamp: "Formatted at 2026-08-08 02:32:09 on dist-test-slave-45dx"
server_key: "d7043bb26e2acd50e756c0093fd786e6"
server_key_iv: "c65a999c6beac1150931cd6b077316c6"
server_key_version: "encryptionkey@0"
I20260808 02:32:09.417346 7622 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 02:32:09.420826 7644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:09.422309 7622 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 02:32:09.422515 7622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "6d7c2674453b46d89ab25fc054b0044d"
format_stamp: "Formatted at 2026-08-08 02:32:09 on dist-test-slave-45dx"
server_key: "d7043bb26e2acd50e756c0093fd786e6"
server_key_iv: "c65a999c6beac1150931cd6b077316c6"
server_key_version: "encryptionkey@0"
I20260808 02:32:09.422770 7622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:32:09.441672 7622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:32:09.442566 7622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:32:09.442890 7622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:32:09.443898 7622 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:32:09.445399 7622 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:32:09.445523 7622 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:09.445658 7622 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:32:09.445755 7622 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:09.481493 7622 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:38253
I20260808 02:32:09.481588 7823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:38253 every 8 connection(s)
I20260808 02:32:09.482887 7622 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:32:09.489874 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 7622
I20260808 02:32:09.490057 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:32:09.490657 25043 external_mini_cluster.cc:1428] Setting key fd2e11984400e77acd7cea2315fdaccc
I20260808 02:32:09.497035 7402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:09.485697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:38663 (local address 127.24.116.254:39861)
0808 02:32:09.485918 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:09.485923 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:09.487340 (+ 1417us) server_negotiation.cc:407] Connection header received
0808 02:32:09.489131 (+ 1791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:09.489135 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:09.489219 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:09.489306 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:09.490782 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:09.491671 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:09.494451 (+ 2780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:09.494845 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:09.494943 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:09.496253 (+ 1310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:09.496258 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:09.496261 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:32:09.496279 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:09.496372 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:32:09.496397 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:32:09.496475 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:09.496677 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 02:32:09.496754 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260808 02:32:09.498066 7827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:09.486225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:39861 (local address 127.24.116.195:38663)
0808 02:32:09.487167 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:09.487203 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:09.488876 (+ 1673us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:09.489590 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:09.489602 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:09.489718 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:09.490565 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:09.490588 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:09.491959 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:09.491965 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:09.494283 (+ 2318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:09.494306 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:09.495038 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:09.495043 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:09.495251 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:09.495952 (+ 701us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:32:09.495954 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:09.495993 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:32:09.496067 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:32:09.496489 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:32:09.496497 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:32:09.496503 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 02:32:09.496656 (+ 153us) client_negotiation.cc:240] Negotiation successful
0808 02:32:09.496971 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":272,"threads_started":1}
I20260808 02:32:09.499320 7824 heartbeater.cc:347] Connected to a master server at 127.24.116.254:39861
I20260808 02:32:09.499627 7824 heartbeater.cc:464] Registering TS with master...
I20260808 02:32:09.500448 7824 heartbeater.cc:511] Master 127.24.116.254:39861 requested a full tablet report, sending...
I20260808 02:32:09.501793 7110 ts_manager.cc:194] Registered new tserver with Master: 6d7c2674453b46d89ab25fc054b0044d (127.24.116.195:38253)
I20260808 02:32:09.502552 7110 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.116.195:38663
I20260808 02:32:09.506542 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 02:32:09.513247 7402 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:32:09.511460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57900 (local address 127.24.116.254:39861)
0808 02:32:09.511669 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:09.511674 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:09.512237 (+ 563us) server_negotiation.cc:407] Connection header received
0808 02:32:09.512477 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:09.512481 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:09.512548 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:09.512642 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:09.513070 (+ 428us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57900: BlockingRecv error: recv got EOF from 127.0.0.1:57900 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 02:32:09.514304 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 7206
I20260808 02:32:09.522507 7838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:09.515330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58770 (local address 127.24.116.193:36181)
0808 02:32:09.515883 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:09.515890 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:09.515916 (+ 26us) server_negotiation.cc:407] Connection header received
0808 02:32:09.515971 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:09.515977 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:09.516181 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:09.516361 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:09.516768 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:09.517755 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:09.519087 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:09.519630 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:09.519737 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:09.520991 (+ 1254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:09.520998 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:09.521010 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:32:09.521573 (+ 563us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:09.521627 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:32:09.521646 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:32:09.521781 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:09.521946 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 02:32:09.522059 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":266,"threads_started":1}
I20260808 02:32:09.523809 7395 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:32:09.606658 7400 heartbeater.cc:503] Master 127.24.116.254:39861 was elected leader, sending a full tablet report...
I20260808 02:32:09.608217 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 7206
W20260808 02:32:09.631376 7085 connection.cc:535] server connection from 127.24.116.193:54739 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 02:32:09.631783 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 7406
I20260808 02:32:09.639699 7843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:09.632717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56320 (local address 127.24.116.194:32837)
0808 02:32:09.633238 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:09.633245 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:09.633271 (+ 26us) server_negotiation.cc:407] Connection header received
0808 02:32:09.633331 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:09.633337 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:09.633555 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:09.633748 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:09.634195 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:09.635180 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:09.636620 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:09.637163 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:09.637281 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:09.638328 (+ 1047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:09.638336 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:09.638348 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:32:09.638949 (+ 601us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:09.638998 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:32:09.639018 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:32:09.639107 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:09.639253 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 02:32:09.639398 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":255,"threads_started":1}
I20260808 02:32:09.640997 7612 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:32:09.724391 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 7406
I20260808 02:32:09.749985 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 7622
I20260808 02:32:09.758803 7846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:09.751045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55544 (local address 127.24.116.195:38253)
0808 02:32:09.751701 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:09.751708 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:09.751738 (+ 30us) server_negotiation.cc:407] Connection header received
0808 02:32:09.751810 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:09.751817 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:09.752033 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:09.752209 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:09.752734 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:09.753866 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:09.755138 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:09.755731 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:09.755882 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:09.757291 (+ 1409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:09.757301 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:09.757315 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:32:09.757922 (+ 607us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:09.757972 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:32:09.757992 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:32:09.758121 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:09.758297 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 02:32:09.758453 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":349,"threads_started":1}
I20260808 02:32:09.760142 7816 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:32:09.842968 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 7622
I20260808 02:32:09.871286 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 7065
I20260808 02:32:09.872607 7155 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:32:09.975414 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 7065
2026-08-08T02:32:10Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2581 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T02:32:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:32:10Z Disabled control of system clock
I20260808 02:32:10.071830 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:38019
--webserver_interface=127.24.116.254
--webserver_port=0
--builtin_ntp_servers=127.24.116.212:35119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:38019
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 02:32:10.422083 7854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:32:10.422408 7854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:32:10.422501 7854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:32:10.429986 7854 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:32:10.430104 7854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:32:10.430142 7854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:32:10.430195 7854 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:32:10.430240 7854 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:32:10.440649 7854 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:35119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:38019
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:38019
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:32:10.441989 7854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:32:10.443774 7854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:32:10.456112 7865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:32:10.456180 7867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:32:10.456144 7864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:32:10.457074 7854 server_base.cc:1034] running on GCE node
I20260808 02:32:10.457930 7854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:32:10.459380 7854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:32:10.460628 7854 hybrid_clock.cc:648] HybridClock initialized: now 1786156330460587 us; error 59 us; skew 500 ppm
I20260808 02:32:10.461030 7854 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:32:10.468796 7854 webserver.cc:460] Webserver started at http://127.24.116.254:46335/ using document root <none> and password file <none>
I20260808 02:32:10.469633 7854 fs_manager.cc:359] Metadata directory not provided
I20260808 02:32:10.469781 7854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:32:10.470186 7854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:32:10.473701 7854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "c388138e4a7c45cab39c1dd93f9e485e"
format_stamp: "Formatted at 2026-08-08 02:32:10 on dist-test-slave-45dx"
server_key: "66fb27c0a5741a51a7916f8eb47eaa66"
server_key_iv: "0002150d6f9ca3b27a22077ebd92cb93"
server_key_version: "encryptionkey@0"
I20260808 02:32:10.474658 7854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "c388138e4a7c45cab39c1dd93f9e485e"
format_stamp: "Formatted at 2026-08-08 02:32:10 on dist-test-slave-45dx"
server_key: "66fb27c0a5741a51a7916f8eb47eaa66"
server_key_iv: "0002150d6f9ca3b27a22077ebd92cb93"
server_key_version: "encryptionkey@0"
I20260808 02:32:10.480643 7854 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 02:32:10.484139 7875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:10.485514 7854 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:32:10.485708 7854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "c388138e4a7c45cab39c1dd93f9e485e"
format_stamp: "Formatted at 2026-08-08 02:32:10 on dist-test-slave-45dx"
server_key: "66fb27c0a5741a51a7916f8eb47eaa66"
server_key_iv: "0002150d6f9ca3b27a22077ebd92cb93"
server_key_version: "encryptionkey@0"
I20260808 02:32:10.485950 7854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:32:10.491955 7854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:32:10.492797 7854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:32:10.493279 7854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:32:10.512152 7854 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:38019
I20260808 02:32:10.512189 7955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:38019 every 8 connection(s)
I20260808 02:32:10.513587 7854 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:32:10.517393 7957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:32:10.519599 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 7854
I20260808 02:32:10.519817 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:32:10.520663 25043 external_mini_cluster.cc:1428] Setting key 4cd10dea8f5e307b8dbb45a49e54804c
I20260808 02:32:10.529618 7961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:10.522998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46460 (local address 127.24.116.254:38019)
0808 02:32:10.524071 (+ 1073us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:10.524083 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:10.524126 (+ 43us) server_negotiation.cc:407] Connection header received
0808 02:32:10.525880 (+ 1754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:10.525902 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:10.526307 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:10.526669 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:10.527892 (+ 1223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:10.527899 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:10.527911 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:32:10.527926 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:10.527990 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:32:10.528009 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:32:10.528196 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:10.528371 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 02:32:10.528715 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":642,"thread_start_us":423,"threads_started":1}
I20260808 02:32:10.530546 7957 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c388138e4a7c45cab39c1dd93f9e485e: Bootstrap starting.
I20260808 02:32:10.534698 7957 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c388138e4a7c45cab39c1dd93f9e485e: Neither blocks nor log segments found. Creating new log.
I20260808 02:32:10.536290 7957 log.cc:824] T 00000000000000000000000000000000 P c388138e4a7c45cab39c1dd93f9e485e: Log is configured to *not* fsync() on all Append() calls
I20260808 02:32:10.539950 7957 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c388138e4a7c45cab39c1dd93f9e485e: No bootstrap required, opened a new log
I20260808 02:32:10.550556 7957 raft_consensus.cc:348] T 00000000000000000000000000000000 P c388138e4a7c45cab39c1dd93f9e485e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c388138e4a7c45cab39c1dd93f9e485e" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38019 } }
I20260808 02:32:10.551147 7957 raft_consensus.cc:374] T 00000000000000000000000000000000 P c388138e4a7c45cab39c1dd93f9e485e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:32:10.551275 7957 raft_consensus.cc:729] T 00000000000000000000000000000000 P c388138e4a7c45cab39c1dd93f9e485e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c388138e4a7c45cab39c1dd93f9e485e, State: Initialized, Role: FOLLOWER
I20260808 02:32:10.552124 7957 consensus_queue.cc:260] T 00000000000000000000000000000000 P c388138e4a7c45cab39c1dd93f9e485e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c388138e4a7c45cab39c1dd93f9e485e" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38019 } }
I20260808 02:32:10.552551 7957 raft_consensus.cc:388] T 00000000000000000000000000000000 P c388138e4a7c45cab39c1dd93f9e485e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:32:10.552728 7957 raft_consensus.cc:482] T 00000000000000000000000000000000 P c388138e4a7c45cab39c1dd93f9e485e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:32:10.552951 7957 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c388138e4a7c45cab39c1dd93f9e485e [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:32:10.555958 7957 raft_consensus.cc:504] T 00000000000000000000000000000000 P c388138e4a7c45cab39c1dd93f9e485e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c388138e4a7c45cab39c1dd93f9e485e" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38019 } }
I20260808 02:32:10.556646 7957 leader_election.cc:302] T 00000000000000000000000000000000 P c388138e4a7c45cab39c1dd93f9e485e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c388138e4a7c45cab39c1dd93f9e485e; no voters:
I20260808 02:32:10.557650 7957 leader_election.cc:288] T 00000000000000000000000000000000 P c388138e4a7c45cab39c1dd93f9e485e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:32:10.557857 7964 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c388138e4a7c45cab39c1dd93f9e485e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:32:10.558684 7964 raft_consensus.cc:686] T 00000000000000000000000000000000 P c388138e4a7c45cab39c1dd93f9e485e [term 1 LEADER]: Becoming Leader. State: Replica: c388138e4a7c45cab39c1dd93f9e485e, State: Running, Role: LEADER
I20260808 02:32:10.559365 7964 consensus_queue.cc:237] T 00000000000000000000000000000000 P c388138e4a7c45cab39c1dd93f9e485e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c388138e4a7c45cab39c1dd93f9e485e" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38019 } }
I20260808 02:32:10.560187 7957 sys_catalog.cc:564] T 00000000000000000000000000000000 P c388138e4a7c45cab39c1dd93f9e485e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:32:10.562945 7965 sys_catalog.cc:455] T 00000000000000000000000000000000 P c388138e4a7c45cab39c1dd93f9e485e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c388138e4a7c45cab39c1dd93f9e485e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c388138e4a7c45cab39c1dd93f9e485e" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38019 } } }
I20260808 02:32:10.563383 7965 sys_catalog.cc:458] T 00000000000000000000000000000000 P c388138e4a7c45cab39c1dd93f9e485e [sys.catalog]: This master's current role is: LEADER
I20260808 02:32:10.563058 7966 sys_catalog.cc:455] T 00000000000000000000000000000000 P c388138e4a7c45cab39c1dd93f9e485e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c388138e4a7c45cab39c1dd93f9e485e. Latest consensus state: current_term: 1 leader_uuid: "c388138e4a7c45cab39c1dd93f9e485e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c388138e4a7c45cab39c1dd93f9e485e" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38019 } } }
I20260808 02:32:10.563515 7966 sys_catalog.cc:458] T 00000000000000000000000000000000 P c388138e4a7c45cab39c1dd93f9e485e [sys.catalog]: This master's current role is: LEADER
I20260808 02:32:10.566967 7973 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:32:10.573504 7973 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:32:10.586892 7973 catalog_manager.cc:1347] Generated new cluster ID: e0eaff6f28aa49c787d51cc4b3760e7f
I20260808 02:32:10.587057 7973 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:32:10.606051 7973 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:32:10.606674 7973 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:32:10.617724 7973 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c388138e4a7c45cab39c1dd93f9e485e: Generated new TSK 0
I20260808 02:32:10.619012 7973 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:32:10.629536 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:38019
--builtin_ntp_servers=127.24.116.212:35119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 02:32:10.982152 7990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:32:10.982501 7990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:32:10.982674 7990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:32:10.989971 7990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:32:10.990103 7990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:32:10.990284 7990 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:32:10.999447 7990 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:35119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:38019
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:32:11.000805 7990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:32:11.002682 7990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:32:11.015934 7998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:32:11.016017 7997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:32:11.015971 8002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:32:11.016899 7990 server_base.cc:1034] running on GCE node
I20260808 02:32:11.017467 7990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:32:11.018380 7990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:32:11.019593 7990 hybrid_clock.cc:648] HybridClock initialized: now 1786156331019557 us; error 28 us; skew 500 ppm
I20260808 02:32:11.019917 7990 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:32:11.026132 7990 webserver.cc:460] Webserver started at http://127.24.116.193:36525/ using document root <none> and password file <none>
I20260808 02:32:11.026965 7990 fs_manager.cc:359] Metadata directory not provided
I20260808 02:32:11.027065 7990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:32:11.027357 7990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:32:11.030679 7990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "bef4aca3fb2e42e3b0b7c11e2382d79b"
format_stamp: "Formatted at 2026-08-08 02:32:11 on dist-test-slave-45dx"
server_key: "1326e9d0a15f1836ed4526c37144b860"
server_key_iv: "3fcad99f2174c1460559e67cbe6360ec"
server_key_version: "encryptionkey@0"
I20260808 02:32:11.031473 7990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "bef4aca3fb2e42e3b0b7c11e2382d79b"
format_stamp: "Formatted at 2026-08-08 02:32:11 on dist-test-slave-45dx"
server_key: "1326e9d0a15f1836ed4526c37144b860"
server_key_iv: "3fcad99f2174c1460559e67cbe6360ec"
server_key_version: "encryptionkey@0"
I20260808 02:32:11.037056 7990 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 02:32:11.041002 8015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:11.042418 7990 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:32:11.042557 7990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "bef4aca3fb2e42e3b0b7c11e2382d79b"
format_stamp: "Formatted at 2026-08-08 02:32:11 on dist-test-slave-45dx"
server_key: "1326e9d0a15f1836ed4526c37144b860"
server_key_iv: "3fcad99f2174c1460559e67cbe6360ec"
server_key_version: "encryptionkey@0"
I20260808 02:32:11.042739 7990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:32:11.048523 7990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:32:11.049271 7990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:32:11.049501 7990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:32:11.050356 7990 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:32:11.051867 7990 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:32:11.051961 7990 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:11.052042 7990 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:32:11.052098 7990 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:11.086440 7990 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:40653
I20260808 02:32:11.086529 8186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:40653 every 8 connection(s)
I20260808 02:32:11.087797 7990 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:32:11.091836 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 7990
I20260808 02:32:11.092092 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:32:11.092934 25043 external_mini_cluster.cc:1428] Setting key 390cc3fa8b75321cc76f0ce95b6e924a
I20260808 02:32:11.095943 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:38019
--builtin_ntp_servers=127.24.116.212:35119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 02:32:11.097221 8190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:11.090738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:53601 (local address 127.24.116.254:38019)
0808 02:32:11.091316 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:11.091322 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:11.092796 (+ 1474us) server_negotiation.cc:407] Connection header received
0808 02:32:11.094730 (+ 1934us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:11.094734 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:11.094785 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:11.094888 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:11.096348 (+ 1460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:11.096357 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:11.096365 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:32:11.096388 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:11.096443 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:32:11.096462 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:32:11.096606 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:11.096768 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 02:32:11.096834 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":270,"threads_started":1}
I20260808 02:32:11.098023 8191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:11.091487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:38019 (local address 127.24.116.193:53601)
0808 02:32:11.092635 (+ 1148us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:11.092680 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:11.094449 (+ 1769us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:11.095097 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:11.095105 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:11.095189 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:11.095946 (+ 757us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:32:11.095949 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:11.095986 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:32:11.096124 (+ 138us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:32:11.096570 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:32:11.096578 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:32:11.096583 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 02:32:11.096791 (+ 208us) client_negotiation.cc:240] Negotiation successful
0808 02:32:11.096998 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":371,"threads_started":1}
I20260808 02:32:11.099658 8188 heartbeater.cc:347] Connected to a master server at 127.24.116.254:38019
I20260808 02:32:11.100054 8188 heartbeater.cc:464] Registering TS with master...
I20260808 02:32:11.100746 8188 heartbeater.cc:511] Master 127.24.116.254:38019 requested a full tablet report, sending...
I20260808 02:32:11.103027 7897 ts_manager.cc:194] Registered new tserver with Master: bef4aca3fb2e42e3b0b7c11e2382d79b (127.24.116.193:40653)
W20260808 02:32:11.443078 8192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:32:11.443440 8192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:32:11.443611 8192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:32:11.451191 8192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:32:11.451333 8192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:32:11.451514 8192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:32:11.461110 8192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:35119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:38019
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:32:11.462527 8192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:32:11.464483 8192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:32:11.477768 8197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:32:11.477810 8200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:32:11.477870 8202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:32:11.478952 8192 server_base.cc:1034] running on GCE node
I20260808 02:32:11.479571 8192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:32:11.480623 8192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:32:11.481853 8192 hybrid_clock.cc:648] HybridClock initialized: now 1786156331481800 us; error 68 us; skew 500 ppm
I20260808 02:32:11.482197 8192 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:32:11.484694 8192 webserver.cc:460] Webserver started at http://127.24.116.194:34583/ using document root <none> and password file <none>
I20260808 02:32:11.485414 8192 fs_manager.cc:359] Metadata directory not provided
I20260808 02:32:11.485553 8192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:32:11.485896 8192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:32:11.489014 8192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "6af66cefc1174949a6ef03d5171921db"
format_stamp: "Formatted at 2026-08-08 02:32:11 on dist-test-slave-45dx"
server_key: "df3c35b78201f75105eb38928bc181a3"
server_key_iv: "53afba286f033f95eb5ae4ba223b9e0e"
server_key_version: "encryptionkey@0"
I20260808 02:32:11.489929 8192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "6af66cefc1174949a6ef03d5171921db"
format_stamp: "Formatted at 2026-08-08 02:32:11 on dist-test-slave-45dx"
server_key: "df3c35b78201f75105eb38928bc181a3"
server_key_iv: "53afba286f033f95eb5ae4ba223b9e0e"
server_key_version: "encryptionkey@0"
I20260808 02:32:11.495163 8192 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 02:32:11.498765 8210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:11.500156 8192 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 02:32:11.500411 8192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "6af66cefc1174949a6ef03d5171921db"
format_stamp: "Formatted at 2026-08-08 02:32:11 on dist-test-slave-45dx"
server_key: "df3c35b78201f75105eb38928bc181a3"
server_key_iv: "53afba286f033f95eb5ae4ba223b9e0e"
server_key_version: "encryptionkey@0"
I20260808 02:32:11.500653 8192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:32:11.506498 8192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:32:11.507314 8192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:32:11.507618 8192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:32:11.508656 8192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:32:11.510210 8192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:32:11.510339 8192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:11.510484 8192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:32:11.510577 8192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:11.546377 8192 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:36511
I20260808 02:32:11.546411 8378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:36511 every 8 connection(s)
I20260808 02:32:11.547816 8192 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:32:11.555889 8190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:11.550530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:43303 (local address 127.24.116.254:38019)
0808 02:32:11.550717 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:11.550722 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:11.552126 (+ 1404us) server_negotiation.cc:407] Connection header received
0808 02:32:11.553833 (+ 1707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:11.553839 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:11.553913 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:11.554007 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:11.555270 (+ 1263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:11.555274 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:11.555278 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:32:11.555294 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:11.555333 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:32:11.555344 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:32:11.555440 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:11.555606 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 02:32:11.555657 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 02:32:11.556913 8385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:11.551054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:38019 (local address 127.24.116.194:43303)
0808 02:32:11.551979 (+ 925us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:11.552015 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:11.553552 (+ 1537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:11.554206 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:11.554214 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:11.554303 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:11.554982 (+ 679us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:32:11.554985 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:11.555022 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:32:11.555105 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:32:11.555429 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:32:11.555437 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:32:11.555442 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 02:32:11.555649 (+ 207us) client_negotiation.cc:240] Negotiation successful
0808 02:32:11.555867 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":284,"threads_started":1}
I20260808 02:32:11.557808 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 8192
I20260808 02:32:11.558014 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:32:11.558449 8379 heartbeater.cc:347] Connected to a master server at 127.24.116.254:38019
I20260808 02:32:11.558586 25043 external_mini_cluster.cc:1428] Setting key f5161f9da82bdd7b2fc112b8a1ebab89
I20260808 02:32:11.558775 8379 heartbeater.cc:464] Registering TS with master...
I20260808 02:32:11.559510 8379 heartbeater.cc:511] Master 127.24.116.254:38019 requested a full tablet report, sending...
I20260808 02:32:11.560990 7897 ts_manager.cc:194] Registered new tserver with Master: 6af66cefc1174949a6ef03d5171921db (127.24.116.194:36511)
I20260808 02:32:11.561878 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:38019
--builtin_ntp_servers=127.24.116.212:35119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 02:32:11.913371 8387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:32:11.913667 8387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:32:11.913829 8387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:32:11.921169 8387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:32:11.921278 8387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:32:11.921485 8387 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:32:11.930836 8387 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:35119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:38019
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:32:11.932489 8387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:32:11.934386 8387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:32:11.948519 8395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:32:11.948485 8400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:32:11.948460 8396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:32:11.949255 8387 server_base.cc:1034] running on GCE node
I20260808 02:32:11.949956 8387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:32:11.951011 8387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:32:11.952260 8387 hybrid_clock.cc:648] HybridClock initialized: now 1786156331952204 us; error 65 us; skew 500 ppm
I20260808 02:32:11.952620 8387 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:32:11.954972 8387 webserver.cc:460] Webserver started at http://127.24.116.195:40493/ using document root <none> and password file <none>
I20260808 02:32:11.955684 8387 fs_manager.cc:359] Metadata directory not provided
I20260808 02:32:11.955823 8387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:32:11.956166 8387 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:32:11.959246 8387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "b9547f579b94473b9e563b7f7ec9798a"
format_stamp: "Formatted at 2026-08-08 02:32:11 on dist-test-slave-45dx"
server_key: "ae86f8cab0f088ca2b3f15327a9f2578"
server_key_iv: "20163979c646f79d03d6342f9ed14377"
server_key_version: "encryptionkey@0"
I20260808 02:32:11.960093 8387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "b9547f579b94473b9e563b7f7ec9798a"
format_stamp: "Formatted at 2026-08-08 02:32:11 on dist-test-slave-45dx"
server_key: "ae86f8cab0f088ca2b3f15327a9f2578"
server_key_iv: "20163979c646f79d03d6342f9ed14377"
server_key_version: "encryptionkey@0"
I20260808 02:32:11.965898 8387 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 02:32:11.969689 8406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:11.971153 8387 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 02:32:11.971372 8387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "b9547f579b94473b9e563b7f7ec9798a"
format_stamp: "Formatted at 2026-08-08 02:32:11 on dist-test-slave-45dx"
server_key: "ae86f8cab0f088ca2b3f15327a9f2578"
server_key_iv: "20163979c646f79d03d6342f9ed14377"
server_key_version: "encryptionkey@0"
I20260808 02:32:11.971629 8387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:32:11.977722 8387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:32:11.978574 8387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:32:11.978864 8387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:32:11.979807 8387 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:32:11.981360 8387 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:32:11.981487 8387 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:11.981626 8387 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:32:11.981714 8387 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:12.017494 8387 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:41487
I20260808 02:32:12.017552 8588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:41487 every 8 connection(s)
I20260808 02:32:12.018886 8387 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:32:12.023415 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 8387
I20260808 02:32:12.023618 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:32:12.024199 25043 external_mini_cluster.cc:1428] Setting key 84acd2e09adaa2e001153f1850b50f52
I20260808 02:32:12.028074 8190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:12.021542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:60313 (local address 127.24.116.254:38019)
0808 02:32:12.021769 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:12.021774 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:12.023227 (+ 1453us) server_negotiation.cc:407] Connection header received
0808 02:32:12.025565 (+ 2338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:12.025572 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:12.025639 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:12.025750 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:12.027181 (+ 1431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:12.027188 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:12.027194 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:32:12.027215 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:12.027286 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:32:12.027321 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:32:12.027456 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:12.027660 (+ 204us) server_negotiation.cc:299] Negotiation successful
0808 02:32:12.027734 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 02:32:12.029024 8593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:12.022045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:38019 (local address 127.24.116.195:60313)
0808 02:32:12.023041 (+ 996us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:12.023094 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:12.025232 (+ 2138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:12.025977 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:12.025985 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:12.026071 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:12.026878 (+ 807us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:32:12.026881 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:12.026919 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:32:12.027013 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:32:12.027431 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:32:12.027444 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:32:12.027455 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 02:32:12.027738 (+ 283us) client_negotiation.cc:240] Negotiation successful
0808 02:32:12.027991 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":305,"threads_started":1}
I20260808 02:32:12.030463 8590 heartbeater.cc:347] Connected to a master server at 127.24.116.254:38019
I20260808 02:32:12.030802 8590 heartbeater.cc:464] Registering TS with master...
I20260808 02:32:12.031388 8590 heartbeater.cc:511] Master 127.24.116.254:38019 requested a full tablet report, sending...
I20260808 02:32:12.032948 7897 ts_manager.cc:194] Registered new tserver with Master: b9547f579b94473b9e563b7f7ec9798a (127.24.116.195:41487)
I20260808 02:32:12.040165 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 02:32:12.047049 8190 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:32:12.045138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46474 (local address 127.24.116.254:38019)
0808 02:32:12.045344 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:12.045349 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:12.046053 (+ 704us) server_negotiation.cc:407] Connection header received
0808 02:32:12.046219 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:12.046223 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:12.046280 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:12.046375 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:12.046695 (+ 320us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46474: BlockingRecv error: recv got EOF from 127.0.0.1:46474 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 02:32:12.048075 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 7990
I20260808 02:32:12.051869 8604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:12.049157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57324 (local address 127.24.116.193:40653)
0808 02:32:12.049755 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:12.049761 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:12.049788 (+ 27us) server_negotiation.cc:407] Connection header received
0808 02:32:12.049846 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:12.049852 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:12.050068 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:12.050195 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:12.051153 (+ 958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:12.051160 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:12.051172 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:32:12.051191 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:12.051235 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:32:12.051251 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:32:12.051354 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:12.051452 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 02:32:12.051555 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":295,"threads_started":1}
I20260808 02:32:12.053172 8181 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:32:12.132890 8188 heartbeater.cc:503] Master 127.24.116.254:38019 was elected leader, sending a full tablet report...
I20260808 02:32:12.134274 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 7990
W20260808 02:32:12.155673 7877 connection.cc:535] server connection from 127.24.116.193:53601 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 02:32:12.156005 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 8192
I20260808 02:32:12.159745 8607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:12.157132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52338 (local address 127.24.116.194:36511)
0808 02:32:12.157657 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:12.157664 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:12.157692 (+ 28us) server_negotiation.cc:407] Connection header received
0808 02:32:12.157755 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:12.157761 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:12.157981 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:12.158105 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:12.159046 (+ 941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:12.159051 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:12.159062 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:32:12.159079 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:12.159118 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:32:12.159131 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:32:12.159237 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:12.159316 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 02:32:12.159429 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":256,"threads_started":1}
I20260808 02:32:12.161167 8374 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:32:12.241743 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 8192
I20260808 02:32:12.270618 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 8387
I20260808 02:32:12.274924 8609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:12.272127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43332 (local address 127.24.116.195:41487)
0808 02:32:12.272776 (+ 649us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:12.272783 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:12.272820 (+ 37us) server_negotiation.cc:407] Connection header received
0808 02:32:12.272892 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:12.272899 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:12.273117 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:12.273251 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:12.274195 (+ 944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:12.274201 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:12.274212 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:32:12.274224 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:12.274266 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:32:12.274282 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:32:12.274442 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:12.274488 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 02:32:12.274613 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":335,"threads_started":1}
I20260808 02:32:12.276393 8584 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:32:12.357914 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 8387
I20260808 02:32:12.383028 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 7854
I20260808 02:32:12.384461 7949 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:32:12.491740 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 7854
2026-08-08T02:32:12Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2517 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:32:12 dist-test-slave-45dx krb5kdc[8615](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:32:12 dist-test-slave-45dx krb5kdc[8615](info): set up 2 sockets
Aug 08 02:32:12 dist-test-slave-45dx krb5kdc[8615](info): commencing operation
krb5kdc: starting...
W20260808 02:32:13.837373 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.292s user 0.000s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:32:14 dist-test-slave-45dx krb5kdc[8615](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156334, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:32:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:32:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:32:14.153076 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:43795
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:32907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:43795
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:32:14.524587 8638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:32:14.524899 8638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:32:14.525045 8638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:32:14.532397 8638 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:32:14.532500 8638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:32:14.532610 8638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:32:14.532725 8638 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:32:14.532809 8638 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:32:14.542989 8638 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:32907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:43795
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:43795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:32:14.544523 8638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:32:14.545933 8638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:32:14.558234 8645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:32:14.558234 8650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:32:14.558648 8654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:32:14.559324 8638 server_base.cc:1034] running on GCE node
I20260808 02:32:14.560180 8638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:32:14.561707 8638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:32:14.562963 8638 hybrid_clock.cc:648] HybridClock initialized: now 1786156334562912 us; error 44 us; skew 500 ppm
I20260808 02:32:14.563333 8638 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:32:14 dist-test-slave-45dx krb5kdc[8615](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156334, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:32:14.567209 8638 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:32:14.568811 8638 webserver.cc:460] Webserver started at http://127.24.116.254:39623/ using document root <none> and password file <none>
I20260808 02:32:14.569545 8638 fs_manager.cc:359] Metadata directory not provided
I20260808 02:32:14.569658 8638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:32:14.569939 8638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:32:14.573222 8638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "c0ea39a51e9046a092e9eefff4683cfd"
format_stamp: "Formatted at 2026-08-08 02:32:14 on dist-test-slave-45dx"
server_key: "36cc6aabcf2bc0d7feee67669ef52295"
server_key_iv: "3a00e6cbe6862c4af7170a08b4195994"
server_key_version: "encryptionkey@0"
I20260808 02:32:14.574018 8638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "c0ea39a51e9046a092e9eefff4683cfd"
format_stamp: "Formatted at 2026-08-08 02:32:14 on dist-test-slave-45dx"
server_key: "36cc6aabcf2bc0d7feee67669ef52295"
server_key_iv: "3a00e6cbe6862c4af7170a08b4195994"
server_key_version: "encryptionkey@0"
I20260808 02:32:14.579702 8638 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 02:32:14.583388 8667 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:14.584904 8638 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:32:14.585095 8638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "c0ea39a51e9046a092e9eefff4683cfd"
format_stamp: "Formatted at 2026-08-08 02:32:14 on dist-test-slave-45dx"
server_key: "36cc6aabcf2bc0d7feee67669ef52295"
server_key_iv: "3a00e6cbe6862c4af7170a08b4195994"
server_key_version: "encryptionkey@0"
I20260808 02:32:14.585286 8638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:32:14.614977 8638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:32:14.619663 8638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:32:14.619998 8638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:32:14.639376 8638 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:43795
I20260808 02:32:14.639460 8741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:43795 every 8 connection(s)
I20260808 02:32:14.640849 8638 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:32:14.644873 8742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:32:14.645762 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 8638
I20260808 02:32:14.646025 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:32:14.646734 25043 external_mini_cluster.cc:1428] Setting key 1ce64081e501eafdd4c44d4cb4df08bf
I20260808 02:32:14.659498 8742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0ea39a51e9046a092e9eefff4683cfd: Bootstrap starting.
Aug 08 02:32:14 dist-test-slave-45dx krb5kdc[8615](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156334, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:32:14.663362 8742 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0ea39a51e9046a092e9eefff4683cfd: Neither blocks nor log segments found. Creating new log.
I20260808 02:32:14.664710 8742 log.cc:824] T 00000000000000000000000000000000 P c0ea39a51e9046a092e9eefff4683cfd: Log is configured to *not* fsync() on all Append() calls
I20260808 02:32:14.667889 8742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0ea39a51e9046a092e9eefff4683cfd: No bootstrap required, opened a new log
I20260808 02:32:14.671049 8745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:14.648806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32888 (local address 127.24.116.254:43795)
0808 02:32:14.649676 (+ 870us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:14.649691 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:14.649734 (+ 43us) server_negotiation.cc:407] Connection header received
0808 02:32:14.651411 (+ 1677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:14.651436 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:14.651854 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:14.652184 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:14.654247 (+ 2063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:14.655556 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:14.657517 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:14.658199 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:14.658331 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:14.663155 (+ 4824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:14.663163 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:14.663177 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:32:14.663214 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:14.666685 (+ 3471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:32:14.667427 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:32:14.667434 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:32:14.667441 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:32:14.667637 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:32:14.668069 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:32:14.668078 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:32:14.668081 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:32:14.668696 (+ 615us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:32:14.669050 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:14.669513 (+ 463us) server_negotiation.cc:299] Negotiation successful
0808 02:32:14.669968 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":645,"thread_start_us":401,"threads_started":1}
I20260808 02:32:14.676812 8742 raft_consensus.cc:348] T 00000000000000000000000000000000 P c0ea39a51e9046a092e9eefff4683cfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0ea39a51e9046a092e9eefff4683cfd" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 43795 } }
I20260808 02:32:14.677304 8742 raft_consensus.cc:374] T 00000000000000000000000000000000 P c0ea39a51e9046a092e9eefff4683cfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:32:14.677461 8742 raft_consensus.cc:729] T 00000000000000000000000000000000 P c0ea39a51e9046a092e9eefff4683cfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0ea39a51e9046a092e9eefff4683cfd, State: Initialized, Role: FOLLOWER
I20260808 02:32:14.678058 8742 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0ea39a51e9046a092e9eefff4683cfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0ea39a51e9046a092e9eefff4683cfd" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 43795 } }
I20260808 02:32:14.678269 8742 raft_consensus.cc:388] T 00000000000000000000000000000000 P c0ea39a51e9046a092e9eefff4683cfd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:32:14.678431 8742 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0ea39a51e9046a092e9eefff4683cfd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:32:14.678622 8742 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0ea39a51e9046a092e9eefff4683cfd [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:32:14.680966 8742 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0ea39a51e9046a092e9eefff4683cfd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0ea39a51e9046a092e9eefff4683cfd" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 43795 } }
I20260808 02:32:14.681535 8742 leader_election.cc:302] T 00000000000000000000000000000000 P c0ea39a51e9046a092e9eefff4683cfd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c0ea39a51e9046a092e9eefff4683cfd; no voters:
I20260808 02:32:14.682160 8742 leader_election.cc:288] T 00000000000000000000000000000000 P c0ea39a51e9046a092e9eefff4683cfd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:32:14.682312 8747 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0ea39a51e9046a092e9eefff4683cfd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:32:14.683154 8747 raft_consensus.cc:686] T 00000000000000000000000000000000 P c0ea39a51e9046a092e9eefff4683cfd [term 1 LEADER]: Becoming Leader. State: Replica: c0ea39a51e9046a092e9eefff4683cfd, State: Running, Role: LEADER
I20260808 02:32:14.683730 8747 consensus_queue.cc:237] T 00000000000000000000000000000000 P c0ea39a51e9046a092e9eefff4683cfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0ea39a51e9046a092e9eefff4683cfd" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 43795 } }
I20260808 02:32:14.684537 8742 sys_catalog.cc:564] T 00000000000000000000000000000000 P c0ea39a51e9046a092e9eefff4683cfd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:32:14.686969 8752 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0ea39a51e9046a092e9eefff4683cfd [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0ea39a51e9046a092e9eefff4683cfd. Latest consensus state: current_term: 1 leader_uuid: "c0ea39a51e9046a092e9eefff4683cfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0ea39a51e9046a092e9eefff4683cfd" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 43795 } } }
I20260808 02:32:14.686944 8751 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0ea39a51e9046a092e9eefff4683cfd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c0ea39a51e9046a092e9eefff4683cfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0ea39a51e9046a092e9eefff4683cfd" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 43795 } } }
I20260808 02:32:14.687405 8752 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0ea39a51e9046a092e9eefff4683cfd [sys.catalog]: This master's current role is: LEADER
I20260808 02:32:14.689697 8751 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0ea39a51e9046a092e9eefff4683cfd [sys.catalog]: This master's current role is: LEADER
I20260808 02:32:14.689971 8759 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:32:14.695574 8759 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:32:14.705539 8759 catalog_manager.cc:1347] Generated new cluster ID: 6ecd7433d0584bf1be70cbc407031527
I20260808 02:32:14.705679 8759 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:32:14.719933 8759 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:32:14.721886 8759 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:32:14.731704 8759 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c0ea39a51e9046a092e9eefff4683cfd: Generated new TSK 0
I20260808 02:32:14.732774 8759 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.116.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
I20260808 02:32:14.820154 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:43795
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:32907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:32:15.177882 8784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:32:15.178172 8784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:32:15.178337 8784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:32:15.185940 8784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:32:15.186051 8784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:32:15.186252 8784 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:32:15.196611 8784 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:32907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:43795
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:32:15.198016 8784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:32:15.199399 8784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:32:15.213344 8789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:32:15.213413 8790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:32:15.213291 8794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:32:15.214540 8784 server_base.cc:1034] running on GCE node
I20260808 02:32:15.215343 8784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:32:15.216476 8784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:32:15.217748 8784 hybrid_clock.cc:648] HybridClock initialized: now 1786156335217649 us; error 80 us; skew 500 ppm
I20260808 02:32:15.218128 8784 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:32:15 dist-test-slave-45dx krb5kdc[8615](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156335, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:32:15.221618 8784 init.cc:377] Logged in from keytab as kudu/127.24.116.193@KRBTEST.COM (short username kudu)
I20260808 02:32:15.223323 8784 webserver.cc:460] Webserver started at http://127.24.116.193:40901/ using document root <none> and password file <none>
I20260808 02:32:15.224080 8784 fs_manager.cc:359] Metadata directory not provided
I20260808 02:32:15.224236 8784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:32:15.224622 8784 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:32:15.227636 8784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "0b0d823f93e848c386cb8b4f5233f16b"
format_stamp: "Formatted at 2026-08-08 02:32:15 on dist-test-slave-45dx"
server_key: "380cdf6e765b76a875979dae390fd381"
server_key_iv: "b0946b5b2d5753cb41acc737a9029f06"
server_key_version: "encryptionkey@0"
I20260808 02:32:15.228574 8784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "0b0d823f93e848c386cb8b4f5233f16b"
format_stamp: "Formatted at 2026-08-08 02:32:15 on dist-test-slave-45dx"
server_key: "380cdf6e765b76a875979dae390fd381"
server_key_iv: "b0946b5b2d5753cb41acc737a9029f06"
server_key_version: "encryptionkey@0"
I20260808 02:32:15.233848 8784 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260808 02:32:15.237272 8803 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:15.238583 8784 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 02:32:15.238761 8784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "0b0d823f93e848c386cb8b4f5233f16b"
format_stamp: "Formatted at 2026-08-08 02:32:15 on dist-test-slave-45dx"
server_key: "380cdf6e765b76a875979dae390fd381"
server_key_iv: "b0946b5b2d5753cb41acc737a9029f06"
server_key_version: "encryptionkey@0"
I20260808 02:32:15.238960 8784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:32:15.253180 8784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:32:15.257325 8784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:32:15.257645 8784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:32:15.258809 8784 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:32:15.260457 8784 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:32:15.260535 8784 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:15.260620 8784 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:32:15.260667 8784 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:15.294416 8784 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:46549
I20260808 02:32:15.294449 8976 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:46549 every 8 connection(s)
I20260808 02:32:15.295742 8784 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:32:15.296427 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 8784
I20260808 02:32:15.296690 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:32:15.297602 25043 external_mini_cluster.cc:1428] Setting key 1226f5445c715c825fbdb7841325f9ab
Aug 08 02:32:15 dist-test-slave-45dx krb5kdc[8615](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156335, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:32:15.316653 8980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:15.298750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:36237 (local address 127.24.116.254:43795)
0808 02:32:15.299313 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:15.299319 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:15.300496 (+ 1177us) server_negotiation.cc:407] Connection header received
0808 02:32:15.302305 (+ 1809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:15.302310 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:15.302394 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:15.302524 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:15.303979 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:15.304774 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:15.306305 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:15.306697 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:15.306842 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:15.310303 (+ 3461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:15.310308 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:15.310312 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:32:15.310343 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:15.313202 (+ 2859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:32:15.314160 (+ 958us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:32:15.314164 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:32:15.314167 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:32:15.314313 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:32:15.314835 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:32:15.314840 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:32:15.314842 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:32:15.315121 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:32:15.315243 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:15.316136 (+ 893us) server_negotiation.cc:299] Negotiation successful
0808 02:32:15.316375 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":255,"threads_started":1}
I20260808 02:32:15.318277 8982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:15.299442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:43795 (local address 127.24.116.193:36237)
0808 02:32:15.300341 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:15.300400 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:15.302045 (+ 1645us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:15.302762 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:15.302771 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:15.303270 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:15.303809 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:15.303827 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:15.304935 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:15.304943 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:15.306141 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:15.306152 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:15.306942 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:15.306951 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:15.307177 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:15.307877 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:32:15.307899 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:15.310077 (+ 2178us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:32:15.313373 (+ 3296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:32:15.313385 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:32:15.313404 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:32:15.314031 (+ 627us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:32:15.314430 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:32:15.314438 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:32:15.314444 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:32:15.314695 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:32:15.315255 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:32:15.315273 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:32:15.315729 (+ 456us) client_negotiation.cc:769] Sending connection context
0808 02:32:15.316049 (+ 320us) client_negotiation.cc:240] Negotiation successful
0808 02:32:15.316700 (+ 651us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":370,"threads_started":1}
I20260808 02:32:15.319957 8977 heartbeater.cc:347] Connected to a master server at 127.24.116.254:43795
I20260808 02:32:15.320282 8977 heartbeater.cc:464] Registering TS with master...
I20260808 02:32:15.321169 8977 heartbeater.cc:511] Master 127.24.116.254:43795 requested a full tablet report, sending...
I20260808 02:32:15.323338 8695 ts_manager.cc:194] Registered new tserver with Master: 0b0d823f93e848c386cb8b4f5233f16b (127.24.116.193:46549)
I20260808 02:32:15.324883 8695 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.193@KRBTEST.COM'} at 127.24.116.193:36237
WARNING: no policy specified for kudu/127.24.116.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
I20260808 02:32:15.367901 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:43795
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:32907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:32:15.726408 8987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:32:15.726673 8987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:32:15.726847 8987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:32:15.734100 8987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:32:15.734205 8987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:32:15.734416 8987 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:32:15.744423 8987 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:32907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:43795
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:32:15.745781 8987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:32:15.747114 8987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:32:15.761335 8999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:32:15.761394 9000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:32:15.761425 9002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:32:15.762315 8987 server_base.cc:1034] running on GCE node
I20260808 02:32:15.762943 8987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:32:15.763904 8987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:32:15.765125 8987 hybrid_clock.cc:648] HybridClock initialized: now 1786156335765084 us; error 32 us; skew 500 ppm
I20260808 02:32:15.765596 8987 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:32:15 dist-test-slave-45dx krb5kdc[8615](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156335, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:32:15.769347 8987 init.cc:377] Logged in from keytab as kudu/127.24.116.194@KRBTEST.COM (short username kudu)
I20260808 02:32:15.770951 8987 webserver.cc:460] Webserver started at http://127.24.116.194:39299/ using document root <none> and password file <none>
I20260808 02:32:15.771731 8987 fs_manager.cc:359] Metadata directory not provided
I20260808 02:32:15.771900 8987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:32:15.772267 8987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:32:15.775615 8987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "ac7f431098c8485da051c894a1446915"
format_stamp: "Formatted at 2026-08-08 02:32:15 on dist-test-slave-45dx"
server_key: "7493d5819190142c7e63a7f8bb941d94"
server_key_iv: "fc4abde755ddec968346a40225ba66e9"
server_key_version: "encryptionkey@0"
I20260808 02:32:15.776608 8987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "ac7f431098c8485da051c894a1446915"
format_stamp: "Formatted at 2026-08-08 02:32:15 on dist-test-slave-45dx"
server_key: "7493d5819190142c7e63a7f8bb941d94"
server_key_iv: "fc4abde755ddec968346a40225ba66e9"
server_key_version: "encryptionkey@0"
I20260808 02:32:15.782385 8987 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 02:32:15.786324 9010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:15.787760 8987 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 02:32:15.787983 8987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "ac7f431098c8485da051c894a1446915"
format_stamp: "Formatted at 2026-08-08 02:32:15 on dist-test-slave-45dx"
server_key: "7493d5819190142c7e63a7f8bb941d94"
server_key_iv: "fc4abde755ddec968346a40225ba66e9"
server_key_version: "encryptionkey@0"
I20260808 02:32:15.788249 8987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:32:15.814858 8987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:32:15.820217 8987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:32:15.820595 8987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:32:15.821756 8987 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:32:15.823374 8987 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:32:15.823484 8987 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:15.823643 8987 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:32:15.823722 8987 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:15.860579 8987 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:40529
I20260808 02:32:15.860626 9186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:40529 every 8 connection(s)
I20260808 02:32:15.861955 8987 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:32:15.868413 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 8987
I20260808 02:32:15.868649 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:32:15.869097 25043 external_mini_cluster.cc:1428] Setting key 5eb9ffabbbba3e0654498dd291be37be
Aug 08 02:32:15 dist-test-slave-45dx krb5kdc[8615](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156335, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:32:15.887054 9191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:15.864630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:51339 (local address 127.24.116.254:43795)
0808 02:32:15.865098 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:15.865103 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:15.866100 (+ 997us) server_negotiation.cc:407] Connection header received
0808 02:32:15.868025 (+ 1925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:15.868033 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:15.868128 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:15.868264 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:15.870075 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:15.870912 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:15.872716 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:15.873495 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:15.873648 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:15.878179 (+ 4531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:15.878188 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:15.878195 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:32:15.878243 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:15.882847 (+ 4604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:32:15.884001 (+ 1154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:32:15.884007 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:32:15.884011 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:32:15.884214 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:32:15.884890 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:32:15.884897 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:32:15.884902 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:32:15.885296 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:32:15.885483 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:15.886264 (+ 781us) server_negotiation.cc:299] Negotiation successful
0808 02:32:15.886530 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":235,"threads_started":1}
I20260808 02:32:15.887687 9195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:15.865156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:43795 (local address 127.24.116.194:51339)
0808 02:32:15.865928 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:15.865977 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:15.867747 (+ 1770us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:15.868605 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:15.868617 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:15.869297 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:15.869910 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:15.869929 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:15.871070 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:15.871076 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:15.872565 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:15.872578 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:15.873721 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:15.873726 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:15.873966 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:15.874778 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:32:15.874811 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:15.877813 (+ 3002us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:32:15.883078 (+ 5265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:32:15.883089 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:32:15.883109 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:32:15.883853 (+ 744us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:32:15.884432 (+ 579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:32:15.884440 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:32:15.884447 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:32:15.884748 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:32:15.885475 (+ 727us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:32:15.885482 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:32:15.885872 (+ 390us) client_negotiation.cc:769] Sending connection context
0808 02:32:15.886104 (+ 232us) client_negotiation.cc:240] Negotiation successful
0808 02:32:15.886523 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":321,"threads_started":1}
I20260808 02:32:15.889240 9188 heartbeater.cc:347] Connected to a master server at 127.24.116.254:43795
I20260808 02:32:15.889643 9188 heartbeater.cc:464] Registering TS with master...
I20260808 02:32:15.890513 9188 heartbeater.cc:511] Master 127.24.116.254:43795 requested a full tablet report, sending...
I20260808 02:32:15.892259 8695 ts_manager.cc:194] Registered new tserver with Master: ac7f431098c8485da051c894a1446915 (127.24.116.194:40529)
I20260808 02:32:15.893285 8695 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.194@KRBTEST.COM'} at 127.24.116.194:51339
WARNING: no policy specified for kudu/127.24.116.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
I20260808 02:32:15.942797 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:43795
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:32907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:32:16.294031 9200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:32:16.294389 9200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:32:16.294538 9200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:32:16.304072 9200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:32:16.304181 9200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:32:16.304294 9200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:32:16.314128 9200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:32907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:43795
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:32:16.315383 9200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:32:16.316776 9200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 02:32:16.327713 8977 heartbeater.cc:503] Master 127.24.116.254:43795 was elected leader, sending a full tablet report...
W20260808 02:32:16.330678 9209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:32:16.330925 9205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:32:16.330683 9206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:32:16.331662 9200 server_base.cc:1034] running on GCE node
I20260808 02:32:16.332271 9200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:32:16.333277 9200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:32:16.334481 9200 hybrid_clock.cc:648] HybridClock initialized: now 1786156336334416 us; error 61 us; skew 500 ppm
I20260808 02:32:16.334806 9200 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:32:16 dist-test-slave-45dx krb5kdc[8615](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156336, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:32:16.343536 9200 init.cc:377] Logged in from keytab as kudu/127.24.116.195@KRBTEST.COM (short username kudu)
I20260808 02:32:16.345192 9200 webserver.cc:460] Webserver started at http://127.24.116.195:42863/ using document root <none> and password file <none>
I20260808 02:32:16.345902 9200 fs_manager.cc:359] Metadata directory not provided
I20260808 02:32:16.346047 9200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:32:16.346381 9200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:32:16.349471 9200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "122642e57a134c53b4ce5183fa124f67"
format_stamp: "Formatted at 2026-08-08 02:32:16 on dist-test-slave-45dx"
server_key: "64a3a89ea19a888cd4520a97667f007a"
server_key_iv: "dea5025ce090c79a54b6912afb47f6bc"
server_key_version: "encryptionkey@0"
I20260808 02:32:16.350278 9200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "122642e57a134c53b4ce5183fa124f67"
format_stamp: "Formatted at 2026-08-08 02:32:16 on dist-test-slave-45dx"
server_key: "64a3a89ea19a888cd4520a97667f007a"
server_key_iv: "dea5025ce090c79a54b6912afb47f6bc"
server_key_version: "encryptionkey@0"
I20260808 02:32:16.355603 9200 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 02:32:16.359294 9217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:16.360809 9200 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:32:16.360952 9200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "122642e57a134c53b4ce5183fa124f67"
format_stamp: "Formatted at 2026-08-08 02:32:16 on dist-test-slave-45dx"
server_key: "64a3a89ea19a888cd4520a97667f007a"
server_key_iv: "dea5025ce090c79a54b6912afb47f6bc"
server_key_version: "encryptionkey@0"
I20260808 02:32:16.361133 9200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:32:16.382215 9200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:32:16.386647 9200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:32:16.386911 9200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:32:16.387867 9200 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:32:16.389482 9200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:32:16.389561 9200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:16.389647 9200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:32:16.389720 9200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:32:16.425897 9200 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:32869
I20260808 02:32:16.426008 9404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:32869 every 8 connection(s)
I20260808 02:32:16.427240 9200 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:32:16.435637 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 9200
I20260808 02:32:16.435871 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:32:16.436435 25043 external_mini_cluster.cc:1428] Setting key 4e8982b48bb0a2a6fe7820bd4c552a50
Aug 08 02:32:16 dist-test-slave-45dx krb5kdc[8615](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156336, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:32:16.448944 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:16.430097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:38869 (local address 127.24.116.254:43795)
0808 02:32:16.430569 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:16.430575 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:16.431620 (+ 1045us) server_negotiation.cc:407] Connection header received
0808 02:32:16.433502 (+ 1882us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:16.433507 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:16.433589 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:16.433690 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:16.435167 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.436087 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.438316 (+ 2229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.438746 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.438908 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:16.442663 (+ 3755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:16.442668 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:16.442671 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:32:16.442704 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:16.445598 (+ 2894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:32:16.446370 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:32:16.446376 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:32:16.446378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:32:16.446500 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:32:16.447062 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:32:16.447078 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:32:16.447080 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:32:16.447380 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:32:16.447579 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:16.448285 (+ 706us) server_negotiation.cc:299] Negotiation successful
0808 02:32:16.448557 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":221,"threads_started":1}
I20260808 02:32:16.449892 9409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:16.430693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:43795 (local address 127.24.116.195:38869)
0808 02:32:16.431452 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:16.431499 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:16.433241 (+ 1742us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:16.433895 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:16.433903 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:16.434429 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:32:16.434982 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:16.435000 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.436262 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.436269 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:16.438150 (+ 1881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:16.438166 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.439002 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.439010 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:16.439254 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:16.440050 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:32:16.440078 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:32:16.442435 (+ 2357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:32:16.445748 (+ 3313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:32:16.445758 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:32:16.445779 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:32:16.446225 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:32:16.446619 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:32:16.446624 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:32:16.446628 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:32:16.446932 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:32:16.447535 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:32:16.447543 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:32:16.447892 (+ 349us) client_negotiation.cc:769] Sending connection context
0808 02:32:16.448165 (+ 273us) client_negotiation.cc:240] Negotiation successful
0808 02:32:16.448731 (+ 566us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":283,"threads_started":1}
I20260808 02:32:16.451613 9405 heartbeater.cc:347] Connected to a master server at 127.24.116.254:43795
I20260808 02:32:16.451953 9405 heartbeater.cc:464] Registering TS with master...
I20260808 02:32:16.452987 9405 heartbeater.cc:511] Master 127.24.116.254:43795 requested a full tablet report, sending...
I20260808 02:32:16.454631 8694 ts_manager.cc:194] Registered new tserver with Master: 122642e57a134c53b4ce5183fa124f67 (127.24.116.195:32869)
I20260808 02:32:16.455540 8694 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.195@KRBTEST.COM'} at 127.24.116.195:38869
I20260808 02:32:16.464699 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:32:16.482645 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:16.469512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32892 (local address 127.24.116.254:43795)
0808 02:32:16.469728 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:16.469734 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:16.470131 (+ 397us) server_negotiation.cc:407] Connection header received
0808 02:32:16.470335 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:16.470343 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:16.470410 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:16.470517 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:16.472117 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.472940 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.474247 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.474664 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.474792 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:16.477222 (+ 2430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:16.477228 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:16.477232 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:32:16.477264 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:16.479793 (+ 2529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:32:16.480551 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:32:16.480558 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:32:16.480561 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:32:16.480693 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:32:16.481096 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:32:16.481102 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:32:16.481105 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:32:16.481456 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:32:16.481776 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:16.482102 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 02:32:16.482333 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 02:32:16.487013 8694 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32892:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:32:16.494670 8694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:32:16.519553 9429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:16.507693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:46549 (local address 127.0.0.1:42134)
0808 02:32:16.508988 (+ 1295us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:16.509025 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:16.509197 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:16.510891 (+ 1694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:16.510898 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:16.510931 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:32:16.511437 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:16.511454 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.513560 (+ 2106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.513566 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:16.516364 (+ 2798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:16.516391 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.518317 (+ 1926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.518331 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:16.518544 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:16.518612 (+ 68us) client_negotiation.cc:769] Sending connection context
0808 02:32:16.518781 (+ 169us) client_negotiation.cc:240] Negotiation successful
0808 02:32:16.519007 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1055,"mutex_wait_us":5,"thread_start_us":2673,"threads_started":1}
I20260808 02:32:16.520464 9431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:16.507843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42134 (local address 127.24.116.193:46549)
0808 02:32:16.510215 (+ 2372us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:16.510221 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:16.510244 (+ 23us) server_negotiation.cc:407] Connection header received
0808 02:32:16.510328 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:16.510340 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:16.510630 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:16.511657 (+ 1027us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:32:16.511863 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.513356 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.516563 (+ 3207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.518074 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.518296 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:16.518489 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:16.519842 (+ 1353us) server_negotiation.cc:299] Negotiation successful
0808 02:32:16.520052 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2220,"thread_start_us":2091,"threads_started":1}
I20260808 02:32:16.520654 9427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:16.507931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:40529 (local address 127.0.0.1:42656)
0808 02:32:16.510705 (+ 2774us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:16.510727 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:16.510987 (+ 260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:16.512124 (+ 1137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:16.512133 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:16.512174 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:32:16.512841 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:16.512866 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.515143 (+ 2277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.515149 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:16.517368 (+ 2219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:16.517380 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.519375 (+ 1995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.519382 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:16.519617 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:16.519655 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 02:32:16.520048 (+ 393us) client_negotiation.cc:240] Negotiation successful
0808 02:32:16.520192 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2623,"mutex_wait_us":86,"thread_start_us":808,"threads_started":1}
I20260808 02:32:16.520713 9432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:16.508513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42656 (local address 127.24.116.194:40529)
0808 02:32:16.509805 (+ 1292us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:16.509812 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:16.510845 (+ 1033us) server_negotiation.cc:407] Connection header received
0808 02:32:16.511237 (+ 392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:16.511249 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:16.511554 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:16.511773 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:32:16.513097 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.514936 (+ 1839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.517551 (+ 2615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.518848 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.519023 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:16.519196 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:16.520138 (+ 942us) server_negotiation.cc:299] Negotiation successful
0808 02:32:16.520360 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1140,"thread_start_us":1030,"threads_started":1}
I20260808 02:32:16.522297 9438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:16.511882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:32869 (local address 127.0.0.1:34194)
0808 02:32:16.512864 (+ 982us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:16.512882 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:16.512988 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:16.514008 (+ 1020us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:16.514013 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:16.514037 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:32:16.514519 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:16.514538 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.516154 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.516160 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:16.518829 (+ 2669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:16.518854 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.521699 (+ 2845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.521708 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:16.521848 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:16.521870 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 02:32:16.521948 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 02:32:16.522029 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":814,"mutex_wait_us":1,"thread_start_us":638,"threads_started":1}
I20260808 02:32:16.522584 9434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:16.511116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34194 (local address 127.24.116.195:32869)
0808 02:32:16.513546 (+ 2430us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:16.513553 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:16.513589 (+ 36us) server_negotiation.cc:407] Connection header received
0808 02:32:16.513661 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:16.513666 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:16.513821 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:16.514019 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:32:16.514883 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.516008 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.519047 (+ 3039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.520407 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.520596 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:16.520763 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:16.522045 (+ 1282us) server_negotiation.cc:299] Negotiation successful
0808 02:32:16.522220 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2244,"thread_start_us":2087,"threads_started":1}
I20260808 02:32:16.524930 9088 tablet_service.cc:1467] Processing CreateTablet for tablet 79e577cc32f245f6aef334797d47eb54 (DEFAULT_TABLE table=test-table [id=84cd771ba1a7498cbb4b934b084254eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:32:16.525027 8878 tablet_service.cc:1467] Processing CreateTablet for tablet 79e577cc32f245f6aef334797d47eb54 (DEFAULT_TABLE table=test-table [id=84cd771ba1a7498cbb4b934b084254eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:32:16.526216 9088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79e577cc32f245f6aef334797d47eb54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:32:16.526221 8878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79e577cc32f245f6aef334797d47eb54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:32:16.530102 9304 tablet_service.cc:1467] Processing CreateTablet for tablet 79e577cc32f245f6aef334797d47eb54 (DEFAULT_TABLE table=test-table [id=84cd771ba1a7498cbb4b934b084254eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:32:16.531699 9304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79e577cc32f245f6aef334797d47eb54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:32:16.538426 9440 tablet_bootstrap.cc:492] T 79e577cc32f245f6aef334797d47eb54 P 0b0d823f93e848c386cb8b4f5233f16b: Bootstrap starting.
I20260808 02:32:16.541783 9440 tablet_bootstrap.cc:654] T 79e577cc32f245f6aef334797d47eb54 P 0b0d823f93e848c386cb8b4f5233f16b: Neither blocks nor log segments found. Creating new log.
I20260808 02:32:16.542127 9441 tablet_bootstrap.cc:492] T 79e577cc32f245f6aef334797d47eb54 P ac7f431098c8485da051c894a1446915: Bootstrap starting.
I20260808 02:32:16.543320 9440 log.cc:824] T 79e577cc32f245f6aef334797d47eb54 P 0b0d823f93e848c386cb8b4f5233f16b: Log is configured to *not* fsync() on all Append() calls
I20260808 02:32:16.546243 9441 tablet_bootstrap.cc:654] T 79e577cc32f245f6aef334797d47eb54 P ac7f431098c8485da051c894a1446915: Neither blocks nor log segments found. Creating new log.
I20260808 02:32:16.547547 9440 tablet_bootstrap.cc:492] T 79e577cc32f245f6aef334797d47eb54 P 0b0d823f93e848c386cb8b4f5233f16b: No bootstrap required, opened a new log
I20260808 02:32:16.547580 9441 log.cc:824] T 79e577cc32f245f6aef334797d47eb54 P ac7f431098c8485da051c894a1446915: Log is configured to *not* fsync() on all Append() calls
I20260808 02:32:16.547961 9440 ts_tablet_manager.cc:1397] T 79e577cc32f245f6aef334797d47eb54 P 0b0d823f93e848c386cb8b4f5233f16b: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260808 02:32:16.548074 9443 tablet_bootstrap.cc:492] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67: Bootstrap starting.
I20260808 02:32:16.551185 9441 tablet_bootstrap.cc:492] T 79e577cc32f245f6aef334797d47eb54 P ac7f431098c8485da051c894a1446915: No bootstrap required, opened a new log
I20260808 02:32:16.551473 9443 tablet_bootstrap.cc:654] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67: Neither blocks nor log segments found. Creating new log.
I20260808 02:32:16.551477 9441 ts_tablet_manager.cc:1397] T 79e577cc32f245f6aef334797d47eb54 P ac7f431098c8485da051c894a1446915: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260808 02:32:16.552649 9443 log.cc:824] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67: Log is configured to *not* fsync() on all Append() calls
I20260808 02:32:16.555328 9443 tablet_bootstrap.cc:492] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67: No bootstrap required, opened a new log
I20260808 02:32:16.555619 9443 ts_tablet_manager.cc:1397] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260808 02:32:16.560218 9440 raft_consensus.cc:348] T 79e577cc32f245f6aef334797d47eb54 P 0b0d823f93e848c386cb8b4f5233f16b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b0d823f93e848c386cb8b4f5233f16b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 46549 } } peers { permanent_uuid: "122642e57a134c53b4ce5183fa124f67" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 32869 } } peers { permanent_uuid: "ac7f431098c8485da051c894a1446915" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 40529 } }
I20260808 02:32:16.560761 9440 raft_consensus.cc:374] T 79e577cc32f245f6aef334797d47eb54 P 0b0d823f93e848c386cb8b4f5233f16b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:32:16.560957 9440 raft_consensus.cc:729] T 79e577cc32f245f6aef334797d47eb54 P 0b0d823f93e848c386cb8b4f5233f16b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b0d823f93e848c386cb8b4f5233f16b, State: Initialized, Role: FOLLOWER
I20260808 02:32:16.561648 9440 consensus_queue.cc:260] T 79e577cc32f245f6aef334797d47eb54 P 0b0d823f93e848c386cb8b4f5233f16b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b0d823f93e848c386cb8b4f5233f16b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 46549 } } peers { permanent_uuid: "122642e57a134c53b4ce5183fa124f67" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 32869 } } peers { permanent_uuid: "ac7f431098c8485da051c894a1446915" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 40529 } }
I20260808 02:32:16.562191 9441 raft_consensus.cc:348] T 79e577cc32f245f6aef334797d47eb54 P ac7f431098c8485da051c894a1446915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b0d823f93e848c386cb8b4f5233f16b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 46549 } } peers { permanent_uuid: "122642e57a134c53b4ce5183fa124f67" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 32869 } } peers { permanent_uuid: "ac7f431098c8485da051c894a1446915" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 40529 } }
I20260808 02:32:16.563732 9440 ts_tablet_manager.cc:1428] T 79e577cc32f245f6aef334797d47eb54 P 0b0d823f93e848c386cb8b4f5233f16b: Time spent starting tablet: real 0.016s user 0.013s sys 0.000s
I20260808 02:32:16.562748 9441 raft_consensus.cc:374] T 79e577cc32f245f6aef334797d47eb54 P ac7f431098c8485da051c894a1446915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:32:16.564031 9441 raft_consensus.cc:729] T 79e577cc32f245f6aef334797d47eb54 P ac7f431098c8485da051c894a1446915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac7f431098c8485da051c894a1446915, State: Initialized, Role: FOLLOWER
I20260808 02:32:16.564810 9441 consensus_queue.cc:260] T 79e577cc32f245f6aef334797d47eb54 P ac7f431098c8485da051c894a1446915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b0d823f93e848c386cb8b4f5233f16b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 46549 } } peers { permanent_uuid: "122642e57a134c53b4ce5183fa124f67" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 32869 } } peers { permanent_uuid: "ac7f431098c8485da051c894a1446915" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 40529 } }
I20260808 02:32:16.565291 9443 raft_consensus.cc:348] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b0d823f93e848c386cb8b4f5233f16b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 46549 } } peers { permanent_uuid: "122642e57a134c53b4ce5183fa124f67" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 32869 } } peers { permanent_uuid: "ac7f431098c8485da051c894a1446915" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 40529 } }
I20260808 02:32:16.565868 9443 raft_consensus.cc:374] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:32:16.566031 9443 raft_consensus.cc:729] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 122642e57a134c53b4ce5183fa124f67, State: Initialized, Role: FOLLOWER
I20260808 02:32:16.566690 9443 consensus_queue.cc:260] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b0d823f93e848c386cb8b4f5233f16b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 46549 } } peers { permanent_uuid: "122642e57a134c53b4ce5183fa124f67" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 32869 } } peers { permanent_uuid: "ac7f431098c8485da051c894a1446915" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 40529 } }
I20260808 02:32:16.566980 9441 ts_tablet_manager.cc:1428] T 79e577cc32f245f6aef334797d47eb54 P ac7f431098c8485da051c894a1446915: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260808 02:32:16.567415 9188 heartbeater.cc:503] Master 127.24.116.254:43795 was elected leader, sending a full tablet report...
I20260808 02:32:16.568320 9405 heartbeater.cc:503] Master 127.24.116.254:43795 was elected leader, sending a full tablet report...
I20260808 02:32:16.569018 9443 ts_tablet_manager.cc:1428] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67: Time spent starting tablet: real 0.013s user 0.007s sys 0.007s
W20260808 02:32:16.614106 9190 tablet.cc:2369] T 79e577cc32f245f6aef334797d47eb54 P ac7f431098c8485da051c894a1446915: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:32:16.679059 9407 tablet.cc:2369] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:32:16.783234 9449 raft_consensus.cc:482] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:32:16.783545 9449 raft_consensus.cc:504] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b0d823f93e848c386cb8b4f5233f16b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 46549 } } peers { permanent_uuid: "122642e57a134c53b4ce5183fa124f67" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 32869 } } peers { permanent_uuid: "ac7f431098c8485da051c894a1446915" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 40529 } }
I20260808 02:32:16.785645 9449 leader_election.cc:288] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b0d823f93e848c386cb8b4f5233f16b (127.24.116.193:46549), ac7f431098c8485da051c894a1446915 (127.24.116.194:40529)
I20260808 02:32:16.793116 9409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:16.786071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:40529 (local address 127.24.116.195:55523)
0808 02:32:16.786373 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:16.786394 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:16.786540 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:16.787089 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:16.787097 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:16.787124 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:32:16.787283 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:16.787291 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.788857 (+ 1566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.788865 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:16.790989 (+ 2124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:16.791004 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.792325 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.792338 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:16.792547 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:16.792584 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 02:32:16.792679 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 02:32:16.792783 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145}
I20260808 02:32:16.793147 9432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:16.786432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:55523 (local address 127.24.116.194:40529)
0808 02:32:16.786693 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:16.786701 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:16.786726 (+ 25us) server_negotiation.cc:407] Connection header received
0808 02:32:16.786814 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:16.786822 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:16.786920 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:16.787055 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:32:16.787474 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.788688 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.791179 (+ 2491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.792144 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.792284 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:16.792424 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:16.792711 (+ 287us) server_negotiation.cc:299] Negotiation successful
0808 02:32:16.792854 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260808 02:32:16.793414 9431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:16.786182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:53967 (local address 127.24.116.193:46549)
0808 02:32:16.786404 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:16.786412 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:16.787010 (+ 598us) server_negotiation.cc:407] Connection header received
0808 02:32:16.787181 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:16.787186 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:16.787276 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:16.787356 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:32:16.787855 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.789010 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.791385 (+ 2375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.792345 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.792507 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:16.792577 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:16.793012 (+ 435us) server_negotiation.cc:299] Negotiation successful
0808 02:32:16.793154 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 02:32:16.793522 9450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:16.786143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:46549 (local address 127.24.116.195:53967)
0808 02:32:16.786893 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0808 02:32:16.786907 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 02:32:16.787034 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:32:16.787411 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:32:16.787416 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:32:16.787449 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:32:16.787700 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:16.787708 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.789146 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.789151 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:16.791229 (+ 2078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:32:16.791238 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.792592 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.792602 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:32:16.792816 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:16.792851 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 02:32:16.792964 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 02:32:16.793115 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"thread_start_us":438,"threads_started":1}
I20260808 02:32:16.794497 9125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79e577cc32f245f6aef334797d47eb54" candidate_uuid: "122642e57a134c53b4ce5183fa124f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac7f431098c8485da051c894a1446915" is_pre_election: true
I20260808 02:32:16.794687 8910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79e577cc32f245f6aef334797d47eb54" candidate_uuid: "122642e57a134c53b4ce5183fa124f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b0d823f93e848c386cb8b4f5233f16b" is_pre_election: true
I20260808 02:32:16.795110 9125 raft_consensus.cc:2454] T 79e577cc32f245f6aef334797d47eb54 P ac7f431098c8485da051c894a1446915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 122642e57a134c53b4ce5183fa124f67 in term 0.
I20260808 02:32:16.795217 8910 raft_consensus.cc:2454] T 79e577cc32f245f6aef334797d47eb54 P 0b0d823f93e848c386cb8b4f5233f16b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 122642e57a134c53b4ce5183fa124f67 in term 0.
I20260808 02:32:16.795914 9220 leader_election.cc:302] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0d823f93e848c386cb8b4f5233f16b, 122642e57a134c53b4ce5183fa124f67; no voters:
I20260808 02:32:16.796353 9449 raft_consensus.cc:2781] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:32:16.796518 9449 raft_consensus.cc:482] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:32:16.796625 9449 raft_consensus.cc:3037] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67 [term 0 FOLLOWER]: Advancing to term 1
W20260808 02:32:16.798717 8979 tablet.cc:2369] T 79e577cc32f245f6aef334797d47eb54 P 0b0d823f93e848c386cb8b4f5233f16b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:32:16.799114 9449 raft_consensus.cc:504] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b0d823f93e848c386cb8b4f5233f16b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 46549 } } peers { permanent_uuid: "122642e57a134c53b4ce5183fa124f67" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 32869 } } peers { permanent_uuid: "ac7f431098c8485da051c894a1446915" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 40529 } }
I20260808 02:32:16.799914 9449 leader_election.cc:288] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67 [CANDIDATE]: Term 1 election: Requested vote from peers 0b0d823f93e848c386cb8b4f5233f16b (127.24.116.193:46549), ac7f431098c8485da051c894a1446915 (127.24.116.194:40529)
I20260808 02:32:16.800392 8910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79e577cc32f245f6aef334797d47eb54" candidate_uuid: "122642e57a134c53b4ce5183fa124f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b0d823f93e848c386cb8b4f5233f16b"
I20260808 02:32:16.800510 9125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79e577cc32f245f6aef334797d47eb54" candidate_uuid: "122642e57a134c53b4ce5183fa124f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac7f431098c8485da051c894a1446915"
I20260808 02:32:16.800609 8910 raft_consensus.cc:3037] T 79e577cc32f245f6aef334797d47eb54 P 0b0d823f93e848c386cb8b4f5233f16b [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:32:16.800786 9125 raft_consensus.cc:3037] T 79e577cc32f245f6aef334797d47eb54 P ac7f431098c8485da051c894a1446915 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:32:16.803224 8910 raft_consensus.cc:2454] T 79e577cc32f245f6aef334797d47eb54 P 0b0d823f93e848c386cb8b4f5233f16b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 122642e57a134c53b4ce5183fa124f67 in term 1.
I20260808 02:32:16.803434 9125 raft_consensus.cc:2454] T 79e577cc32f245f6aef334797d47eb54 P ac7f431098c8485da051c894a1446915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 122642e57a134c53b4ce5183fa124f67 in term 1.
I20260808 02:32:16.803637 9220 leader_election.cc:302] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0d823f93e848c386cb8b4f5233f16b, 122642e57a134c53b4ce5183fa124f67; no voters:
I20260808 02:32:16.803959 9449 raft_consensus.cc:2781] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:32:16.804430 9449 raft_consensus.cc:686] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67 [term 1 LEADER]: Becoming Leader. State: Replica: 122642e57a134c53b4ce5183fa124f67, State: Running, Role: LEADER
I20260808 02:32:16.804893 9449 consensus_queue.cc:237] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b0d823f93e848c386cb8b4f5233f16b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 46549 } } peers { permanent_uuid: "122642e57a134c53b4ce5183fa124f67" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 32869 } } peers { permanent_uuid: "ac7f431098c8485da051c894a1446915" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 40529 } }
I20260808 02:32:16.809999 8693 catalog_manager.cc:5495] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 122642e57a134c53b4ce5183fa124f67 (127.24.116.195). New cstate: current_term: 1 leader_uuid: "122642e57a134c53b4ce5183fa124f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b0d823f93e848c386cb8b4f5233f16b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 46549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "122642e57a134c53b4ce5183fa124f67" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 32869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac7f431098c8485da051c894a1446915" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 40529 } health_report { overall_health: UNKNOWN } } }
I20260808 02:32:16.889617 9434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:16.879831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34210 (local address 127.24.116.195:32869)
0808 02:32:16.880062 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:16.880069 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:16.880191 (+ 122us) server_negotiation.cc:407] Connection header received
0808 02:32:16.880482 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:16.880486 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:16.880567 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:16.880729 (+ 162us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:32:16.881169 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.882385 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.884098 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.884783 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.884912 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:16.888285 (+ 3373us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:32:16.888981 (+ 696us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:32:16.889180 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:16.889232 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 02:32:16.889320 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 02:32:16.899034 9125 raft_consensus.cc:1261] T 79e577cc32f245f6aef334797d47eb54 P ac7f431098c8485da051c894a1446915 [term 1 FOLLOWER]: Refusing update from remote peer 122642e57a134c53b4ce5183fa124f67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:32:16.899101 8910 raft_consensus.cc:1261] T 79e577cc32f245f6aef334797d47eb54 P 0b0d823f93e848c386cb8b4f5233f16b [term 1 FOLLOWER]: Refusing update from remote peer 122642e57a134c53b4ce5183fa124f67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:32:16.900065 9451 consensus_queue.cc:1035] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac7f431098c8485da051c894a1446915" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 40529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:32:16.900506 9449 consensus_queue.cc:1035] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b0d823f93e848c386cb8b4f5233f16b" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 46549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:32:16.911793 9455 mvcc.cc:205] Tried to move back new op lower bound from 7316096355928895488 to 7316096355556745216. Current Snapshot: MvccSnapshot[applied={T|T < 7316096355928895488}]
I20260808 02:32:16.920496 9456 mvcc.cc:205] Tried to move back new op lower bound from 7316096355928895488 to 7316096355556745216. Current Snapshot: MvccSnapshot[applied={T|T < 7316096355928895488}]
I20260808 02:32:16.924628 8693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:32:16.924912 8693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:32:16.928635 8693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c0ea39a51e9046a092e9eefff4683cfd: Sending DeleteTablet for 3 replicas of tablet 79e577cc32f245f6aef334797d47eb54
I20260808 02:32:16.929795 8878 tablet_service.cc:1514] Processing DeleteTablet for tablet 79e577cc32f245f6aef334797d47eb54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:32:16 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:42134
I20260808 02:32:16.929872 9304 tablet_service.cc:1514] Processing DeleteTablet for tablet 79e577cc32f245f6aef334797d47eb54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:32:16 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:34194
I20260808 02:32:16.930202 9088 tablet_service.cc:1514] Processing DeleteTablet for tablet 79e577cc32f245f6aef334797d47eb54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:32:16 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:42656
I20260808 02:32:16.932719 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 8784
I20260808 02:32:16.939916 9469 tablet_replica.cc:330] T 79e577cc32f245f6aef334797d47eb54 P ac7f431098c8485da051c894a1446915: stopping tablet replica
I20260808 02:32:16.940174 9468 tablet_replica.cc:330] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67: stopping tablet replica
I20260808 02:32:16.940613 9469 raft_consensus.cc:2229] T 79e577cc32f245f6aef334797d47eb54 P ac7f431098c8485da051c894a1446915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:32:16.940618 9468 raft_consensus.cc:2229] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:32:16.941207 9469 raft_consensus.cc:2258] T 79e577cc32f245f6aef334797d47eb54 P ac7f431098c8485da051c894a1446915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:32:16.941471 9468 raft_consensus.cc:2258] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:32:16.943830 9468 ts_tablet_manager.cc:1905] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:32:16.943825 9469 ts_tablet_manager.cc:1905] T 79e577cc32f245f6aef334797d47eb54 P ac7f431098c8485da051c894a1446915: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:32:16.944574 9467 tablet_replica.cc:330] T 79e577cc32f245f6aef334797d47eb54 P 0b0d823f93e848c386cb8b4f5233f16b: stopping tablet replica
I20260808 02:32:16.945003 9467 raft_consensus.cc:2229] T 79e577cc32f245f6aef334797d47eb54 P 0b0d823f93e848c386cb8b4f5233f16b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:32:16.945516 9467 raft_consensus.cc:2258] T 79e577cc32f245f6aef334797d47eb54 P 0b0d823f93e848c386cb8b4f5233f16b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:32:16.951421 9469 ts_tablet_manager.cc:1918] T 79e577cc32f245f6aef334797d47eb54 P ac7f431098c8485da051c894a1446915: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:32:16.951597 9468 ts_tablet_manager.cc:1918] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:32:16.951673 9469 log.cc:1196] T 79e577cc32f245f6aef334797d47eb54 P ac7f431098c8485da051c894a1446915: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/79e577cc32f245f6aef334797d47eb54
I20260808 02:32:16.951803 9468 log.cc:1196] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/79e577cc32f245f6aef334797d47eb54
I20260808 02:32:16.952455 9469 ts_tablet_manager.cc:1939] T 79e577cc32f245f6aef334797d47eb54 P ac7f431098c8485da051c894a1446915: Deleting consensus metadata
I20260808 02:32:16.952454 9468 ts_tablet_manager.cc:1939] T 79e577cc32f245f6aef334797d47eb54 P 122642e57a134c53b4ce5183fa124f67: Deleting consensus metadata
I20260808 02:32:16.952845 9467 ts_tablet_manager.cc:1905] T 79e577cc32f245f6aef334797d47eb54 P 0b0d823f93e848c386cb8b4f5233f16b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:32:16.954650 8669 catalog_manager.cc:4841] TS 122642e57a134c53b4ce5183fa124f67 (127.24.116.195:32869): tablet 79e577cc32f245f6aef334797d47eb54 (table test-table [id=84cd771ba1a7498cbb4b934b084254eb]) successfully deleted
I20260808 02:32:16.954839 8671 catalog_manager.cc:4841] TS ac7f431098c8485da051c894a1446915 (127.24.116.194:40529): tablet 79e577cc32f245f6aef334797d47eb54 (table test-table [id=84cd771ba1a7498cbb4b934b084254eb]) successfully deleted
Aug 08 02:32:16 dist-test-slave-45dx krb5kdc[8615](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156334, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.193@KRBTEST.COM
I20260808 02:32:16.961864 9467 ts_tablet_manager.cc:1918] T 79e577cc32f245f6aef334797d47eb54 P 0b0d823f93e848c386cb8b4f5233f16b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:32:16.962069 9467 log.cc:1196] T 79e577cc32f245f6aef334797d47eb54 P 0b0d823f93e848c386cb8b4f5233f16b: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/79e577cc32f245f6aef334797d47eb54
I20260808 02:32:16.962683 9467 ts_tablet_manager.cc:1939] T 79e577cc32f245f6aef334797d47eb54 P 0b0d823f93e848c386cb8b4f5233f16b: Deleting consensus metadata
I20260808 02:32:16.964864 8669 catalog_manager.cc:4841] TS 0b0d823f93e848c386cb8b4f5233f16b (127.24.116.193:46549): tablet 79e577cc32f245f6aef334797d47eb54 (table test-table [id=84cd771ba1a7498cbb4b934b084254eb]) successfully deleted
I20260808 02:32:16.967026 9431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:16.933663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42150 (local address 127.24.116.193:46549)
0808 02:32:16.934582 (+ 919us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:16.934592 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:16.940762 (+ 6170us) server_negotiation.cc:407] Connection header received
0808 02:32:16.941754 (+ 992us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:16.941764 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:16.941861 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:16.941957 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:16.946870 (+ 4913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.948053 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.950399 (+ 2346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:16.951054 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:16.951161 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:16.960372 (+ 9211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:16.960397 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:16.960413 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:32:16.960452 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:16.963688 (+ 3236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:32:16.964529 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:32:16.964539 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:32:16.964543 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:32:16.964780 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:32:16.965265 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:32:16.965269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:32:16.965271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:32:16.965719 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:32:16.966056 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:16.966406 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 02:32:16.966640 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":745}
I20260808 02:32:16.967729 8967 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:32:17.057791 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 8784
I20260808 02:32:17.086582 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 8987
Aug 08 02:32:17 dist-test-slave-45dx krb5kdc[8615](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156334, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.194@KRBTEST.COM
I20260808 02:32:17.104084 9432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:17.087441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42658 (local address 127.24.116.194:40529)
0808 02:32:17.087648 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:17.087653 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:17.087913 (+ 260us) server_negotiation.cc:407] Connection header received
0808 02:32:17.088072 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:17.088078 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:17.088167 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:17.088293 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:17.089730 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:17.090896 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:17.092296 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:17.093075 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:17.093223 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:17.097537 (+ 4314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:17.097556 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:17.097577 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:32:17.097618 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:17.101309 (+ 3691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:32:17.102011 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:32:17.102021 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:32:17.102025 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:32:17.102190 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:32:17.102552 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:32:17.102558 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:32:17.102561 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:32:17.103023 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:32:17.103325 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:17.103496 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 02:32:17.103710 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 02:32:17.104816 9180 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:32:17.195886 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 8987
I20260808 02:32:17.229586 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 9200
Aug 08 02:32:17 dist-test-slave-45dx krb5kdc[8615](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156334, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.195@KRBTEST.COM
I20260808 02:32:17.246961 9434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:32:17.230489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34226 (local address 127.24.116.195:32869)
0808 02:32:17.230697 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 02:32:17.230703 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:32:17.230728 (+ 25us) server_negotiation.cc:407] Connection header received
0808 02:32:17.230841 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:32:17.230846 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:32:17.230950 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:32:17.231062 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:32:17.232391 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:17.233168 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:17.234445 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:32:17.234903 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:32:17.235059 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:32:17.239888 (+ 4829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:32:17.239901 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:32:17.239923 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:32:17.239959 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:32:17.243840 (+ 3881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:32:17.244711 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:32:17.244720 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:32:17.244725 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:32:17.244891 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:32:17.245326 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:32:17.245329 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:32:17.245331 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:32:17.245705 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:32:17.246081 (+ 376us) server_negotiation.cc:1035] Waiting for connection context
0808 02:32:17.246322 (+ 241us) server_negotiation.cc:299] Negotiation successful
0808 02:32:17.246558 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 02:32:17.247879 9396 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:32:17.371667 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 9200
I20260808 02:32:17.402078 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 8638
I20260808 02:32:17.403254 8735 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:32:17.514101 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 8638
2026-08-08T02:32:17Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (5022 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:32:17 dist-test-slave-45dx krb5kdc[9482](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:32:17 dist-test-slave-45dx krb5kdc[9482](info): set up 2 sockets
Aug 08 02:32:17 dist-test-slave-45dx krb5kdc[9482](info): commencing operation
krb5kdc: starting...
W20260808 02:32:18.885905 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.318s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:32:19 dist-test-slave-45dx krb5kdc[9482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:32:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:32:19Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.24.116.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.24.116.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.24.116.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/rangeradmin_127.24.116.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.24.116.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/rangeradmin_127.24.116.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.24.116.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.24.116.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.24.116.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/rangerlookup_127.24.116.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.24.116.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/rangerlookup_127.24.116.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.24.116.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.24.116.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.24.116.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/HTTP_127.24.116.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.24.116.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/HTTP_127.24.116.212@KRBTEST.COM.keytab.
I20260808 02:32:19.321691 25043 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task5C7FBY/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/postgres -l logfile start
2026-08-08 02:32:21.908 UTC [9536] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 02:32:21.908 UTC [9536] LOG: listening on IPv4 address "127.24.116.212", port 38285
2026-08-08 02:32:21.911 UTC [9536] LOG: listening on Unix socket "/tmp/.s.PGSQL.38285"
2026-08-08 02:32:21.933 UTC [9543] LOG: database system was shut down at 2026-08-08 02:32:20 UTC
2026-08-08 02:32:21.937 UTC [9536] LOG: database system is ready to accept connections
I20260808 02:32:23.183997 25043 mini_postgres.cc:96] Postgres bound to 38285
2026-08-08 02:32:23.212 UTC [9555] FATAL: database "slave" does not exist
127.24.116.212:38285 - accepting connections
I20260808 02:32:23.212970 25043 mini_ranger.cc:161] Starting Ranger...
I20260808 02:32:23.248016 25043 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 02:32:23.763413 25043 mini_ranger.cc:87] Created ranger Postgres database
I20260808 02:32:23.763562 25043 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ranger-admin
2026-08-08 02:32:24,079 [I] DB FLAVOR :POSTGRES
2026-08-08 02:32:24,079 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 02:32:24,079 [I] Checking connection..
2026-08-08 02:32:24,079 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:38285/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 02:32:24,353 [I] Checking connection passed.
2026-08-08 02:32:24,353 [I] --------- Verifying version history table ---------
2026-08-08 02:32:24,353 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:38285/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 02:32:24,605 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 02:32:24,606 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:38285/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 02:32:24,850 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 02:32:24,851 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 02:32:24,851 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:38285/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 02:32:25.098 UTC [9662] WARNING: there is no transaction in progress
2026-08-08 02:32:25,105 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 02:32:25,106 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:38285/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 02:32:25,374 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 02:32:25,375 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 02:32:25,375 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:38285/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 02:32:25,616 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:38285/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 02:32:25,882 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:38285/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-45dx.c.gcp-upstream.internal','N') ;"
2026-08-08 02:32:26,142 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:38285/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 02:32:26,392 [I] Table x_portal_user does not exist in database ranger
2026-08-08 02:32:26,393 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:38285/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 02:32:26,664 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 02:32:26,665 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:38285/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 02:32:26,933 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:38285/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 02:32:27,190 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 02:32:27,190 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:38285/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 02:32:28.152 UTC [9826] WARNING: there is no transaction in progress
2026-08-08 02:32:28.171 UTC [9826] WARNING: there is no transaction in progress
2026-08-08 02:32:28.188 UTC [9826] WARNING: there is no transaction in progress
2026-08-08 02:32:28.204 UTC [9826] WARNING: there is no transaction in progress
2026-08-08 02:32:28.223 UTC [9826] WARNING: there is no transaction in progress
2026-08-08 02:32:28.241 UTC [9826] WARNING: there is no transaction in progress
2026-08-08 02:32:28.301 UTC [9826] WARNING: there is no transaction in progress
2026-08-08 02:32:28.308 UTC [9826] WARNING: there is no transaction in progress
2026-08-08 02:32:28.322 UTC [9826] WARNING: there is no transaction in progress
2026-08-08 02:32:28.331 UTC [9826] WARNING: there is no transaction in progress
2026-08-08 02:32:28.341 UTC [9826] WARNING: there is no transaction in progress
2026-08-08 02:32:28.354 UTC [9826] WARNING: there is no transaction in progress
2026-08-08 02:32:28.364 UTC [9826] WARNING: there is no transaction in progress
2026-08-08 02:32:28.371 UTC [9826] WARNING: there is no transaction in progress
2026-08-08 02:32:28.378 UTC [9826] WARNING: there is no transaction in progress
2026-08-08 02:32:28.385 UTC [9826] WARNING: there is no transaction in progress
2026-08-08 02:32:29,032 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 02:32:29,033 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:38285/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 02:32:29,280 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 02:32:29,281 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:38285/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 02:32:29,552 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 02:32:29,553 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:38285/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 02:32:29,812 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 02:32:29,812 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:38285/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 02:32:30,086 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:38285/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 02:32:30,339 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:38285/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-45dx.c.gcp-upstream.internal';"
2026-08-08 02:32:30,573 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 02:32:30,574 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:38285/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 02:32:30,856 [I] DB_PATCHES have already been applied
I20260808 02:32:30.863102 25043 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ranger-admin:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task5C7FBY/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 02:32:30.863240 25043 mini_ranger.cc:193] Using host: 127.24.116.212
I20260808 02:32:30.887763 25043 mini_ranger.cc:227] Ranger admin URL: http://127.24.116.212:51551
Aug 08, 2026 2:32:31 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:32:31 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:32:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 2:32:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 2:32:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 2:32:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 2:32:31 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 02:32:32.309960 25043 mini_ranger.cc:160] Time spent starting Ranger: real 9.097s user 0.000s sys 0.075s
Aug 08, 2026 2:32:53 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 2:32:53 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 2:32:53 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 2:32:53 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 2:32:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 2:32:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 2:32:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 2:32:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 2:32:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 2:32:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 2:32:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 2:32:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 2:32:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 2:32:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 2:32:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 2:32:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 2:32:53 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 2:32:54 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 02:32:55.005100 25043 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.24.116.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.24.116.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.24.116.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/rangerkms_127.24.116.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.24.116.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/rangerkms_127.24.116.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.24.116.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.24.116.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.24.116.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/HTTP_127.24.116.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.24.116.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/HTTP_127.24.116.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 02:32:55 dist-test-slave-45dx krb5kdc[9482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156375, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 02:32:55.240732 25043 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 02:32:55.271654 25043 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 02:32:56.194077 25043 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 02:32:56.194262 25043 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ranger-kms
I20260808 02:32:56.194422 25043 mini_ranger_kms.cc:227] Using postgres at 127.24.116.212:38285
2026-08-08 02:32:57,146 [I] DB FLAVOR :POSTGRES
2026-08-08 02:32:57,147 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 02:32:57,147 [I] Checking connection
2026-08-08 02:32:57,147 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:38285/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 02:32:57,464 [I] connection success
2026-08-08 02:32:57,465 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 02:32:57,465 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 02:32:57,465 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:38285/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 02:32:57,770 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 02:32:57,770 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 02:32:57,770 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 02:32:57,770 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:38285/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 02:32:58,097 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 02:32:58.629189 25043 mini_ranger_kms.cc:310] Created kms service
I20260808 02:32:58.818931 25043 mini_ranger_kms.cc:326] Created kudu user
I20260808 02:32:58.866020 25043 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 02:32:58 dist-test-slave-45dx krb5kdc[9482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156375, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.24.116.212@KRBTEST.COM
I20260808 02:32:59.282353 25043 mini_ranger_kms.cc:384] Added ranger policy
I20260808 02:32:59.283762 25043 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ranger-kms:/tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 02:32:59.283826 25043 mini_ranger_kms.cc:240] Using host: 127.24.116.212
I20260808 02:32:59.312777 25043 mini_ranger_kms.cc:276] Ranger KMS PID: 10107
I20260808 02:32:59.313014 25043 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.24.116.212:39909
Aug 08, 2026 2:33:00 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:33:00 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:33:00 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 2:33:00 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 2:33:00 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 2:33:00 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 02:33:01 dist-test-slave-45dx krb5kdc[9482](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786156381, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.116.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 08 02:33:02 dist-test-slave-45dx krb5kdc[9482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156381, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.116.212@KRBTEST.COM for HTTP/127.24.116.212@KRBTEST.COM
I20260808 02:33:02.233754 25043 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.993s user 0.139s sys 0.512s
I20260808 02:33:02.234189 25043 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 02:33:02.234416 25043 mini_ranger_kms.cc:401] 127.24.116.212:39909/kms/v1/keys
Aug 08 02:33:02 dist-test-slave-45dx krb5kdc[9482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156381, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.116.212@KRBTEST.COM for HTTP/127.24.116.212@KRBTEST.COM
Aug 08 02:33:04 dist-test-slave-45dx krb5kdc[9482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:33:05.054517 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:45097
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:34477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:45097
--ranger_config_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.116.212:39909/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:33:05.460562 10195 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:33:05.460891 10195 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:33:05.461212 10195 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:33:05.469472 10195 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:33:05.469621 10195 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:33:05.469776 10195 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:33:05.469949 10195 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:33:05.470042 10195 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:33:05.481014 10195 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:34477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/master-0/wal
--ranger_kms_url=127.24.116.212:39909/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:45097
--ranger_config_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:45097
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:33:05.482524 10195 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:33:05.484375 10195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:33:05.499392 10205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:33:05.499830 10203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:33:05.499382 10207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:33:05.505791 10195 server_base.cc:1034] running on GCE node
I20260808 02:33:05.506843 10195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:33:05.508663 10195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:33:05.509965 10195 hybrid_clock.cc:648] HybridClock initialized: now 1786156385509883 us; error 55 us; skew 500 ppm
I20260808 02:33:05.510424 10195 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:33:05 dist-test-slave-45dx krb5kdc[9482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156385, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:33:05.514473 10195 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:33:05.516284 10195 webserver.cc:460] Webserver started at http://127.24.116.254:43883/ using document root <none> and password file <none>
I20260808 02:33:05.517163 10195 fs_manager.cc:359] Metadata directory not provided
I20260808 02:33:05.517313 10195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:33:05.517706 10195 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 02:33:05 dist-test-slave-45dx krb5kdc[9482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156385, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for HTTP/127.24.116.212@KRBTEST.COM
I20260808 02:33:05.588135 10195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "7464ffc97fce4e46810042e76cd08f40"
format_stamp: "Formatted at 2026-08-08 02:33:05 on dist-test-slave-45dx"
server_key: "6c8194234a091b01513ed20713aba911"
server_key_iv: "33d0838d852c2e7d31e478cdfe556be1"
server_key_version: "kuduclusterkey@0"
I20260808 02:33:05.589141 10195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "7464ffc97fce4e46810042e76cd08f40"
format_stamp: "Formatted at 2026-08-08 02:33:05 on dist-test-slave-45dx"
server_key: "6c8194234a091b01513ed20713aba911"
server_key_iv: "33d0838d852c2e7d31e478cdfe556be1"
server_key_version: "kuduclusterkey@0"
I20260808 02:33:05.595125 10195 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260808 02:33:05.617154 10222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:33:05.618942 10195 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260808 02:33:05.619158 10195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "7464ffc97fce4e46810042e76cd08f40"
format_stamp: "Formatted at 2026-08-08 02:33:05 on dist-test-slave-45dx"
server_key: "6c8194234a091b01513ed20713aba911"
server_key_iv: "33d0838d852c2e7d31e478cdfe556be1"
server_key_version: "kuduclusterkey@0"
I20260808 02:33:05.619395 10195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:33:05.631323 10195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:33:05.635710 10195 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:33:05.636057 10195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:33:05.662672 10195 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:45097
I20260808 02:33:05.662695 10302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:45097 every 8 connection(s)
I20260808 02:33:05.664260 10195 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:33:05.665531 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 10195
I20260808 02:33:05.665729 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:33:05.666539 25043 external_mini_cluster.cc:1428] Setting key 46abbe096023312b7b14f82d3981833b
I20260808 02:33:05.670790 10303 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:33:05.684257 10303 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7464ffc97fce4e46810042e76cd08f40: Bootstrap starting.
I20260808 02:33:05.688683 10303 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7464ffc97fce4e46810042e76cd08f40: Neither blocks nor log segments found. Creating new log.
I20260808 02:33:05.690408 10303 log.cc:824] T 00000000000000000000000000000000 P 7464ffc97fce4e46810042e76cd08f40: Log is configured to *not* fsync() on all Append() calls
Aug 08 02:33:05 dist-test-slave-45dx krb5kdc[9482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:33:05.695757 10303 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7464ffc97fce4e46810042e76cd08f40: No bootstrap required, opened a new log
I20260808 02:33:05.701630 10310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:33:05.668936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40066 (local address 127.24.116.254:45097)
0808 02:33:05.677152 (+ 8216us) server_negotiation.cc:206] Beginning negotiation
0808 02:33:05.677169 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 02:33:05.677226 (+ 57us) server_negotiation.cc:407] Connection header received
0808 02:33:05.679941 (+ 2715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:33:05.679973 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:33:05.680532 (+ 559us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:33:05.680991 (+ 459us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:33:05.682727 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:05.684595 (+ 1868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:05.686586 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:05.687595 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:05.687785 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:33:05.693337 (+ 5552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:33:05.693351 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:33:05.693374 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:33:05.693427 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:33:05.696935 (+ 3508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:33:05.697742 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:33:05.697752 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:33:05.697759 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:33:05.697933 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:33:05.698363 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:33:05.698375 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:33:05.698379 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:33:05.698990 (+ 611us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:33:05.699337 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0808 02:33:05.699807 (+ 470us) server_negotiation.cc:299] Negotiation successful
0808 02:33:05.700334 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7921,"thread_start_us":7617,"threads_started":1}
I20260808 02:33:05.707739 10303 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7464ffc97fce4e46810042e76cd08f40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7464ffc97fce4e46810042e76cd08f40" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 45097 } }
I20260808 02:33:05.708258 10303 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7464ffc97fce4e46810042e76cd08f40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:33:05.708413 10303 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7464ffc97fce4e46810042e76cd08f40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7464ffc97fce4e46810042e76cd08f40, State: Initialized, Role: FOLLOWER
I20260808 02:33:05.709148 10303 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7464ffc97fce4e46810042e76cd08f40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7464ffc97fce4e46810042e76cd08f40" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 45097 } }
I20260808 02:33:05.709535 10303 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7464ffc97fce4e46810042e76cd08f40 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:33:05.709704 10303 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7464ffc97fce4e46810042e76cd08f40 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:33:05.709924 10303 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7464ffc97fce4e46810042e76cd08f40 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:33:05.713408 10303 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7464ffc97fce4e46810042e76cd08f40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7464ffc97fce4e46810042e76cd08f40" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 45097 } }
I20260808 02:33:05.714010 10303 leader_election.cc:302] T 00000000000000000000000000000000 P 7464ffc97fce4e46810042e76cd08f40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7464ffc97fce4e46810042e76cd08f40; no voters:
I20260808 02:33:05.714740 10303 leader_election.cc:288] T 00000000000000000000000000000000 P 7464ffc97fce4e46810042e76cd08f40 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:33:05.714893 10312 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7464ffc97fce4e46810042e76cd08f40 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:33:05.716511 10312 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7464ffc97fce4e46810042e76cd08f40 [term 1 LEADER]: Becoming Leader. State: Replica: 7464ffc97fce4e46810042e76cd08f40, State: Running, Role: LEADER
I20260808 02:33:05.717149 10303 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7464ffc97fce4e46810042e76cd08f40 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:33:05.717242 10312 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7464ffc97fce4e46810042e76cd08f40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7464ffc97fce4e46810042e76cd08f40" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 45097 } }
I20260808 02:33:05.721163 10316 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7464ffc97fce4e46810042e76cd08f40 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7464ffc97fce4e46810042e76cd08f40. Latest consensus state: current_term: 1 leader_uuid: "7464ffc97fce4e46810042e76cd08f40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7464ffc97fce4e46810042e76cd08f40" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 45097 } } }
I20260808 02:33:05.721771 10316 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7464ffc97fce4e46810042e76cd08f40 [sys.catalog]: This master's current role is: LEADER
I20260808 02:33:05.722471 10315 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7464ffc97fce4e46810042e76cd08f40 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7464ffc97fce4e46810042e76cd08f40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7464ffc97fce4e46810042e76cd08f40" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 45097 } } }
I20260808 02:33:05.722831 10315 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7464ffc97fce4e46810042e76cd08f40 [sys.catalog]: This master's current role is: LEADER
I20260808 02:33:05.734090 10325 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:33:05.740286 10325 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:33:05.744482 10303 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 02:33:05.771504 10325 catalog_manager.cc:1347] Generated new cluster ID: 0a8a9973f62d442d8887279a6e373b31
I20260808 02:33:05.771782 10325 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:33:05.797960 10325 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:33:05.800211 10325 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:33:05.810369 10325 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7464ffc97fce4e46810042e76cd08f40: Generated new TSK 0
I20260808 02:33:05.811594 10325 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.116.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
I20260808 02:33:06.671968 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.116.212:39909/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:45097
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:34477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 02:33:06 dist-test-slave-45dx krb5kdc[9482](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786156386, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 02:33:07.137463 10382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:33:07.137902 10382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:33:07.138170 10382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:33:07.150491 10382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:33:07.150712 10382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:33:07.150944 10382 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:33:07.167629 10382 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:34477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.24.116.212:39909/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:45097
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:33:07.169541 10382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:33:07.171299 10382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:33:07.187840 10395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:33:07.187879 10401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:33:07.187932 10397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:33:07.189574 10382 server_base.cc:1034] running on GCE node
I20260808 02:33:07.190279 10382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:33:07.191417 10382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:33:07.192715 10382 hybrid_clock.cc:648] HybridClock initialized: now 1786156387192607 us; error 49 us; skew 500 ppm
I20260808 02:33:07.193122 10382 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:33:07 dist-test-slave-45dx krb5kdc[9482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156387, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:33:07.196666 10382 init.cc:377] Logged in from keytab as kudu/127.24.116.193@KRBTEST.COM (short username kudu)
I20260808 02:33:07.198348 10382 webserver.cc:460] Webserver started at http://127.24.116.193:46851/ using document root <none> and password file <none>
I20260808 02:33:07.199157 10382 fs_manager.cc:359] Metadata directory not provided
I20260808 02:33:07.199290 10382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:33:07.199669 10382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 02:33:07 dist-test-slave-45dx krb5kdc[9482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156387, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for HTTP/127.24.116.212@KRBTEST.COM
I20260808 02:33:07.220376 10382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "fa26b5ebb52b490a80086288efc60a00"
format_stamp: "Formatted at 2026-08-08 02:33:07 on dist-test-slave-45dx"
server_key: "ac0ce1f4a29e285044b0fc7eeac1363e"
server_key_iv: "7abff7eaa42298aecd5d38b0c3efaabe"
server_key_version: "kuduclusterkey@0"
I20260808 02:33:07.221645 10382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "fa26b5ebb52b490a80086288efc60a00"
format_stamp: "Formatted at 2026-08-08 02:33:07 on dist-test-slave-45dx"
server_key: "ac0ce1f4a29e285044b0fc7eeac1363e"
server_key_iv: "7abff7eaa42298aecd5d38b0c3efaabe"
server_key_version: "kuduclusterkey@0"
I20260808 02:33:07.242769 10382 fs_manager.cc:691] Time spent creating directory manager: real 0.020s user 0.007s sys 0.011s
I20260808 02:33:07.271056 10411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:33:07.273128 10382 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.008s sys 0.000s
I20260808 02:33:07.273432 10382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "fa26b5ebb52b490a80086288efc60a00"
format_stamp: "Formatted at 2026-08-08 02:33:07 on dist-test-slave-45dx"
server_key: "ac0ce1f4a29e285044b0fc7eeac1363e"
server_key_iv: "7abff7eaa42298aecd5d38b0c3efaabe"
server_key_version: "kuduclusterkey@0"
I20260808 02:33:07.273806 10382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:33:07.319324 10382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:33:07.325817 10382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:33:07.326347 10382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:33:07.333973 10382 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:33:07.342460 10382 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:33:07.342653 10382 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260808 02:33:07.342871 10382 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:33:07.343010 10382 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 02:33:07 dist-test-slave-45dx krb5kdc[9482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156386, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for HTTP/127.24.116.212@KRBTEST.COM
I20260808 02:33:07.861368 10382 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:41121
I20260808 02:33:07.861450 10578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:41121 every 8 connection(s)
I20260808 02:33:07.863349 10382 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:33:07.868796 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 10382
I20260808 02:33:07.869082 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:33:07.870153 25043 external_mini_cluster.cc:1428] Setting key 8626cbde88b4027a6e9ad654c0eb1c14
Aug 08 02:33:07 dist-test-slave-45dx krb5kdc[9482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156387, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:33:07.913264 10584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:33:07.866526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:60005 (local address 127.24.116.254:45097)
0808 02:33:07.890214 (+ 23688us) server_negotiation.cc:206] Beginning negotiation
0808 02:33:07.890222 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:33:07.890264 (+ 42us) server_negotiation.cc:407] Connection header received
0808 02:33:07.890340 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:33:07.890347 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:33:07.890444 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:33:07.890596 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:33:07.894595 (+ 3999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:07.895850 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:07.898715 (+ 2865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:07.899362 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:07.899470 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:33:07.904558 (+ 5088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:33:07.904566 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:33:07.904572 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:33:07.904630 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:33:07.908931 (+ 4301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:33:07.909983 (+ 1052us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:33:07.909990 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:33:07.909994 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:33:07.910160 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:33:07.910729 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:33:07.910734 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:33:07.910738 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:33:07.911130 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:33:07.911286 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 02:33:07.912564 (+ 1278us) server_negotiation.cc:299] Negotiation successful
0808 02:33:07.912849 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23513,"thread_start_us":24200,"threads_started":1}
I20260808 02:33:07.914275 10585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:33:07.867154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45097 (local address 127.24.116.193:60005)
0808 02:33:07.878837 (+ 11683us) negotiation.cc:107] Waiting for socket to connect
0808 02:33:07.878926 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0808 02:33:07.881884 (+ 2958us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:33:07.891425 (+ 9541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:33:07.891441 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:33:07.892194 (+ 753us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:33:07.893244 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:33:07.893280 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:33:07.896342 (+ 3062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:33:07.896349 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:33:07.898513 (+ 2164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:33:07.898532 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:33:07.899857 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:33:07.899866 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:33:07.900181 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:33:07.901179 (+ 998us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:33:07.901211 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:33:07.904237 (+ 3026us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:33:07.909151 (+ 4914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:33:07.909163 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:33:07.909184 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:33:07.909804 (+ 620us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:33:07.910294 (+ 490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:33:07.910300 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:33:07.910304 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:33:07.910586 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:33:07.911367 (+ 781us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:33:07.911375 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:33:07.911860 (+ 485us) client_negotiation.cc:769] Sending connection context
0808 02:33:07.912169 (+ 309us) client_negotiation.cc:240] Negotiation successful
0808 02:33:07.912763 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11196,"thread_start_us":15079,"threads_started":1}
I20260808 02:33:07.916482 10581 heartbeater.cc:347] Connected to a master server at 127.24.116.254:45097
I20260808 02:33:07.916862 10581 heartbeater.cc:464] Registering TS with master...
I20260808 02:33:07.917805 10581 heartbeater.cc:511] Master 127.24.116.254:45097 requested a full tablet report, sending...
I20260808 02:33:07.920644 10248 ts_manager.cc:194] Registered new tserver with Master: fa26b5ebb52b490a80086288efc60a00 (127.24.116.193:41121)
I20260808 02:33:07.923014 10248 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.193@KRBTEST.COM'} at 127.24.116.193:60005
WARNING: no policy specified for kudu/127.24.116.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.194@KRBTEST.COM" created.
Aug 08 02:33:07 dist-test-slave-45dx krb5kdc[9482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156386, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for HTTP/127.24.116.212@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
W20260808 02:33:07.985399 25043 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.24.116.194: real 0.112s user 0.005s sys 0.022s
I20260808 02:33:07.986446 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.116.212:39909/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:45097
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:34477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:33:08.489666 10592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:33:08.489965 10592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:33:08.490139 10592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:33:08.498114 10592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:33:08.498245 10592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:33:08.498425 10592 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:33:08.509171 10592 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:34477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.24.116.212:39909/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:45097
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:33:08.510752 10592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:33:08.512523 10592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:33:08.529312 10609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:33:08.529274 10612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:33:08.529917 10607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:33:08.530408 10592 server_base.cc:1034] running on GCE node
I20260808 02:33:08.531039 10592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:33:08.532122 10592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:33:08.533372 10592 hybrid_clock.cc:648] HybridClock initialized: now 1786156388533304 us; error 60 us; skew 500 ppm
I20260808 02:33:08.533794 10592 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:33:08 dist-test-slave-45dx krb5kdc[9482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156388, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:33:08.537513 10592 init.cc:377] Logged in from keytab as kudu/127.24.116.194@KRBTEST.COM (short username kudu)
I20260808 02:33:08.539242 10592 webserver.cc:460] Webserver started at http://127.24.116.194:33757/ using document root <none> and password file <none>
I20260808 02:33:08.539986 10592 fs_manager.cc:359] Metadata directory not provided
I20260808 02:33:08.540149 10592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:33:08.540552 10592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 02:33:08 dist-test-slave-45dx krb5kdc[9482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156388, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for HTTP/127.24.116.212@KRBTEST.COM
I20260808 02:33:08.559193 10592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "927c35c01d9546ad89ae1c0ccbe79b05"
format_stamp: "Formatted at 2026-08-08 02:33:08 on dist-test-slave-45dx"
server_key: "02ea267b756eb0708178bd0d9b3344e2"
server_key_iv: "78c426df040f50b65911e032973951ab"
server_key_version: "kuduclusterkey@0"
I20260808 02:33:08.560261 10592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "927c35c01d9546ad89ae1c0ccbe79b05"
format_stamp: "Formatted at 2026-08-08 02:33:08 on dist-test-slave-45dx"
server_key: "02ea267b756eb0708178bd0d9b3344e2"
server_key_iv: "78c426df040f50b65911e032973951ab"
server_key_version: "kuduclusterkey@0"
I20260808 02:33:08.567521 10592 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.005s
I20260808 02:33:08.588336 10627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:33:08.590332 10592 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260808 02:33:08.590551 10592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "927c35c01d9546ad89ae1c0ccbe79b05"
format_stamp: "Formatted at 2026-08-08 02:33:08 on dist-test-slave-45dx"
server_key: "02ea267b756eb0708178bd0d9b3344e2"
server_key_iv: "78c426df040f50b65911e032973951ab"
server_key_version: "kuduclusterkey@0"
I20260808 02:33:08.590862 10592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:33:08.625244 10592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:33:08.630656 10592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:33:08.631037 10592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:33:08.632290 10592 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:33:08.634217 10592 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:33:08.634316 10592 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:33:08.634439 10592 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:33:08.634506 10592 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:33:08.687165 10592 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:41113
I20260808 02:33:08.687171 10801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:41113 every 8 connection(s)
I20260808 02:33:08.688853 10592 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:33:08.690737 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 10592
I20260808 02:33:08.690949 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:33:08.691404 25043 external_mini_cluster.cc:1428] Setting key 28c00c515f449a5aab529727b1196ec8
Aug 08 02:33:08 dist-test-slave-45dx krb5kdc[9482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156388, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:33:08.717880 10805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:33:08.693394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:34477 (local address 127.24.116.254:45097)
0808 02:33:08.694333 (+ 939us) server_negotiation.cc:206] Beginning negotiation
0808 02:33:08.694339 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:33:08.695378 (+ 1039us) server_negotiation.cc:407] Connection header received
0808 02:33:08.698135 (+ 2757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:33:08.698144 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:33:08.698235 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:33:08.698369 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:33:08.700357 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:08.701646 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:08.703935 (+ 2289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:08.704692 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:08.704841 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:33:08.709515 (+ 4674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:33:08.709524 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:33:08.709531 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:33:08.709586 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:33:08.713760 (+ 4174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:33:08.714763 (+ 1003us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:33:08.714772 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:33:08.714778 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:33:08.714963 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:33:08.715597 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:33:08.715605 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:33:08.715611 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:33:08.716031 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:33:08.716203 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 02:33:08.717096 (+ 893us) server_negotiation.cc:299] Negotiation successful
0808 02:33:08.717376 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":368,"threads_started":1}
I20260808 02:33:08.718864 10806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:33:08.694186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45097 (local address 127.24.116.194:34477)
0808 02:33:08.695224 (+ 1038us) negotiation.cc:107] Waiting for socket to connect
0808 02:33:08.695273 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 02:33:08.697829 (+ 2556us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:33:08.698641 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:33:08.698653 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:33:08.699301 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:33:08.700130 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:33:08.700156 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:33:08.701830 (+ 1674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:33:08.701836 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:33:08.703776 (+ 1940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:33:08.703791 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:33:08.705033 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:33:08.705044 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:33:08.705367 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:33:08.706233 (+ 866us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:33:08.706270 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:33:08.709239 (+ 2969us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:33:08.713954 (+ 4715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:33:08.713964 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:33:08.713983 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:33:08.714616 (+ 633us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:33:08.715111 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:33:08.715116 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:33:08.715119 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:33:08.715462 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:33:08.716185 (+ 723us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:33:08.716193 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:33:08.716655 (+ 462us) client_negotiation.cc:769] Sending connection context
0808 02:33:08.716962 (+ 307us) client_negotiation.cc:240] Negotiation successful
0808 02:33:08.717502 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":734,"thread_start_us":461,"threads_started":1}
I20260808 02:33:08.720619 10802 heartbeater.cc:347] Connected to a master server at 127.24.116.254:45097
I20260808 02:33:08.721112 10802 heartbeater.cc:464] Registering TS with master...
I20260808 02:33:08.722076 10802 heartbeater.cc:511] Master 127.24.116.254:45097 requested a full tablet report, sending...
I20260808 02:33:08.724213 10248 ts_manager.cc:194] Registered new tserver with Master: 927c35c01d9546ad89ae1c0ccbe79b05 (127.24.116.194:41113)
I20260808 02:33:08.725350 10248 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.194@KRBTEST.COM'} at 127.24.116.194:34477
WARNING: no policy specified for kudu/127.24.116.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
I20260808 02:33:08.768610 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.116.212:39909/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:45097
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:34477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:33:08.931424 10581 heartbeater.cc:503] Master 127.24.116.254:45097 was elected leader, sending a full tablet report...
W20260808 02:33:09.192935 10810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:33:09.193296 10810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:33:09.193467 10810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:33:09.201076 10810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:33:09.201237 10810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:33:09.201433 10810 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:33:09.211640 10810 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:34477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.24.116.212:39909/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:45097
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:33:09.213152 10810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:33:09.214553 10810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:33:09.228945 10816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:33:09.229040 10817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:33:09.228902 10820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:33:09.230036 10810 server_base.cc:1034] running on GCE node
I20260808 02:33:09.230643 10810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:33:09.231633 10810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:33:09.232839 10810 hybrid_clock.cc:648] HybridClock initialized: now 1786156389232780 us; error 53 us; skew 500 ppm
I20260808 02:33:09.233273 10810 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:33:09 dist-test-slave-45dx krb5kdc[9482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156389, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:33:09.236769 10810 init.cc:377] Logged in from keytab as kudu/127.24.116.195@KRBTEST.COM (short username kudu)
I20260808 02:33:09.238377 10810 webserver.cc:460] Webserver started at http://127.24.116.195:45657/ using document root <none> and password file <none>
I20260808 02:33:09.239104 10810 fs_manager.cc:359] Metadata directory not provided
I20260808 02:33:09.239260 10810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:33:09.239603 10810 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 02:33:09 dist-test-slave-45dx krb5kdc[9482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156389, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for HTTP/127.24.116.212@KRBTEST.COM
I20260808 02:33:09.256141 10810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "140fc460bdf54d95b84bbc319356d5a9"
format_stamp: "Formatted at 2026-08-08 02:33:09 on dist-test-slave-45dx"
server_key: "6b85e0b0ff5c0846883fb60b18e0c543"
server_key_iv: "ec579bdd410cf97e8b188877b049019d"
server_key_version: "kuduclusterkey@0"
I20260808 02:33:09.257213 10810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "140fc460bdf54d95b84bbc319356d5a9"
format_stamp: "Formatted at 2026-08-08 02:33:09 on dist-test-slave-45dx"
server_key: "6b85e0b0ff5c0846883fb60b18e0c543"
server_key_iv: "ec579bdd410cf97e8b188877b049019d"
server_key_version: "kuduclusterkey@0"
I20260808 02:33:09.263305 10810 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.005s
I20260808 02:33:09.280491 10827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:33:09.282527 10810 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260808 02:33:09.282711 10810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "140fc460bdf54d95b84bbc319356d5a9"
format_stamp: "Formatted at 2026-08-08 02:33:09 on dist-test-slave-45dx"
server_key: "6b85e0b0ff5c0846883fb60b18e0c543"
server_key_iv: "ec579bdd410cf97e8b188877b049019d"
server_key_version: "kuduclusterkey@0"
I20260808 02:33:09.283057 10810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:33:09.335042 10810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:33:09.340550 10810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:33:09.341025 10810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:33:09.342314 10810 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:33:09.344188 10810 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:33:09.344291 10810 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:33:09.344455 10810 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:33:09.344527 10810 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:33:09.391883 10810 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:38905
I20260808 02:33:09.391994 11011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:38905 every 8 connection(s)
I20260808 02:33:09.393433 10810 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:33:09.398316 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 10810
I20260808 02:33:09.398523 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:33:09.399101 25043 external_mini_cluster.cc:1428] Setting key 41afca9ad576226ca2159c2132caef69
Aug 08 02:33:09 dist-test-slave-45dx krb5kdc[9482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156389, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:33:09.419548 11014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:33:09.396719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:48975 (local address 127.24.116.254:45097)
0808 02:33:09.397371 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0808 02:33:09.397380 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:33:09.399143 (+ 1763us) server_negotiation.cc:407] Connection header received
0808 02:33:09.401328 (+ 2185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:33:09.401334 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:33:09.401463 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:33:09.401580 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:33:09.403606 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.404775 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.406570 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.407246 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.407377 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:33:09.411502 (+ 4125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:33:09.411509 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:33:09.411514 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:33:09.411561 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:33:09.415763 (+ 4202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:33:09.416703 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:33:09.416711 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:33:09.416718 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:33:09.416875 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:33:09.417470 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:33:09.417476 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:33:09.417479 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:33:09.417799 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:33:09.417993 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0808 02:33:09.418846 (+ 853us) server_negotiation.cc:299] Negotiation successful
0808 02:33:09.419116 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":340,"threads_started":1}
I20260808 02:33:09.420756 11015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:33:09.397515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:45097 (local address 127.24.116.195:48975)
0808 02:33:09.398422 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0808 02:33:09.398471 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 02:33:09.400883 (+ 2412us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:33:09.401922 (+ 1039us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:33:09.401936 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:33:09.402732 (+ 796us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:33:09.403419 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:33:09.403440 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.404945 (+ 1505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.404950 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:33:09.406368 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:33:09.406413 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.407494 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.407500 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:33:09.407738 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:33:09.408577 (+ 839us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:33:09.408609 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:33:09.411216 (+ 2607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:33:09.415936 (+ 4720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:33:09.415954 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:33:09.415969 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:33:09.416564 (+ 595us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:33:09.417009 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:33:09.417014 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:33:09.417025 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:33:09.417333 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:33:09.417950 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:33:09.417959 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:33:09.418394 (+ 435us) client_negotiation.cc:769] Sending connection context
0808 02:33:09.418750 (+ 356us) client_negotiation.cc:240] Negotiation successful
0808 02:33:09.419369 (+ 619us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":424,"threads_started":1}
I20260808 02:33:09.422477 11012 heartbeater.cc:347] Connected to a master server at 127.24.116.254:45097
I20260808 02:33:09.422880 11012 heartbeater.cc:464] Registering TS with master...
I20260808 02:33:09.423817 11012 heartbeater.cc:511] Master 127.24.116.254:45097 requested a full tablet report, sending...
I20260808 02:33:09.425593 10248 ts_manager.cc:194] Registered new tserver with Master: 140fc460bdf54d95b84bbc319356d5a9 (127.24.116.195:38905)
I20260808 02:33:09.426738 10248 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.195@KRBTEST.COM'} at 127.24.116.195:48975
I20260808 02:33:09.428818 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:33:09.451946 11014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:33:09.433887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40082 (local address 127.24.116.254:45097)
0808 02:33:09.434059 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 02:33:09.434063 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:33:09.436885 (+ 2822us) server_negotiation.cc:407] Connection header received
0808 02:33:09.437053 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:33:09.437059 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:33:09.437160 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:33:09.437266 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:33:09.438781 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.439932 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.441567 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.442212 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.442341 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:33:09.445136 (+ 2795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:33:09.445142 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:33:09.445147 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:33:09.445188 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:33:09.448687 (+ 3499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:33:09.449546 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:33:09.449552 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:33:09.449556 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:33:09.449719 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:33:09.450196 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:33:09.450202 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:33:09.450205 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:33:09.450573 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:33:09.450894 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0808 02:33:09.451321 (+ 427us) server_negotiation.cc:299] Negotiation successful
0808 02:33:09.451581 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 02:33:09.457504 10244 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40082:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:33:09.468432 10244 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:33:09.523471 11028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:33:09.483788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:41121 (local address 127.0.0.1:49890)
0808 02:33:09.511955 (+ 28167us) negotiation.cc:107] Waiting for socket to connect
0808 02:33:09.511983 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 02:33:09.512142 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:33:09.514316 (+ 2174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:33:09.514321 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:33:09.514356 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:33:09.514890 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:33:09.514905 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.517594 (+ 2689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.517600 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:33:09.519985 (+ 2385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:33:09.520006 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.522494 (+ 2488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.522501 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:33:09.522710 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:33:09.522761 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 02:33:09.522907 (+ 146us) client_negotiation.cc:240] Negotiation successful
0808 02:33:09.523095 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27980,"thread_start_us":27779,"threads_started":1}
I20260808 02:33:09.524902 11032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:33:09.484612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49890 (local address 127.24.116.193:41121)
0808 02:33:09.512891 (+ 28279us) server_negotiation.cc:206] Beginning negotiation
0808 02:33:09.512901 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:33:09.512935 (+ 34us) server_negotiation.cc:407] Connection header received
0808 02:33:09.513055 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:33:09.513064 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:33:09.513327 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:33:09.513568 (+ 241us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:33:09.515603 (+ 2035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.517351 (+ 1748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.520187 (+ 2836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.521958 (+ 1771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.522159 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:33:09.522340 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 02:33:09.524360 (+ 2020us) server_negotiation.cc:299] Negotiation successful
0808 02:33:09.524539 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28059,"thread_start_us":28399,"threads_started":1}
I20260808 02:33:09.525058 11029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:33:09.483454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:41113 (local address 127.0.0.1:33324)
0808 02:33:09.509743 (+ 26289us) negotiation.cc:107] Waiting for socket to connect
0808 02:33:09.509809 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 02:33:09.510120 (+ 311us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:33:09.513552 (+ 3432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:33:09.513565 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:33:09.513618 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:33:09.514301 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:33:09.514315 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.516671 (+ 2356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.516680 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:33:09.519780 (+ 3100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:33:09.519798 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.523556 (+ 3758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.523564 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:33:09.523760 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:33:09.523811 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 02:33:09.523895 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 02:33:09.524074 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25923,"mutex_wait_us":1,"thread_start_us":30552,"threads_started":1}
I20260808 02:33:09.526010 11035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:33:09.485151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51310 (local address 127.24.116.195:38905)
0808 02:33:09.508675 (+ 23524us) server_negotiation.cc:206] Beginning negotiation
0808 02:33:09.508690 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 02:33:09.514493 (+ 5803us) server_negotiation.cc:407] Connection header received
0808 02:33:09.514860 (+ 367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:33:09.514869 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:33:09.515099 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:33:09.515275 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:33:09.517671 (+ 2396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.519490 (+ 1819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.522309 (+ 2819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.523946 (+ 1637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.524109 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:33:09.524322 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 02:33:09.525441 (+ 1119us) server_negotiation.cc:299] Negotiation successful
0808 02:33:09.525614 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23236,"thread_start_us":23545,"threads_started":1}
I20260808 02:33:09.526290 11034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:33:09.483932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33324 (local address 127.24.116.194:41113)
0808 02:33:09.512765 (+ 28833us) server_negotiation.cc:206] Beginning negotiation
0808 02:33:09.512775 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:33:09.512811 (+ 36us) server_negotiation.cc:407] Connection header received
0808 02:33:09.512925 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:33:09.512934 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:33:09.513228 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:33:09.514590 (+ 1362us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:33:09.514860 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.516547 (+ 1687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.521360 (+ 4813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.523232 (+ 1872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.525478 (+ 2246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:33:09.525646 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 02:33:09.525716 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 02:33:09.525919 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28633,"thread_start_us":29309,"threads_started":1}
I20260808 02:33:09.527097 11027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:33:09.484442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:38905 (local address 127.0.0.1:51310)
0808 02:33:09.514343 (+ 29901us) negotiation.cc:107] Waiting for socket to connect
0808 02:33:09.514367 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 02:33:09.514624 (+ 257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:33:09.516779 (+ 2155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:33:09.516786 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:33:09.516824 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:33:09.517348 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:33:09.517361 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.519756 (+ 2395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.519762 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:33:09.522093 (+ 2331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:33:09.522109 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.524942 (+ 2833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.524950 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:33:09.525171 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:33:09.525207 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 02:33:09.526562 (+ 1355us) client_negotiation.cc:240] Negotiation successful
0808 02:33:09.526717 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29760,"mutex_wait_us":5,"thread_start_us":26107,"threads_started":1}
I20260808 02:33:09.530395 10483 tablet_service.cc:1467] Processing CreateTablet for tablet 4dd56e2f094940f3b8a5a023da972668 (DEFAULT_TABLE table=test-table [id=50692e2994af45b5a4663b846a1807c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:33:09.530393 10697 tablet_service.cc:1467] Processing CreateTablet for tablet 4dd56e2f094940f3b8a5a023da972668 (DEFAULT_TABLE table=test-table [id=50692e2994af45b5a4663b846a1807c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:33:09.531000 10910 tablet_service.cc:1467] Processing CreateTablet for tablet 4dd56e2f094940f3b8a5a023da972668 (DEFAULT_TABLE table=test-table [id=50692e2994af45b5a4663b846a1807c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:33:09.532351 10697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dd56e2f094940f3b8a5a023da972668. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:33:09.532353 10483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dd56e2f094940f3b8a5a023da972668. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:33:09.532708 10910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dd56e2f094940f3b8a5a023da972668. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:33:09.545133 11038 tablet_bootstrap.cc:492] T 4dd56e2f094940f3b8a5a023da972668 P 140fc460bdf54d95b84bbc319356d5a9: Bootstrap starting.
I20260808 02:33:09.549213 11039 tablet_bootstrap.cc:492] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00: Bootstrap starting.
I20260808 02:33:09.549589 11038 tablet_bootstrap.cc:654] T 4dd56e2f094940f3b8a5a023da972668 P 140fc460bdf54d95b84bbc319356d5a9: Neither blocks nor log segments found. Creating new log.
I20260808 02:33:09.551126 11038 log.cc:824] T 4dd56e2f094940f3b8a5a023da972668 P 140fc460bdf54d95b84bbc319356d5a9: Log is configured to *not* fsync() on all Append() calls
I20260808 02:33:09.552804 11042 tablet_bootstrap.cc:492] T 4dd56e2f094940f3b8a5a023da972668 P 927c35c01d9546ad89ae1c0ccbe79b05: Bootstrap starting.
I20260808 02:33:09.553669 11039 tablet_bootstrap.cc:654] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00: Neither blocks nor log segments found. Creating new log.
I20260808 02:33:09.554566 11038 tablet_bootstrap.cc:492] T 4dd56e2f094940f3b8a5a023da972668 P 140fc460bdf54d95b84bbc319356d5a9: No bootstrap required, opened a new log
I20260808 02:33:09.554853 11038 ts_tablet_manager.cc:1397] T 4dd56e2f094940f3b8a5a023da972668 P 140fc460bdf54d95b84bbc319356d5a9: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 02:33:09.555142 11039 log.cc:824] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00: Log is configured to *not* fsync() on all Append() calls
I20260808 02:33:09.556942 11042 tablet_bootstrap.cc:654] T 4dd56e2f094940f3b8a5a023da972668 P 927c35c01d9546ad89ae1c0ccbe79b05: Neither blocks nor log segments found. Creating new log.
I20260808 02:33:09.558162 11042 log.cc:824] T 4dd56e2f094940f3b8a5a023da972668 P 927c35c01d9546ad89ae1c0ccbe79b05: Log is configured to *not* fsync() on all Append() calls
I20260808 02:33:09.558511 11039 tablet_bootstrap.cc:492] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00: No bootstrap required, opened a new log
I20260808 02:33:09.558796 11039 ts_tablet_manager.cc:1397] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 02:33:09.561079 11042 tablet_bootstrap.cc:492] T 4dd56e2f094940f3b8a5a023da972668 P 927c35c01d9546ad89ae1c0ccbe79b05: No bootstrap required, opened a new log
I20260808 02:33:09.561372 11042 ts_tablet_manager.cc:1397] T 4dd56e2f094940f3b8a5a023da972668 P 927c35c01d9546ad89ae1c0ccbe79b05: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 02:33:09.566533 11038 raft_consensus.cc:348] T 4dd56e2f094940f3b8a5a023da972668 P 140fc460bdf54d95b84bbc319356d5a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "927c35c01d9546ad89ae1c0ccbe79b05" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 41113 } } peers { permanent_uuid: "fa26b5ebb52b490a80086288efc60a00" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41121 } } peers { permanent_uuid: "140fc460bdf54d95b84bbc319356d5a9" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38905 } }
I20260808 02:33:09.567050 11038 raft_consensus.cc:374] T 4dd56e2f094940f3b8a5a023da972668 P 140fc460bdf54d95b84bbc319356d5a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:33:09.567176 11038 raft_consensus.cc:729] T 4dd56e2f094940f3b8a5a023da972668 P 140fc460bdf54d95b84bbc319356d5a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 140fc460bdf54d95b84bbc319356d5a9, State: Initialized, Role: FOLLOWER
I20260808 02:33:09.567950 11038 consensus_queue.cc:260] T 4dd56e2f094940f3b8a5a023da972668 P 140fc460bdf54d95b84bbc319356d5a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "927c35c01d9546ad89ae1c0ccbe79b05" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 41113 } } peers { permanent_uuid: "fa26b5ebb52b490a80086288efc60a00" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41121 } } peers { permanent_uuid: "140fc460bdf54d95b84bbc319356d5a9" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38905 } }
I20260808 02:33:09.569555 11012 heartbeater.cc:503] Master 127.24.116.254:45097 was elected leader, sending a full tablet report...
I20260808 02:33:09.569840 11039 raft_consensus.cc:348] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "927c35c01d9546ad89ae1c0ccbe79b05" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 41113 } } peers { permanent_uuid: "fa26b5ebb52b490a80086288efc60a00" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41121 } } peers { permanent_uuid: "140fc460bdf54d95b84bbc319356d5a9" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38905 } }
I20260808 02:33:09.570364 11039 raft_consensus.cc:374] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:33:09.570490 11038 ts_tablet_manager.cc:1428] T 4dd56e2f094940f3b8a5a023da972668 P 140fc460bdf54d95b84bbc319356d5a9: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260808 02:33:09.570515 11039 raft_consensus.cc:729] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa26b5ebb52b490a80086288efc60a00, State: Initialized, Role: FOLLOWER
I20260808 02:33:09.570393 11042 raft_consensus.cc:348] T 4dd56e2f094940f3b8a5a023da972668 P 927c35c01d9546ad89ae1c0ccbe79b05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "927c35c01d9546ad89ae1c0ccbe79b05" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 41113 } } peers { permanent_uuid: "fa26b5ebb52b490a80086288efc60a00" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41121 } } peers { permanent_uuid: "140fc460bdf54d95b84bbc319356d5a9" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38905 } }
I20260808 02:33:09.571025 11042 raft_consensus.cc:374] T 4dd56e2f094940f3b8a5a023da972668 P 927c35c01d9546ad89ae1c0ccbe79b05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:33:09.571204 11042 raft_consensus.cc:729] T 4dd56e2f094940f3b8a5a023da972668 P 927c35c01d9546ad89ae1c0ccbe79b05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 927c35c01d9546ad89ae1c0ccbe79b05, State: Initialized, Role: FOLLOWER
I20260808 02:33:09.571267 11039 consensus_queue.cc:260] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "927c35c01d9546ad89ae1c0ccbe79b05" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 41113 } } peers { permanent_uuid: "fa26b5ebb52b490a80086288efc60a00" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41121 } } peers { permanent_uuid: "140fc460bdf54d95b84bbc319356d5a9" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38905 } }
I20260808 02:33:09.571900 11042 consensus_queue.cc:260] T 4dd56e2f094940f3b8a5a023da972668 P 927c35c01d9546ad89ae1c0ccbe79b05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "927c35c01d9546ad89ae1c0ccbe79b05" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 41113 } } peers { permanent_uuid: "fa26b5ebb52b490a80086288efc60a00" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41121 } } peers { permanent_uuid: "140fc460bdf54d95b84bbc319356d5a9" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38905 } }
I20260808 02:33:09.573261 11039 ts_tablet_manager.cc:1428] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260808 02:33:09.575392 10802 heartbeater.cc:503] Master 127.24.116.254:45097 was elected leader, sending a full tablet report...
I20260808 02:33:09.576085 11042 ts_tablet_manager.cc:1428] T 4dd56e2f094940f3b8a5a023da972668 P 927c35c01d9546ad89ae1c0ccbe79b05: Time spent starting tablet: real 0.015s user 0.011s sys 0.004s
W20260808 02:33:09.645889 10582 tablet.cc:2369] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:33:09.646675 11013 tablet.cc:2369] T 4dd56e2f094940f3b8a5a023da972668 P 140fc460bdf54d95b84bbc319356d5a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:33:09.679776 11053 raft_consensus.cc:482] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:33:09.680073 11053 raft_consensus.cc:504] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "927c35c01d9546ad89ae1c0ccbe79b05" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 41113 } } peers { permanent_uuid: "fa26b5ebb52b490a80086288efc60a00" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41121 } } peers { permanent_uuid: "140fc460bdf54d95b84bbc319356d5a9" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38905 } }
I20260808 02:33:09.681972 11053 leader_election.cc:288] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 927c35c01d9546ad89ae1c0ccbe79b05 (127.24.116.194:41113), 140fc460bdf54d95b84bbc319356d5a9 (127.24.116.195:38905)
I20260808 02:33:09.689668 11034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:33:09.682567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:58595 (local address 127.24.116.194:41113)
0808 02:33:09.682822 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 02:33:09.682831 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:33:09.683615 (+ 784us) server_negotiation.cc:407] Connection header received
0808 02:33:09.683843 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:33:09.683848 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:33:09.683916 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:33:09.684019 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:33:09.684726 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.685448 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.687399 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.688639 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.688817 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:33:09.688900 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 02:33:09.689219 (+ 319us) server_negotiation.cc:299] Negotiation successful
0808 02:33:09.689369 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 02:33:09.689800 11055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:33:09.682182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:41113 (local address 127.24.116.193:58595)
0808 02:33:09.683499 (+ 1317us) negotiation.cc:107] Waiting for socket to connect
0808 02:33:09.683515 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 02:33:09.683689 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:33:09.684045 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:33:09.684049 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:33:09.684076 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:33:09.684574 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:33:09.684588 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.685581 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.685588 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:33:09.687211 (+ 1623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:33:09.687223 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.688841 (+ 1618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.688847 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:33:09.689032 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:33:09.689071 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 02:33:09.689172 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 02:33:09.689311 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1145,"spinlock_wait_cycles":26368,"thread_start_us":819,"threads_started":1}
I20260808 02:33:09.690483 11056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:33:09.682519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:38905 (local address 127.24.116.193:46893)
0808 02:33:09.683492 (+ 973us) negotiation.cc:107] Waiting for socket to connect
0808 02:33:09.683514 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:33:09.683737 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:33:09.684117 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:33:09.684122 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:33:09.684150 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:33:09.684720 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:33:09.684738 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.685728 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.685734 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:33:09.687891 (+ 2157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:33:09.687906 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.689760 (+ 1854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.689768 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:33:09.689951 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:33:09.689986 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 02:33:09.690090 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 02:33:09.690214 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":861,"spinlock_wait_cycles":24960,"thread_start_us":546,"threads_started":1}
I20260808 02:33:09.690579 11035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:33:09.682457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:46893 (local address 127.24.116.195:38905)
0808 02:33:09.682679 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 02:33:09.682687 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:33:09.683629 (+ 942us) server_negotiation.cc:407] Connection header received
0808 02:33:09.683937 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:33:09.683942 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:33:09.684002 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:33:09.684105 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:33:09.684888 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.685581 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.688060 (+ 2479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.689347 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.689504 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:33:09.689576 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 02:33:09.690187 (+ 611us) server_negotiation.cc:299] Negotiation successful
0808 02:33:09.690336 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260808 02:33:09.691571 10803 tablet.cc:2369] T 4dd56e2f094940f3b8a5a023da972668 P 927c35c01d9546ad89ae1c0ccbe79b05: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:33:09.691908 10946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dd56e2f094940f3b8a5a023da972668" candidate_uuid: "fa26b5ebb52b490a80086288efc60a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "140fc460bdf54d95b84bbc319356d5a9" is_pre_election: true
I20260808 02:33:09.691975 10729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dd56e2f094940f3b8a5a023da972668" candidate_uuid: "fa26b5ebb52b490a80086288efc60a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "927c35c01d9546ad89ae1c0ccbe79b05" is_pre_election: true
I20260808 02:33:09.692525 10729 raft_consensus.cc:2454] T 4dd56e2f094940f3b8a5a023da972668 P 927c35c01d9546ad89ae1c0ccbe79b05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa26b5ebb52b490a80086288efc60a00 in term 0.
I20260808 02:33:09.692543 10946 raft_consensus.cc:2454] T 4dd56e2f094940f3b8a5a023da972668 P 140fc460bdf54d95b84bbc319356d5a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa26b5ebb52b490a80086288efc60a00 in term 0.
I20260808 02:33:09.693326 10420 leader_election.cc:302] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 927c35c01d9546ad89ae1c0ccbe79b05, fa26b5ebb52b490a80086288efc60a00; no voters:
I20260808 02:33:09.693765 11053 raft_consensus.cc:2781] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:33:09.693920 11053 raft_consensus.cc:482] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:33:09.694026 11053 raft_consensus.cc:3037] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:33:09.696240 11053 raft_consensus.cc:504] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "927c35c01d9546ad89ae1c0ccbe79b05" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 41113 } } peers { permanent_uuid: "fa26b5ebb52b490a80086288efc60a00" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41121 } } peers { permanent_uuid: "140fc460bdf54d95b84bbc319356d5a9" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38905 } }
I20260808 02:33:09.697014 11053 leader_election.cc:288] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00 [CANDIDATE]: Term 1 election: Requested vote from peers 927c35c01d9546ad89ae1c0ccbe79b05 (127.24.116.194:41113), 140fc460bdf54d95b84bbc319356d5a9 (127.24.116.195:38905)
I20260808 02:33:09.697412 10729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dd56e2f094940f3b8a5a023da972668" candidate_uuid: "fa26b5ebb52b490a80086288efc60a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "927c35c01d9546ad89ae1c0ccbe79b05"
I20260808 02:33:09.697610 10729 raft_consensus.cc:3037] T 4dd56e2f094940f3b8a5a023da972668 P 927c35c01d9546ad89ae1c0ccbe79b05 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:33:09.700565 10946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dd56e2f094940f3b8a5a023da972668" candidate_uuid: "fa26b5ebb52b490a80086288efc60a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "140fc460bdf54d95b84bbc319356d5a9"
I20260808 02:33:09.700794 10946 raft_consensus.cc:3037] T 4dd56e2f094940f3b8a5a023da972668 P 140fc460bdf54d95b84bbc319356d5a9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:33:09.701037 10729 raft_consensus.cc:2454] T 4dd56e2f094940f3b8a5a023da972668 P 927c35c01d9546ad89ae1c0ccbe79b05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa26b5ebb52b490a80086288efc60a00 in term 1.
I20260808 02:33:09.701436 10420 leader_election.cc:302] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 927c35c01d9546ad89ae1c0ccbe79b05, fa26b5ebb52b490a80086288efc60a00; no voters:
I20260808 02:33:09.701766 11053 raft_consensus.cc:2781] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:33:09.702272 11053 raft_consensus.cc:686] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00 [term 1 LEADER]: Becoming Leader. State: Replica: fa26b5ebb52b490a80086288efc60a00, State: Running, Role: LEADER
I20260808 02:33:09.702877 11053 consensus_queue.cc:237] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "927c35c01d9546ad89ae1c0ccbe79b05" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 41113 } } peers { permanent_uuid: "fa26b5ebb52b490a80086288efc60a00" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41121 } } peers { permanent_uuid: "140fc460bdf54d95b84bbc319356d5a9" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38905 } }
I20260808 02:33:09.703940 10946 raft_consensus.cc:2454] T 4dd56e2f094940f3b8a5a023da972668 P 140fc460bdf54d95b84bbc319356d5a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa26b5ebb52b490a80086288efc60a00 in term 1.
I20260808 02:33:09.708485 10243 catalog_manager.cc:5495] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa26b5ebb52b490a80086288efc60a00 (127.24.116.193). New cstate: current_term: 1 leader_uuid: "fa26b5ebb52b490a80086288efc60a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "927c35c01d9546ad89ae1c0ccbe79b05" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 41113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa26b5ebb52b490a80086288efc60a00" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "140fc460bdf54d95b84bbc319356d5a9" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38905 } health_report { overall_health: UNKNOWN } } }
I20260808 02:33:09.768010 11032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:33:09.762818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49900 (local address 127.24.116.193:41121)
0808 02:33:09.763025 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 02:33:09.763030 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:33:09.763048 (+ 18us) server_negotiation.cc:407] Connection header received
0808 02:33:09.763138 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:33:09.763142 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:33:09.763217 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:33:09.763353 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:33:09.763706 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.764454 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.765983 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.766376 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.766466 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:33:09.766981 (+ 515us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:33:09.767508 (+ 527us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:33:09.767628 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 02:33:09.767735 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 02:33:09.767799 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 02:33:09.776367 10946 raft_consensus.cc:1261] T 4dd56e2f094940f3b8a5a023da972668 P 140fc460bdf54d95b84bbc319356d5a9 [term 1 FOLLOWER]: Refusing update from remote peer fa26b5ebb52b490a80086288efc60a00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:33:09.776444 10729 raft_consensus.cc:1261] T 4dd56e2f094940f3b8a5a023da972668 P 927c35c01d9546ad89ae1c0ccbe79b05 [term 1 FOLLOWER]: Refusing update from remote peer fa26b5ebb52b490a80086288efc60a00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:33:09.777387 11053 consensus_queue.cc:1035] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "927c35c01d9546ad89ae1c0ccbe79b05" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 41113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:33:09.777716 11058 consensus_queue.cc:1035] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "140fc460bdf54d95b84bbc319356d5a9" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 38905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:33:09.805522 10244 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40082:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:33:09.805857 10244 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40082:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:33:09.810055 10244 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7464ffc97fce4e46810042e76cd08f40: Sending DeleteTablet for 3 replicas of tablet 4dd56e2f094940f3b8a5a023da972668
I20260808 02:33:09.811415 10483 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dd56e2f094940f3b8a5a023da972668 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:33:09 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:49890
I20260808 02:33:09.811411 10697 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dd56e2f094940f3b8a5a023da972668 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:33:09 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:33324
I20260808 02:33:09.811509 10910 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dd56e2f094940f3b8a5a023da972668 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:33:09 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:51310
I20260808 02:33:09.815598 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 10382
I20260808 02:33:09.824771 11076 tablet_replica.cc:330] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00: stopping tablet replica
I20260808 02:33:09.825410 11076 raft_consensus.cc:2229] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:33:09.826362 11076 raft_consensus.cc:2258] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:33:09.829716 11076 ts_tablet_manager.cc:1905] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:33:09.833884 11077 tablet_replica.cc:330] T 4dd56e2f094940f3b8a5a023da972668 P 927c35c01d9546ad89ae1c0ccbe79b05: stopping tablet replica
I20260808 02:33:09.834172 11078 tablet_replica.cc:330] T 4dd56e2f094940f3b8a5a023da972668 P 140fc460bdf54d95b84bbc319356d5a9: stopping tablet replica
I20260808 02:33:09.834718 11078 raft_consensus.cc:2229] T 4dd56e2f094940f3b8a5a023da972668 P 140fc460bdf54d95b84bbc319356d5a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:33:09.835328 11078 raft_consensus.cc:2258] T 4dd56e2f094940f3b8a5a023da972668 P 140fc460bdf54d95b84bbc319356d5a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:33:09.836586 11077 raft_consensus.cc:2229] T 4dd56e2f094940f3b8a5a023da972668 P 927c35c01d9546ad89ae1c0ccbe79b05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:33:09.837178 11077 raft_consensus.cc:2258] T 4dd56e2f094940f3b8a5a023da972668 P 927c35c01d9546ad89ae1c0ccbe79b05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:33:09.837797 11078 ts_tablet_manager.cc:1905] T 4dd56e2f094940f3b8a5a023da972668 P 140fc460bdf54d95b84bbc319356d5a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:33:09.838155 11076 ts_tablet_manager.cc:1918] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:33:09.838734 11076 log.cc:1196] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/4dd56e2f094940f3b8a5a023da972668
I20260808 02:33:09.839561 11076 ts_tablet_manager.cc:1939] T 4dd56e2f094940f3b8a5a023da972668 P fa26b5ebb52b490a80086288efc60a00: Deleting consensus metadata
I20260808 02:33:09.841938 10225 catalog_manager.cc:4841] TS fa26b5ebb52b490a80086288efc60a00 (127.24.116.193:41121): tablet 4dd56e2f094940f3b8a5a023da972668 (table test-table [id=50692e2994af45b5a4663b846a1807c0]) successfully deleted
I20260808 02:33:09.842645 11077 ts_tablet_manager.cc:1905] T 4dd56e2f094940f3b8a5a023da972668 P 927c35c01d9546ad89ae1c0ccbe79b05: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 02:33:09 dist-test-slave-45dx krb5kdc[9482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.193@KRBTEST.COM
I20260808 02:33:09.845636 11078 ts_tablet_manager.cc:1918] T 4dd56e2f094940f3b8a5a023da972668 P 140fc460bdf54d95b84bbc319356d5a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:33:09.845917 11078 log.cc:1196] T 4dd56e2f094940f3b8a5a023da972668 P 140fc460bdf54d95b84bbc319356d5a9: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/4dd56e2f094940f3b8a5a023da972668
I20260808 02:33:09.846509 11078 ts_tablet_manager.cc:1939] T 4dd56e2f094940f3b8a5a023da972668 P 140fc460bdf54d95b84bbc319356d5a9: Deleting consensus metadata
I20260808 02:33:09.848734 10224 catalog_manager.cc:4841] TS 140fc460bdf54d95b84bbc319356d5a9 (127.24.116.195:38905): tablet 4dd56e2f094940f3b8a5a023da972668 (table test-table [id=50692e2994af45b5a4663b846a1807c0]) successfully deleted
I20260808 02:33:09.850679 11077 ts_tablet_manager.cc:1918] T 4dd56e2f094940f3b8a5a023da972668 P 927c35c01d9546ad89ae1c0ccbe79b05: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:33:09.850881 11077 log.cc:1196] T 4dd56e2f094940f3b8a5a023da972668 P 927c35c01d9546ad89ae1c0ccbe79b05: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/4dd56e2f094940f3b8a5a023da972668
I20260808 02:33:09.851547 11077 ts_tablet_manager.cc:1939] T 4dd56e2f094940f3b8a5a023da972668 P 927c35c01d9546ad89ae1c0ccbe79b05: Deleting consensus metadata
I20260808 02:33:09.853681 10226 catalog_manager.cc:4841] TS 927c35c01d9546ad89ae1c0ccbe79b05 (127.24.116.194:41113): tablet 4dd56e2f094940f3b8a5a023da972668 (table test-table [id=50692e2994af45b5a4663b846a1807c0]) successfully deleted
I20260808 02:33:09.854007 11032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:33:09.817062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49910 (local address 127.24.116.193:41121)
0808 02:33:09.817299 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 02:33:09.817306 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:33:09.827427 (+ 10121us) server_negotiation.cc:407] Connection header received
0808 02:33:09.827889 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:33:09.827897 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:33:09.828032 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:33:09.828121 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:33:09.830128 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.831313 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.834129 (+ 2816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.834836 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:09.834953 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:33:09.845215 (+ 10262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:33:09.845232 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:33:09.845250 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:33:09.845317 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:33:09.849877 (+ 4560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:33:09.850985 (+ 1108us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:33:09.850996 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:33:09.851002 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:33:09.851231 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:33:09.851794 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:33:09.851801 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:33:09.851806 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:33:09.852370 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:33:09.852715 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0808 02:33:09.853106 (+ 391us) server_negotiation.cc:299] Negotiation successful
0808 02:33:09.853387 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 02:33:09.854851 10573 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:33:09.961197 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 10382
I20260808 02:33:09.994109 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 10592
Aug 08 02:33:10 dist-test-slave-45dx krb5kdc[9482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.194@KRBTEST.COM
I20260808 02:33:10.012565 11034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:33:09.994991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33338 (local address 127.24.116.194:41113)
0808 02:33:09.995279 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0808 02:33:09.995287 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:33:09.995311 (+ 24us) server_negotiation.cc:407] Connection header received
0808 02:33:09.995531 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:33:09.995541 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:33:09.995622 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:33:09.995744 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:33:09.997627 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:09.998535 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:10.000062 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:10.000570 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:10.000717 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:33:10.005804 (+ 5087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:33:10.005825 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:33:10.005845 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:33:10.005891 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:33:10.009256 (+ 3365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:33:10.010114 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:33:10.010122 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:33:10.010125 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:33:10.010271 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:33:10.010713 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:33:10.010719 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:33:10.010722 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:33:10.011154 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:33:10.011512 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0808 02:33:10.011861 (+ 349us) server_negotiation.cc:299] Negotiation successful
0808 02:33:10.012130 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123}
I20260808 02:33:10.013378 10794 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:33:10.106572 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 10592
I20260808 02:33:10.136063 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 10810
Aug 08 02:33:10 dist-test-slave-45dx krb5kdc[9482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.195@KRBTEST.COM
I20260808 02:33:10.151842 11035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:33:10.136951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51326 (local address 127.24.116.195:38905)
0808 02:33:10.137136 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 02:33:10.137140 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:33:10.137160 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:33:10.137315 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:33:10.137319 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:33:10.137397 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:33:10.137482 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:33:10.138832 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:10.139568 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:10.140963 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:10.141350 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:10.141449 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:33:10.145979 (+ 4530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:33:10.145995 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:33:10.146013 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:33:10.146051 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:33:10.149236 (+ 3185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:33:10.149963 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:33:10.149971 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:33:10.149973 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:33:10.150111 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:33:10.150459 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:33:10.150463 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:33:10.150464 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:33:10.150855 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:33:10.151077 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 02:33:10.151371 (+ 294us) server_negotiation.cc:299] Negotiation successful
0808 02:33:10.151538 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 02:33:10.152582 11005 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:33:10.244006 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 10810
I20260808 02:33:10.271659 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 10195
I20260808 02:33:10.273138 10292 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:33:10.389386 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 10195
I20260808 02:33:10.425153 25043 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 02:33:10.771174 25043 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 02:33:10.771554 25043 mini_ranger.cc:66] Stopping Ranger...
I20260808 02:33:11.127478 25043 mini_ranger.cc:68] Stopped Ranger
2026-08-08 02:33:11.127 UTC [9536] LOG: received smart shutdown request
2026-08-08 02:33:11.131 UTC [9536] LOG: background worker "logical replication launcher" (PID 9553) exited with exit code 1
2026-08-08 02:33:11.132 UTC [9544] LOG: shutting down
2026-08-08 02:33:11.311 UTC [9536] LOG: database system is shut down
2026-08-08T02:33:11Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (53932 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:33:11 dist-test-slave-45dx krb5kdc[11100](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:33:11 dist-test-slave-45dx krb5kdc[11100](info): set up 2 sockets
Aug 08 02:33:11 dist-test-slave-45dx krb5kdc[11100](info): commencing operation
krb5kdc: starting...
W20260808 02:33:12.805747 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.306s user 0.001s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:33:12 dist-test-slave-45dx krb5kdc[11100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:33:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:33:13Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.24.116.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.24.116.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.24.116.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/rangeradmin_127.24.116.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.24.116.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/rangeradmin_127.24.116.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.24.116.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.24.116.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.24.116.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/rangerlookup_127.24.116.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.24.116.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/rangerlookup_127.24.116.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.24.116.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.24.116.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.24.116.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/HTTP_127.24.116.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.24.116.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/HTTP_127.24.116.212@KRBTEST.COM.keytab.
I20260808 02:33:13.242990 25043 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task5C7FBY/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/postgres -l logfile start
2026-08-08 02:33:15.946 UTC [11146] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 02:33:15.946 UTC [11146] LOG: listening on IPv4 address "127.24.116.212", port 54195
2026-08-08 02:33:15.950 UTC [11146] LOG: listening on Unix socket "/tmp/.s.PGSQL.54195"
2026-08-08 02:33:15.975 UTC [11148] LOG: database system was shut down at 2026-08-08 02:33:14 UTC
2026-08-08 02:33:15.979 UTC [11146] LOG: database system is ready to accept connections
I20260808 02:33:17.185065 25043 mini_postgres.cc:96] Postgres bound to 54195
2026-08-08 02:33:17.210 UTC [11161] FATAL: database "slave" does not exist
127.24.116.212:54195 - accepting connections
I20260808 02:33:17.211737 25043 mini_ranger.cc:161] Starting Ranger...
I20260808 02:33:17.247352 25043 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 02:33:17.804563 25043 mini_ranger.cc:87] Created ranger Postgres database
I20260808 02:33:17.804708 25043 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ranger-admin
2026-08-08 02:33:18,122 [I] DB FLAVOR :POSTGRES
2026-08-08 02:33:18,123 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 02:33:18,123 [I] Checking connection..
2026-08-08 02:33:18,123 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:54195/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 02:33:18,407 [I] Checking connection passed.
2026-08-08 02:33:18,408 [I] --------- Verifying version history table ---------
2026-08-08 02:33:18,408 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:54195/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 02:33:18,698 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 02:33:18,699 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:54195/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 02:33:18,968 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 02:33:18,968 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 02:33:18,969 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:54195/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 02:33:19.226 UTC [11262] WARNING: there is no transaction in progress
2026-08-08 02:33:19,236 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 02:33:19,236 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:54195/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 02:33:19,524 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 02:33:19,524 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 02:33:19,524 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:54195/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 02:33:19,790 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:54195/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 02:33:20,066 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:54195/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-45dx.c.gcp-upstream.internal','N') ;"
2026-08-08 02:33:20,319 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:54195/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 02:33:20,571 [I] Table x_portal_user does not exist in database ranger
2026-08-08 02:33:20,571 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:54195/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 02:33:20,826 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 02:33:20,826 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:54195/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 02:33:21,102 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:54195/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 02:33:21,353 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 02:33:21,353 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:54195/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 02:33:22.372 UTC [11428] WARNING: there is no transaction in progress
2026-08-08 02:33:22.389 UTC [11428] WARNING: there is no transaction in progress
2026-08-08 02:33:22.406 UTC [11428] WARNING: there is no transaction in progress
2026-08-08 02:33:22.421 UTC [11428] WARNING: there is no transaction in progress
2026-08-08 02:33:22.439 UTC [11428] WARNING: there is no transaction in progress
2026-08-08 02:33:22.458 UTC [11428] WARNING: there is no transaction in progress
2026-08-08 02:33:22.521 UTC [11428] WARNING: there is no transaction in progress
2026-08-08 02:33:22.527 UTC [11428] WARNING: there is no transaction in progress
2026-08-08 02:33:22.542 UTC [11428] WARNING: there is no transaction in progress
2026-08-08 02:33:22.552 UTC [11428] WARNING: there is no transaction in progress
2026-08-08 02:33:22.563 UTC [11428] WARNING: there is no transaction in progress
2026-08-08 02:33:22.578 UTC [11428] WARNING: there is no transaction in progress
2026-08-08 02:33:22.587 UTC [11428] WARNING: there is no transaction in progress
2026-08-08 02:33:22.594 UTC [11428] WARNING: there is no transaction in progress
2026-08-08 02:33:22.601 UTC [11428] WARNING: there is no transaction in progress
2026-08-08 02:33:22.608 UTC [11428] WARNING: there is no transaction in progress
2026-08-08 02:33:23,260 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 02:33:23,261 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:54195/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 02:33:23,531 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 02:33:23,532 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:54195/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 02:33:23,803 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 02:33:23,803 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:54195/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 02:33:24,072 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 02:33:24,072 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:54195/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 02:33:24,329 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:54195/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 02:33:24,607 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:54195/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-45dx.c.gcp-upstream.internal';"
2026-08-08 02:33:24,873 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 02:33:24,874 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:54195/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 02:33:25,125 [I] DB_PATCHES have already been applied
I20260808 02:33:25.131880 25043 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ranger-admin:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task5C7FBY/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 02:33:25.131973 25043 mini_ranger.cc:193] Using host: 127.24.116.212
I20260808 02:33:25.154415 25043 mini_ranger.cc:227] Ranger admin URL: http://127.24.116.212:56895
Aug 08, 2026 2:33:25 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:33:25 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:33:25 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 2:33:25 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 2:33:25 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 2:33:26 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 2:33:26 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 02:33:26.566428 25043 mini_ranger.cc:160] Time spent starting Ranger: real 9.355s user 0.003s sys 0.063s
Aug 08, 2026 2:33:47 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 2:33:47 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 08, 2026 2:33:47 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 2:33:47 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 2:33:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 2:33:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 2:33:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 2:33:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 2:33:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 2:33:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 2:33:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 2:33:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 2:33:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 2:33:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 2:33:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 2:33:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 2:33:47 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 2:33:48 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 02:33:49.059278 25043 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.24.116.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.24.116.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.24.116.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/rangerkms_127.24.116.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.24.116.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/rangerkms_127.24.116.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.24.116.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.24.116.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.24.116.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/HTTP_127.24.116.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.24.116.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/HTTP_127.24.116.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 02:33:49 dist-test-slave-45dx krb5kdc[11100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156429, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 02:33:49.288153 25043 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 02:33:49.314854 25043 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 02:33:50.208370 25043 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 02:33:50.208494 25043 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ranger-kms
I20260808 02:33:50.208537 25043 mini_ranger_kms.cc:227] Using postgres at 127.24.116.212:54195
2026-08-08 02:33:50,625 [I] DB FLAVOR :POSTGRES
2026-08-08 02:33:50,625 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 02:33:50,625 [I] Checking connection
2026-08-08 02:33:50,626 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:54195/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 02:33:50,902 [I] connection success
2026-08-08 02:33:50,903 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 02:33:50,903 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 02:33:50,903 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:54195/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 02:33:51,198 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 02:33:51,199 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 02:33:51,199 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 02:33:51,199 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.116.212:54195/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 02:33:51,534 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 02:33:52.026580 25043 mini_ranger_kms.cc:310] Created kms service
I20260808 02:33:52.257805 25043 mini_ranger_kms.cc:326] Created kudu user
I20260808 02:33:52.307552 25043 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 02:33:52 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156429, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.24.116.212@KRBTEST.COM
I20260808 02:33:52.709932 25043 mini_ranger_kms.cc:384] Added ranger policy
I20260808 02:33:52.710317 25043 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ranger-kms:/tmp/dist-test-task5C7FBY/build/asan/bin/postgresql.jar:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task5C7FBY/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 02:33:52.710378 25043 mini_ranger_kms.cc:240] Using host: 127.24.116.212
I20260808 02:33:52.737691 25043 mini_ranger_kms.cc:276] Ranger KMS PID: 11714
I20260808 02:33:52.737844 25043 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.24.116.212:55997
Aug 08, 2026 2:33:53 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:33:53 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:33:53 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 2:33:53 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 2:33:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 2:33:54 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 02:33:55 dist-test-slave-45dx krb5kdc[11100](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786156435, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.116.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:33:55.579596 25043 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.291s user 0.065s sys 0.390s
I20260808 02:33:55.579870 25043 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 02:33:55.580062 25043 mini_ranger_kms.cc:401] 127.24.116.212:55997/kms/v1/keys
Aug 08 02:33:55 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156435, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.116.212@KRBTEST.COM for HTTP/127.24.116.212@KRBTEST.COM
Aug 08 02:33:56 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156435, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.116.212@KRBTEST.COM for HTTP/127.24.116.212@KRBTEST.COM
Aug 08 02:33:58 dist-test-slave-45dx krb5kdc[11100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:33:58.600917 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:42935
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:43721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:42935
--ranger_config_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.116.212:55997/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:33:58.967258 11794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:33:58.967551 11794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:33:58.967720 11794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:33:58.975019 11794 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:33:58.975132 11794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:33:58.975224 11794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:33:58.975317 11794 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:33:58.975410 11794 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:33:58.985656 11794 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:43721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/wal
--ranger_kms_url=127.24.116.212:55997/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:42935
--ranger_config_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:42935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:33:58.987023 11794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:33:58.988440 11794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:33:59.000989 11807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:33:59.000962 11803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:33:59.001253 11810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:33:59.002390 11794 server_base.cc:1034] running on GCE node
I20260808 02:33:59.003264 11794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:33:59.004828 11794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:33:59.006080 11794 hybrid_clock.cc:648] HybridClock initialized: now 1786156439006037 us; error 36 us; skew 500 ppm
I20260808 02:33:59.006508 11794 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:33:59 dist-test-slave-45dx krb5kdc[11100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156439, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:33:59.014922 11794 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:33:59.016583 11794 webserver.cc:460] Webserver started at http://127.24.116.254:38235/ using document root <none> and password file <none>
I20260808 02:33:59.017316 11794 fs_manager.cc:359] Metadata directory not provided
I20260808 02:33:59.017468 11794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:33:59.017805 11794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 02:33:59 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156439, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for HTTP/127.24.116.212@KRBTEST.COM
I20260808 02:33:59.086335 11794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "bd388ed5b9d54d09a5f521c28b30350a"
format_stamp: "Formatted at 2026-08-08 02:33:59 on dist-test-slave-45dx"
server_key: "8c119f34739d7d3df5510c01d69395e6"
server_key_iv: "ae74426eca45e34e246487e8ab4084b1"
server_key_version: "kuduclusterkey@0"
I20260808 02:33:59.087229 11794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "bd388ed5b9d54d09a5f521c28b30350a"
format_stamp: "Formatted at 2026-08-08 02:33:59 on dist-test-slave-45dx"
server_key: "8c119f34739d7d3df5510c01d69395e6"
server_key_iv: "ae74426eca45e34e246487e8ab4084b1"
server_key_version: "kuduclusterkey@0"
I20260808 02:33:59.093081 11794 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 02:33:59.114315 11824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:33:59.116545 11794 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 02:33:59.116775 11794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "bd388ed5b9d54d09a5f521c28b30350a"
format_stamp: "Formatted at 2026-08-08 02:33:59 on dist-test-slave-45dx"
server_key: "8c119f34739d7d3df5510c01d69395e6"
server_key_iv: "ae74426eca45e34e246487e8ab4084b1"
server_key_version: "kuduclusterkey@0"
I20260808 02:33:59.117059 11794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:33:59.131363 11794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:33:59.135440 11794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:33:59.135778 11794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:33:59.155282 11794 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:42935
I20260808 02:33:59.155309 11894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:42935 every 8 connection(s)
I20260808 02:33:59.156850 11794 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:33:59.160936 11895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:33:59.166306 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 11794
I20260808 02:33:59.166582 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:33:59.167375 25043 external_mini_cluster.cc:1428] Setting key a63bb51e59b75717df7b262bfcb9bfcc
I20260808 02:33:59.172645 11895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a: Bootstrap starting.
I20260808 02:33:59.176621 11895 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a: Neither blocks nor log segments found. Creating new log.
I20260808 02:33:59.177950 11895 log.cc:824] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a: Log is configured to *not* fsync() on all Append() calls
I20260808 02:33:59.181788 11895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a: No bootstrap required, opened a new log
Aug 08 02:33:59 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:33:59.192811 11895 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd388ed5b9d54d09a5f521c28b30350a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42935 } }
I20260808 02:33:59.193317 11895 raft_consensus.cc:374] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:33:59.193449 11895 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd388ed5b9d54d09a5f521c28b30350a, State: Initialized, Role: FOLLOWER
I20260808 02:33:59.193994 11900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:33:59.169661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51194 (local address 127.24.116.254:42935)
0808 02:33:59.170581 (+ 920us) server_negotiation.cc:206] Beginning negotiation
0808 02:33:59.170593 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:33:59.170637 (+ 44us) server_negotiation.cc:407] Connection header received
0808 02:33:59.172447 (+ 1810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:33:59.172471 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:33:59.172912 (+ 441us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:33:59.173249 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:33:59.175111 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:59.176485 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:59.178411 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:33:59.179600 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:33:59.179739 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:33:59.184705 (+ 4966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:33:59.184716 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:33:59.184742 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:33:59.184804 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:33:59.189092 (+ 4288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:33:59.189800 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:33:59.189810 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:33:59.189819 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:33:59.190033 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:33:59.190459 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:33:59.190464 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:33:59.190468 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:33:59.191295 (+ 827us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:33:59.191623 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0808 02:33:59.192051 (+ 428us) server_negotiation.cc:299] Negotiation successful
0808 02:33:59.192514 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":697,"thread_start_us":449,"threads_started":1}
I20260808 02:33:59.194977 11895 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd388ed5b9d54d09a5f521c28b30350a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42935 } }
I20260808 02:33:59.195248 11895 raft_consensus.cc:388] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:33:59.195398 11895 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:33:59.195617 11895 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:33:59.198356 11895 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd388ed5b9d54d09a5f521c28b30350a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42935 } }
I20260808 02:33:59.198899 11895 leader_election.cc:302] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd388ed5b9d54d09a5f521c28b30350a; no voters:
I20260808 02:33:59.199690 11895 leader_election.cc:288] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:33:59.199807 11902 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:33:59.200584 11902 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [term 1 LEADER]: Becoming Leader. State: Replica: bd388ed5b9d54d09a5f521c28b30350a, State: Running, Role: LEADER
I20260808 02:33:59.201226 11902 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd388ed5b9d54d09a5f521c28b30350a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42935 } }
I20260808 02:33:59.202157 11895 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:33:59.204396 11905 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd388ed5b9d54d09a5f521c28b30350a. Latest consensus state: current_term: 1 leader_uuid: "bd388ed5b9d54d09a5f521c28b30350a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd388ed5b9d54d09a5f521c28b30350a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42935 } } }
I20260808 02:33:59.204502 11904 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bd388ed5b9d54d09a5f521c28b30350a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd388ed5b9d54d09a5f521c28b30350a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42935 } } }
I20260808 02:33:59.204835 11905 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [sys.catalog]: This master's current role is: LEADER
I20260808 02:33:59.204923 11904 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [sys.catalog]: This master's current role is: LEADER
I20260808 02:33:59.205839 11911 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:33:59.212124 11911 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:33:59.212888 11895 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 02:33:59.235446 11911 catalog_manager.cc:1347] Generated new cluster ID: c2235ce630f241f98e20e6d37fe4092c
I20260808 02:33:59.235612 11911 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:33:59.270366 11911 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:33:59.272480 11911 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:33:59.290169 11911 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a: Generated new TSK 0
I20260808 02:33:59.291415 11911 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.116.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
I20260808 02:34:00.035648 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.116.212:55997/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:42935
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:43721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 02:34:00 dist-test-slave-45dx krb5kdc[11100](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786156440, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 02:34:00.489496 11967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:00.489920 11967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:00.490142 11967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:00.501952 11967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:00.502101 11967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:00.502339 11967 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:34:00.518420 11967 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:43721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.24.116.212:55997/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:42935
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:00.520426 11967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:00.522390 11967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:00.539278 11984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:00.540433 11967 server_base.cc:1034] running on GCE node
W20260808 02:34:00.544677 11982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:00.544819 11986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:00.545642 11967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:00.546826 11967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:00.548112 11967 hybrid_clock.cc:648] HybridClock initialized: now 1786156440548045 us; error 65 us; skew 500 ppm
I20260808 02:34:00.548533 11967 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:00 dist-test-slave-45dx krb5kdc[11100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156440, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:00.551842 11967 init.cc:377] Logged in from keytab as kudu/127.24.116.193@KRBTEST.COM (short username kudu)
I20260808 02:34:00.553606 11967 webserver.cc:460] Webserver started at http://127.24.116.193:33107/ using document root <none> and password file <none>
I20260808 02:34:00.554365 11967 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:00.554553 11967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:34:00.555111 11967 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 02:34:00 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156440, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for HTTP/127.24.116.212@KRBTEST.COM
I20260808 02:34:00.573385 11967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "37a04eb915494d89849650a389693f09"
format_stamp: "Formatted at 2026-08-08 02:34:00 on dist-test-slave-45dx"
server_key: "f07a87b093a822e7d7d430e612ea495e"
server_key_iv: "9b19dec37d314b4a04d7aced4bf17635"
server_key_version: "kuduclusterkey@0"
I20260808 02:34:00.574975 11967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "37a04eb915494d89849650a389693f09"
format_stamp: "Formatted at 2026-08-08 02:34:00 on dist-test-slave-45dx"
server_key: "f07a87b093a822e7d7d430e612ea495e"
server_key_iv: "9b19dec37d314b4a04d7aced4bf17635"
server_key_version: "kuduclusterkey@0"
I20260808 02:34:00.595146 11967 fs_manager.cc:691] Time spent creating directory manager: real 0.020s user 0.010s sys 0.007s
I20260808 02:34:00.624963 11994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:00.627079 11967 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.004s sys 0.000s
I20260808 02:34:00.627389 11967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "37a04eb915494d89849650a389693f09"
format_stamp: "Formatted at 2026-08-08 02:34:00 on dist-test-slave-45dx"
server_key: "f07a87b093a822e7d7d430e612ea495e"
server_key_iv: "9b19dec37d314b4a04d7aced4bf17635"
server_key_version: "kuduclusterkey@0"
I20260808 02:34:00.627799 11967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:00.653789 11967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:00.659571 11967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:00.660036 11967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:00.661931 11967 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:34:00.663863 11967 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:34:00.664039 11967 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:00.664274 11967 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:34:00.664446 11967 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:00.711481 11967 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:37811
I20260808 02:34:00.711519 12171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:37811 every 8 connection(s)
I20260808 02:34:00.713050 11967 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:34:00.720858 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 11967
I20260808 02:34:00.721097 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:34:00.722019 25043 external_mini_cluster.cc:1428] Setting key da50ad9ab98208cdfdfe1acc38c06374
Aug 08 02:34:00 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156440, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.116.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.194@KRBTEST.COM" created.
I20260808 02:34:00.769858 12177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:00.716181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:52251 (local address 127.24.116.254:42935)
0808 02:34:00.716784 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:00.716791 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:00.729534 (+ 12743us) server_negotiation.cc:407] Connection header received
0808 02:34:00.729610 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:00.729615 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:00.729722 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:00.729896 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:00.740614 (+ 10718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:00.741945 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:00.747075 (+ 5130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:00.747881 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:00.748063 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:00.759783 (+ 11720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:00.759793 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:00.759798 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:00.759851 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:00.763997 (+ 4146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:00.766522 (+ 2525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:00.766530 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:00.766534 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:00.766734 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:00.767395 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:00.767401 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:00.767404 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:00.767815 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:00.767967 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:00.769162 (+ 1195us) server_negotiation.cc:299] Negotiation successful
0808 02:34:00.769433 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":461,"thread_start_us":315,"threads_started":1}
I20260808 02:34:00.772619 12179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:00.716758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:42935 (local address 127.24.116.193:52251)
0808 02:34:00.726399 (+ 9641us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:00.726483 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:00.729108 (+ 2625us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:00.730246 (+ 1138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:00.730261 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:00.739161 (+ 8900us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:34:00.740258 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:00.740297 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:00.742193 (+ 1896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:00.742201 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:00.744635 (+ 2434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:00.744666 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:00.748543 (+ 3877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:00.748553 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:00.748949 (+ 396us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:00.754647 (+ 5698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:34:00.754685 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:34:00.758113 (+ 3428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:34:00.765330 (+ 7217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:00.765343 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:00.765367 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:00.766300 (+ 933us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:00.766935 (+ 635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:00.766941 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:00.766945 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:00.767243 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:00.768080 (+ 837us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:34:00.768091 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:34:00.768647 (+ 556us) client_negotiation.cc:769] Sending connection context
0808 02:34:00.770442 (+ 1795us) client_negotiation.cc:240] Negotiation successful
0808 02:34:00.771076 (+ 634us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":328,"threads_started":1}
I20260808 02:34:00.774935 12174 heartbeater.cc:347] Connected to a master server at 127.24.116.254:42935
I20260808 02:34:00.775266 12174 heartbeater.cc:464] Registering TS with master...
I20260808 02:34:00.776201 12174 heartbeater.cc:511] Master 127.24.116.254:42935 requested a full tablet report, sending...
I20260808 02:34:00.778946 11848 ts_manager.cc:194] Registered new tserver with Master: 37a04eb915494d89849650a389693f09 (127.24.116.193:37811)
I20260808 02:34:00.781191 11848 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.193@KRBTEST.COM'} at 127.24.116.193:52251
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
I20260808 02:34:00.813009 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.116.212:55997/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:42935
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:43721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 02:34:00 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156440, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for HTTP/127.24.116.212@KRBTEST.COM
Aug 08 02:34:01 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156440, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for HTTP/127.24.116.212@KRBTEST.COM
W20260808 02:34:01.310753 12183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:01.311170 12183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:01.311370 12183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:01.323392 12183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:01.323674 12183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:01.323948 12183 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:34:01.341943 12183 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:43721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.24.116.212:55997/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:42935
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:01.344543 12183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:01.346642 12183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:01.402841 12196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:01.402889 12195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:01.421569 12183 server_base.cc:1034] running on GCE node
W20260808 02:34:01.422693 12198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:01.429163 12183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:01.430774 12183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:01.432086 12183 hybrid_clock.cc:648] HybridClock initialized: now 1786156441432014 us; error 67 us; skew 500 ppm
I20260808 02:34:01.432575 12183 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:01 dist-test-slave-45dx krb5kdc[11100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156441, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:01.447832 12183 init.cc:377] Logged in from keytab as kudu/127.24.116.194@KRBTEST.COM (short username kudu)
I20260808 02:34:01.474362 12183 webserver.cc:460] Webserver started at http://127.24.116.194:45131/ using document root <none> and password file <none>
I20260808 02:34:01.475611 12183 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:01.475864 12183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:34:01.476487 12183 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 02:34:01 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156441, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for HTTP/127.24.116.212@KRBTEST.COM
I20260808 02:34:01.509799 12183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "ffe1b39e082240249ec189588cec8c3e"
format_stamp: "Formatted at 2026-08-08 02:34:01 on dist-test-slave-45dx"
server_key: "639ca0218e21180a39c36ad215ff18f9"
server_key_iv: "2cc8c662df444d3c256bddeddfa55884"
server_key_version: "kuduclusterkey@0"
I20260808 02:34:01.511201 12183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "ffe1b39e082240249ec189588cec8c3e"
format_stamp: "Formatted at 2026-08-08 02:34:01 on dist-test-slave-45dx"
server_key: "639ca0218e21180a39c36ad215ff18f9"
server_key_iv: "2cc8c662df444d3c256bddeddfa55884"
server_key_version: "kuduclusterkey@0"
I20260808 02:34:01.527031 12183 fs_manager.cc:691] Time spent creating directory manager: real 0.015s user 0.007s sys 0.007s
I20260808 02:34:01.569203 12210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:01.572067 12183 fs_manager.cc:725] Time spent opening block manager: real 0.016s user 0.003s sys 0.011s
I20260808 02:34:01.572446 12183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "ffe1b39e082240249ec189588cec8c3e"
format_stamp: "Formatted at 2026-08-08 02:34:01 on dist-test-slave-45dx"
server_key: "639ca0218e21180a39c36ad215ff18f9"
server_key_iv: "2cc8c662df444d3c256bddeddfa55884"
server_key_version: "kuduclusterkey@0"
I20260808 02:34:01.572852 12183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:01.601477 12183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:01.607465 12183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:01.607926 12183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:01.643621 12183 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:34:01.652467 12183 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:34:01.652681 12183 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:01.652882 12183 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:34:01.653014 12183 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:01.701098 12183 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:46491
I20260808 02:34:01.701112 12409 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:46491 every 8 connection(s)
I20260808 02:34:01.702633 12183 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:34:01.703246 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 12183
I20260808 02:34:01.703470 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:34:01.704187 25043 external_mini_cluster.cc:1428] Setting key 49b68a0ba40b322013e940f83fd532d3
Aug 08 02:34:01 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156441, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.116.195@KRBTEST.COM; defaulting to no policy
I20260808 02:34:01.744570 12415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:01.705857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:39449 (local address 127.24.116.254:42935)
0808 02:34:01.709439 (+ 3582us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:01.709448 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:01.721574 (+ 12126us) server_negotiation.cc:407] Connection header received
0808 02:34:01.724346 (+ 2772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:01.724352 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:01.724458 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:01.724582 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:01.726716 (+ 2134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:01.727874 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:01.730682 (+ 2808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:01.731329 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:01.731464 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:01.736566 (+ 5102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:01.736575 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:01.736583 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:01.736634 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:01.740720 (+ 4086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:01.741678 (+ 958us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:01.741684 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:01.741688 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:01.741883 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:01.742463 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:01.742470 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:01.742473 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:01.742905 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:01.743028 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:01.744015 (+ 987us) server_negotiation.cc:299] Negotiation successful
0808 02:34:01.744207 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3426,"thread_start_us":3310,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.195@KRBTEST.COM" created.
I20260808 02:34:01.745975 12416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:01.706889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:42935 (local address 127.24.116.194:39449)
0808 02:34:01.721289 (+ 14400us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:01.721361 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:01.723978 (+ 2617us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:01.724902 (+ 924us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:01.724918 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:01.725619 (+ 701us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:34:01.726473 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:01.726502 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:01.728081 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:01.728090 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:01.730488 (+ 2398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:01.730507 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:01.731602 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:01.731612 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:01.731998 (+ 386us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:01.732911 (+ 913us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:34:01.732952 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:34:01.736257 (+ 3305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:34:01.740905 (+ 4648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:01.740915 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:01.740934 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:01.741508 (+ 574us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:01.742034 (+ 526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:01.742039 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:01.742042 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:01.742312 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:01.743057 (+ 745us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:34:01.743066 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:34:01.743549 (+ 483us) client_negotiation.cc:769] Sending connection context
0808 02:34:01.743895 (+ 346us) client_negotiation.cc:240] Negotiation successful
0808 02:34:01.744484 (+ 589us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14072,"thread_start_us":13804,"threads_started":1}
I20260808 02:34:01.749107 12410 heartbeater.cc:347] Connected to a master server at 127.24.116.254:42935
I20260808 02:34:01.749468 12410 heartbeater.cc:464] Registering TS with master...
I20260808 02:34:01.750274 12410 heartbeater.cc:511] Master 127.24.116.254:42935 requested a full tablet report, sending...
I20260808 02:34:01.751809 11848 ts_manager.cc:194] Registered new tserver with Master: ffe1b39e082240249ec189588cec8c3e (127.24.116.194:46491)
I20260808 02:34:01.752741 11848 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.194@KRBTEST.COM'} at 127.24.116.194:39449
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
I20260808 02:34:01.784224 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.116.212:55997/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:42935
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:43721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:34:01.785305 12174 heartbeater.cc:503] Master 127.24.116.254:42935 was elected leader, sending a full tablet report...
W20260808 02:34:02.170276 12423 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:02.170550 12423 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:02.170703 12423 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:02.178037 12423 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:02.178347 12423 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:02.178617 12423 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:34:02.188669 12423 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:43721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.24.116.212:55997/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:42935
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:02.190109 12423 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:02.191553 12423 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:02.205457 12430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:02.205479 12429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:02.206753 12423 server_base.cc:1034] running on GCE node
W20260808 02:34:02.208657 12432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:02.209570 12423 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:02.210855 12423 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:02.212155 12423 hybrid_clock.cc:648] HybridClock initialized: now 1786156442212072 us; error 53 us; skew 500 ppm
I20260808 02:34:02.212591 12423 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:02 dist-test-slave-45dx krb5kdc[11100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156442, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:02.217444 12423 init.cc:377] Logged in from keytab as kudu/127.24.116.195@KRBTEST.COM (short username kudu)
I20260808 02:34:02.220602 12423 webserver.cc:460] Webserver started at http://127.24.116.195:36445/ using document root <none> and password file <none>
I20260808 02:34:02.221593 12423 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:02.221762 12423 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:34:02.222105 12423 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 02:34:02 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156442, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for HTTP/127.24.116.212@KRBTEST.COM
I20260808 02:34:02.236867 12423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "179607ce40074bd2a5004b91dae9feec"
format_stamp: "Formatted at 2026-08-08 02:34:02 on dist-test-slave-45dx"
server_key: "038d7da401383e67f03275bdbe823a1f"
server_key_iv: "63d947fcdac8f823ea806dba2c805d78"
server_key_version: "kuduclusterkey@0"
I20260808 02:34:02.237756 12423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "179607ce40074bd2a5004b91dae9feec"
format_stamp: "Formatted at 2026-08-08 02:34:02 on dist-test-slave-45dx"
server_key: "038d7da401383e67f03275bdbe823a1f"
server_key_iv: "63d947fcdac8f823ea806dba2c805d78"
server_key_version: "kuduclusterkey@0"
I20260808 02:34:02.243618 12423 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 02:34:02.261425 12446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:02.263659 12423 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:34:02.263902 12423 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "179607ce40074bd2a5004b91dae9feec"
format_stamp: "Formatted at 2026-08-08 02:34:02 on dist-test-slave-45dx"
server_key: "038d7da401383e67f03275bdbe823a1f"
server_key_iv: "63d947fcdac8f823ea806dba2c805d78"
server_key_version: "kuduclusterkey@0"
I20260808 02:34:02.264236 12423 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:02.291209 12423 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:02.295270 12423 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:02.295610 12423 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:02.296648 12423 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:34:02.298136 12423 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:34:02.298214 12423 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:02.298370 12423 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:34:02.298422 12423 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:02.335071 12423 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:36569
I20260808 02:34:02.335111 12620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:36569 every 8 connection(s)
I20260808 02:34:02.336442 12423 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:34:02.343613 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 12423
I20260808 02:34:02.343807 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:34:02.344412 25043 external_mini_cluster.cc:1428] Setting key 29a7578e2b12144dda185f9794a81035
Aug 08 02:34:02 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156442, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:34:02.357364 12624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:02.339098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:44391 (local address 127.24.116.254:42935)
0808 02:34:02.339557 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:02.339563 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:02.340660 (+ 1097us) server_negotiation.cc:407] Connection header received
0808 02:34:02.342493 (+ 1833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:02.342497 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:02.342577 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:02.342676 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:02.344256 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:02.345307 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:02.347247 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:02.347870 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:02.347980 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:02.351380 (+ 3400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:02.351385 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:02.351388 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:02.351428 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:02.354206 (+ 2778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:02.354926 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:02.354938 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:02.354941 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:02.355080 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:02.355539 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:02.355544 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:02.355547 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:02.355876 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:02.356034 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:02.356766 (+ 732us) server_negotiation.cc:299] Negotiation successful
0808 02:34:02.356994 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":216,"threads_started":1}
I20260808 02:34:02.358466 12626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:02.339714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:42935 (local address 127.24.116.195:44391)
0808 02:34:02.340503 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:02.340543 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:02.342242 (+ 1699us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:02.342921 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:02.342929 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:02.343380 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:34:02.344074 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:02.344099 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:02.345487 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:02.345492 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:02.347104 (+ 1612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:02.347128 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:02.348082 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:02.348088 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:02.348379 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:02.349026 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:34:02.349048 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:34:02.351141 (+ 2093us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:34:02.354348 (+ 3207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:02.354358 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:02.354373 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:02.354790 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:02.355194 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:02.355199 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:02.355203 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:02.355420 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:02.356008 (+ 588us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:34:02.356015 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:34:02.356383 (+ 368us) client_negotiation.cc:769] Sending connection context
0808 02:34:02.356686 (+ 303us) client_negotiation.cc:240] Negotiation successful
0808 02:34:02.357188 (+ 502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":290,"threads_started":1}
I20260808 02:34:02.359890 12622 heartbeater.cc:347] Connected to a master server at 127.24.116.254:42935
I20260808 02:34:02.360236 12622 heartbeater.cc:464] Registering TS with master...
I20260808 02:34:02.360972 12622 heartbeater.cc:511] Master 127.24.116.254:42935 requested a full tablet report, sending...
I20260808 02:34:02.362447 11848 ts_manager.cc:194] Registered new tserver with Master: 179607ce40074bd2a5004b91dae9feec (127.24.116.195:36569)
I20260808 02:34:02.363322 11848 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.195@KRBTEST.COM'} at 127.24.116.195:44391
I20260808 02:34:02.372718 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:34:02.374394 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 11967
Aug 08 02:34:02 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.193@KRBTEST.COM
I20260808 02:34:02.391440 12629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:02.375430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53600 (local address 127.24.116.193:37811)
0808 02:34:02.376118 (+ 688us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:02.376125 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:02.376150 (+ 25us) server_negotiation.cc:407] Connection header received
0808 02:34:02.376207 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:02.376213 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:02.376471 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:02.376603 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:02.378226 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:02.379407 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:02.381066 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:02.381649 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:02.381799 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:02.386076 (+ 4277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:02.386087 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:02.386101 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:02.386137 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:02.389056 (+ 2919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:02.389667 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:02.389674 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:02.389676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:02.389862 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:02.390204 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:02.390207 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:02.390209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:02.390535 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:02.390789 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:02.390970 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 02:34:02.391160 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":530,"thread_start_us":367,"threads_started":1}
I20260808 02:34:02.392720 12167 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:02.480654 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 11967
I20260808 02:34:02.507784 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 12183
Aug 08 02:34:02 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.194@KRBTEST.COM
I20260808 02:34:02.525496 12631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:02.509009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59564 (local address 127.24.116.194:46491)
0808 02:34:02.509785 (+ 776us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:02.509793 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:02.509824 (+ 31us) server_negotiation.cc:407] Connection header received
0808 02:34:02.509889 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:02.509895 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:02.510111 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:02.510242 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:02.511567 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:02.512835 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:02.514238 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:02.514798 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:02.514901 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:02.519379 (+ 4478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:02.519390 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:02.519405 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:02.519450 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:02.522701 (+ 3251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:02.523365 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:02.523372 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:02.523375 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:02.523519 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:02.523882 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:02.523885 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:02.523887 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:02.524237 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:02.524563 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:02.524850 (+ 287us) server_negotiation.cc:299] Negotiation successful
0808 02:34:02.525063 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":474,"threads_started":1}
I20260808 02:34:02.526805 12403 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:02.611670 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 12183
I20260808 02:34:02.643151 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 12423
Aug 08 02:34:02 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.195@KRBTEST.COM
I20260808 02:34:02.662330 12636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:02.644400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57026 (local address 127.24.116.195:36569)
0808 02:34:02.645294 (+ 894us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:02.645312 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:02.645346 (+ 34us) server_negotiation.cc:407] Connection header received
0808 02:34:02.645433 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:02.645441 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:02.645662 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:02.645810 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:02.647216 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:02.648553 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:02.649899 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:02.650531 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:02.650653 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:02.655559 (+ 4906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:02.655574 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:02.655596 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:02.655639 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:02.659061 (+ 3422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:02.659846 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:02.659854 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:02.659857 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:02.660004 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:02.660525 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:02.660531 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:02.660536 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:02.660933 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:02.661314 (+ 381us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:02.661600 (+ 286us) server_negotiation.cc:299] Negotiation successful
0808 02:34:02.661930 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":726,"thread_start_us":511,"threads_started":1}
I20260808 02:34:02.663755 12615 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:02.750432 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 12423
I20260808 02:34:02.776357 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 11794
I20260808 02:34:02.777729 11890 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:02.888162 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 11794
I20260808 02:34:02.922046 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:42935
--webserver_interface=127.24.116.254
--webserver_port=38235
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:43721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:42935
--ranger_config_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.116.212:55997/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.24.116.212:55997/kms with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:34:03.270167 12642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:03.270447 12642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:03.270649 12642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:03.277706 12642 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:34:03.277805 12642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:03.277911 12642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:03.278012 12642 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:34:03.278102 12642 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:34:03.290755 12642 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:43721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.24.116.212:55997/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:42935
--ranger_config_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:42935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=38235
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:03.292081 12642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:03.293540 12642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:03.305511 12650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:03.305900 12653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:03.305955 12649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:03.306468 12642 server_base.cc:1034] running on GCE node
I20260808 02:34:03.307243 12642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:03.308677 12642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:03.309940 12642 hybrid_clock.cc:648] HybridClock initialized: now 1786156443309903 us; error 36 us; skew 500 ppm
I20260808 02:34:03.310425 12642 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:03 dist-test-slave-45dx krb5kdc[11100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156443, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:03.314344 12642 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:34:03.315831 12642 webserver.cc:460] Webserver started at http://127.24.116.254:38235/ using document root <none> and password file <none>
I20260808 02:34:03.316569 12642 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:03.316723 12642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 02:34:03 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156443, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for HTTP/127.24.116.212@KRBTEST.COM
I20260808 02:34:03.366883 12642 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 02:34:03.370072 12662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:03.371438 12642 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 02:34:03.371647 12642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "bd388ed5b9d54d09a5f521c28b30350a"
format_stamp: "Formatted at 2026-08-08 02:33:59 on dist-test-slave-45dx"
server_key: "8c119f34739d7d3df5510c01d69395e6"
server_key_iv: "ae74426eca45e34e246487e8ab4084b1"
server_key_version: "kuduclusterkey@0"
I20260808 02:34:03.372714 12642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:03.389760 12642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:03.394009 12642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:03.394323 12642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:03.413766 12642 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:42935
I20260808 02:34:03.413777 12741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:42935 every 8 connection(s)
I20260808 02:34:03.415349 12642 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:34:03.422297 12742 sys_catalog.cc:263] Verifying existing consensus state
I20260808 02:34:03.423749 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 12642
I20260808 02:34:03.424764 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.116.212:55997/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:37811
--local_ip_for_outbound_sockets=127.24.116.193
--tserver_master_addrs=127.24.116.254:42935
--webserver_port=33107
--webserver_interface=127.24.116.193
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:43721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.24.116.212:55997/kms with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:34:03.425722 12742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a: Bootstrap starting.
I20260808 02:34:03.445777 12742 log.cc:824] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a: Log is configured to *not* fsync() on all Append() calls
I20260808 02:34:03.454936 12742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 02:34:03.455503 12742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a: Bootstrap complete.
I20260808 02:34:03.465482 12742 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd388ed5b9d54d09a5f521c28b30350a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42935 } }
I20260808 02:34:03.466373 12742 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd388ed5b9d54d09a5f521c28b30350a, State: Initialized, Role: FOLLOWER
I20260808 02:34:03.467033 12742 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd388ed5b9d54d09a5f521c28b30350a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42935 } }
I20260808 02:34:03.467280 12742 raft_consensus.cc:388] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:34:03.467411 12742 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:34:03.467599 12742 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [term 1 FOLLOWER]: Advancing to term 2
I20260808 02:34:03.471417 12742 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd388ed5b9d54d09a5f521c28b30350a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42935 } }
I20260808 02:34:03.471896 12742 leader_election.cc:302] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd388ed5b9d54d09a5f521c28b30350a; no voters:
I20260808 02:34:03.472580 12742 leader_election.cc:288] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 02:34:03.472719 12748 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [term 2 FOLLOWER]: Leader election won for term 2
I20260808 02:34:03.473862 12748 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [term 2 LEADER]: Becoming Leader. State: Replica: bd388ed5b9d54d09a5f521c28b30350a, State: Running, Role: LEADER
I20260808 02:34:03.474440 12748 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd388ed5b9d54d09a5f521c28b30350a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42935 } }
I20260808 02:34:03.474826 12742 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:34:03.477660 12749 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "bd388ed5b9d54d09a5f521c28b30350a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd388ed5b9d54d09a5f521c28b30350a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42935 } } }
I20260808 02:34:03.478109 12749 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [sys.catalog]: This master's current role is: LEADER
I20260808 02:34:03.480489 12751 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd388ed5b9d54d09a5f521c28b30350a. Latest consensus state: current_term: 2 leader_uuid: "bd388ed5b9d54d09a5f521c28b30350a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd388ed5b9d54d09a5f521c28b30350a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42935 } } }
I20260808 02:34:03.481585 12759 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:34:03.481686 12751 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a [sys.catalog]: This master's current role is: LEADER
I20260808 02:34:03.488658 12759 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:34:03.490447 12759 catalog_manager.cc:1259] Loaded cluster ID: c2235ce630f241f98e20e6d37fe4092c
I20260808 02:34:03.490571 12759 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:34:03.495710 12759 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:34:03.497730 12759 catalog_manager.cc:5879] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a: Loaded TSK: 0
I20260808 02:34:03.499636 12759 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:34:03.512986 12742 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260808 02:34:03.916069 12746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:03.916512 12746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:03.916678 12746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:03.928395 12746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:03.928555 12746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:03.928755 12746 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:34:03.944929 12746 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:43721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.24.116.212:55997/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:37811
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=33107
--tserver_master_addrs=127.24.116.254:42935
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:03.946736 12746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:03.948719 12746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:03.966022 12795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:03.970574 12800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:03.970688 12794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:03.971562 12746 server_base.cc:1034] running on GCE node
I20260808 02:34:03.972261 12746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:03.973351 12746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:03.974610 12746 hybrid_clock.cc:648] HybridClock initialized: now 1786156443974545 us; error 50 us; skew 500 ppm
I20260808 02:34:03.975018 12746 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:03 dist-test-slave-45dx krb5kdc[11100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156443, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:03.978768 12746 init.cc:377] Logged in from keytab as kudu/127.24.116.193@KRBTEST.COM (short username kudu)
I20260808 02:34:03.980580 12746 webserver.cc:460] Webserver started at http://127.24.116.193:33107/ using document root <none> and password file <none>
I20260808 02:34:03.981472 12746 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:03.981643 12746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 02:34:03 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156443, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for HTTP/127.24.116.212@KRBTEST.COM
I20260808 02:34:04.021453 12746 fs_manager.cc:709] Time spent opening directory manager: real 0.015s user 0.004s sys 0.000s
I20260808 02:34:04.025570 12813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:04.027442 12746 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260808 02:34:04.027688 12746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "37a04eb915494d89849650a389693f09"
format_stamp: "Formatted at 2026-08-08 02:34:00 on dist-test-slave-45dx"
server_key: "f07a87b093a822e7d7d430e612ea495e"
server_key_iv: "9b19dec37d314b4a04d7aced4bf17635"
server_key_version: "kuduclusterkey@0"
I20260808 02:34:04.029337 12746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:04.051286 12746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:04.056872 12746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:04.057179 12746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:04.058445 12746 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:34:04.060227 12746 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:34:04.060364 12746 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260808 02:34:04.060487 12746 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:34:04.060578 12746 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:04.157091 12746 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:37811
I20260808 02:34:04.157155 12981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:37811 every 8 connection(s)
I20260808 02:34:04.159204 12746 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:34:04.159950 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 12746
I20260808 02:34:04.160878 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.116.212:55997/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:46491
--local_ip_for_outbound_sockets=127.24.116.194
--tserver_master_addrs=127.24.116.254:42935
--webserver_port=45131
--webserver_interface=127.24.116.194
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:43721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.24.116.212:55997/kms with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 02:34:04 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156443, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:34:04.216645 12988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:04.165838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:42935 (local address 127.24.116.193:46969)
0808 02:34:04.187921 (+ 22083us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:04.187995 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:04.191232 (+ 3237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:04.193261 (+ 2029us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:04.193276 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:04.194001 (+ 725us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:34:04.194914 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:04.194942 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:04.197923 (+ 2981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:04.197932 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:04.200234 (+ 2302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:04.200261 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:04.201967 (+ 1706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:04.201984 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:04.202189 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:04.203050 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:34:04.203085 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:34:04.206073 (+ 2988us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:34:04.211014 (+ 4941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:04.211024 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:04.211041 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:04.211703 (+ 662us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:04.212356 (+ 653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:04.212361 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:04.212365 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:04.212630 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:04.213734 (+ 1104us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:34:04.213742 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:34:04.214183 (+ 441us) client_negotiation.cc:769] Sending connection context
0808 02:34:04.214487 (+ 304us) client_negotiation.cc:240] Negotiation successful
0808 02:34:04.215115 (+ 628us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21736,"thread_start_us":21512,"threads_started":1}
I20260808 02:34:04.219961 12987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:04.165652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:46969 (local address 127.24.116.254:42935)
0808 02:34:04.191432 (+ 25780us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:04.191453 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:04.191518 (+ 65us) server_negotiation.cc:407] Connection header received
0808 02:34:04.192011 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:04.192033 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:04.192599 (+ 566us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:04.195224 (+ 2625us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:04.195709 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:04.197731 (+ 2022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:04.200521 (+ 2790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:04.201663 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:04.201913 (+ 250us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:04.206426 (+ 4513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:04.206438 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:04.206458 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:04.206507 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:04.210818 (+ 4311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:04.211934 (+ 1116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:04.211944 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:04.211952 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:04.212188 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:04.212807 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:04.212812 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:04.212816 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:04.213557 (+ 741us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:04.217895 (+ 4338us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:04.218153 (+ 258us) server_negotiation.cc:299] Negotiation successful
0808 02:34:04.218577 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25427,"thread_start_us":25825,"threads_started":1}
I20260808 02:34:04.224006 12982 heartbeater.cc:347] Connected to a master server at 127.24.116.254:42935
I20260808 02:34:04.224378 12982 heartbeater.cc:464] Registering TS with master...
I20260808 02:34:04.225240 12982 heartbeater.cc:511] Master 127.24.116.254:42935 requested a full tablet report, sending...
W20260808 02:34:04.228745 12982 heartbeater.cc:644] Failed to heartbeat to 127.24.116.254:42935 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 02:34:04.229014 12982 heartbeater.cc:464] Registering TS with master...
I20260808 02:34:04.229324 12982 heartbeater.cc:511] Master 127.24.116.254:42935 requested a full tablet report, sending...
I20260808 02:34:04.230751 12982 heartbeater.cc:464] Registering TS with master...
I20260808 02:34:04.231065 12982 heartbeater.cc:511] Master 127.24.116.254:42935 requested a full tablet report, sending...
W20260808 02:34:04.232421 12982 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 02:34:04.660940 12989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:04.661423 12989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:04.661605 12989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:04.675102 12989 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:04.675290 12989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:04.675505 12989 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:34:04.691803 12989 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:43721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.24.116.212:55997/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:46491
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=45131
--tserver_master_addrs=127.24.116.254:42935
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:04.693660 12989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:04.695246 12989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:04.727670 13011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:04.728374 13012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:04.734125 12989 server_base.cc:1034] running on GCE node
W20260808 02:34:04.734532 13016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:04.735510 12989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:04.736920 12989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:04.738202 12989 hybrid_clock.cc:648] HybridClock initialized: now 1786156444738145 us; error 39 us; skew 500 ppm
I20260808 02:34:04.738651 12989 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:04 dist-test-slave-45dx krb5kdc[11100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156444, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:04.743350 12989 init.cc:377] Logged in from keytab as kudu/127.24.116.194@KRBTEST.COM (short username kudu)
I20260808 02:34:04.745538 12989 webserver.cc:460] Webserver started at http://127.24.116.194:45131/ using document root <none> and password file <none>
I20260808 02:34:04.746526 12989 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:04.746693 12989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 02:34:04 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156444, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for HTTP/127.24.116.212@KRBTEST.COM
I20260808 02:34:04.777489 12989 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.004s sys 0.000s
I20260808 02:34:04.781567 13028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:04.783535 12989 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:34:04.783754 12989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "ffe1b39e082240249ec189588cec8c3e"
format_stamp: "Formatted at 2026-08-08 02:34:01 on dist-test-slave-45dx"
server_key: "639ca0218e21180a39c36ad215ff18f9"
server_key_iv: "2cc8c662df444d3c256bddeddfa55884"
server_key_version: "kuduclusterkey@0"
I20260808 02:34:04.785338 12989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 08 02:34:04 dist-test-slave-45dx krb5kdc[11100](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786156444, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:04.816695 12989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:04.822185 12989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:04.822531 12989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:04.825181 12989 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:34:04.827147 12989 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:34:04.827276 12989 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:04.827405 12989 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:34:04.827517 12989 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:04.869488 12989 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:46491
I20260808 02:34:04.869576 13192 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:46491 every 8 connection(s)
I20260808 02:34:04.871425 12989 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:34:04.876524 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 12989
I20260808 02:34:04.877600 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.116.212:55997/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:36569
--local_ip_for_outbound_sockets=127.24.116.195
--tserver_master_addrs=127.24.116.254:42935
--webserver_port=36445
--webserver_interface=127.24.116.195
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:43721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.24.116.212:55997/kms with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 02:34:04 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156444, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:34:04.913112 13195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:04.875047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:42935 (local address 127.24.116.194:55557)
0808 02:34:04.886425 (+ 11378us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:04.886488 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:04.889930 (+ 3442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:04.891038 (+ 1108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:04.891054 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:04.891756 (+ 702us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:34:04.892580 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:04.892601 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:04.894257 (+ 1656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:04.894266 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:04.896664 (+ 2398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:04.896693 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:04.897997 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:04.898006 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:04.898331 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:04.899293 (+ 962us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:34:04.899326 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:34:04.902565 (+ 3239us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:34:04.907519 (+ 4954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:04.907531 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:04.907551 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:04.908233 (+ 682us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:04.908771 (+ 538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:04.908777 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:04.908781 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:04.909065 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:04.909879 (+ 814us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:34:04.909891 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:34:04.910395 (+ 504us) client_negotiation.cc:769] Sending connection context
0808 02:34:04.910728 (+ 333us) client_negotiation.cc:240] Negotiation successful
0808 02:34:04.911402 (+ 674us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11014,"thread_start_us":13218,"threads_started":1}
I20260808 02:34:04.914532 13198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:04.874497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:55557 (local address 127.24.116.254:42935)
0808 02:34:04.888701 (+ 14204us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:04.888709 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:04.888737 (+ 28us) server_negotiation.cc:407] Connection header received
0808 02:34:04.890360 (+ 1623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:04.890367 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:04.890462 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:04.890676 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:04.892805 (+ 2129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:04.894055 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:04.896894 (+ 2839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:04.897720 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:04.898954 (+ 1234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:04.902851 (+ 3897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:04.902860 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:04.902867 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:04.902913 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:04.907351 (+ 4438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:04.908454 (+ 1103us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:04.908461 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:04.908468 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:04.908622 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:04.909240 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:04.909248 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:04.909253 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:04.909682 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:04.913586 (+ 3904us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:04.913769 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 02:34:04.914060 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14054,"thread_start_us":13910,"threads_started":1}
I20260808 02:34:04.917109 13193 heartbeater.cc:347] Connected to a master server at 127.24.116.254:42935
I20260808 02:34:04.917433 13193 heartbeater.cc:464] Registering TS with master...
I20260808 02:34:04.918260 13193 heartbeater.cc:511] Master 127.24.116.254:42935 requested a full tablet report, sending...
I20260808 02:34:04.920374 12690 ts_manager.cc:194] Registered new tserver with Master: ffe1b39e082240249ec189588cec8c3e (127.24.116.194:46491)
I20260808 02:34:04.922663 12690 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.194@KRBTEST.COM'} at 127.24.116.194:55557
I20260808 02:34:05.232594 12982 heartbeater.cc:464] Registering TS with master...
I20260808 02:34:05.233070 12982 heartbeater.cc:511] Master 127.24.116.254:42935 requested a full tablet report, sending...
I20260808 02:34:05.234478 12690 ts_manager.cc:194] Registered new tserver with Master: 37a04eb915494d89849650a389693f09 (127.24.116.193:37811)
I20260808 02:34:05.235751 12690 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.193@KRBTEST.COM'} at 127.24.116.193:46969
Aug 08 02:34:05 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156444, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for HTTP/127.24.116.212@KRBTEST.COM
W20260808 02:34:05.362682 13204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:05.363138 13204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:05.363327 13204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:05.374905 13204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:05.375085 13204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:05.375355 13204 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:34:05.391784 13204 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:43721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.24.116.212:55997/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:36569
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=36445
--tserver_master_addrs=127.24.116.254:42935
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:05.393667 13204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:05.395134 13204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:05.424094 13211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:05.425858 13213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:05.436902 13204 server_base.cc:1034] running on GCE node
W20260808 02:34:05.437422 13219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:05.438391 13204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:05.439756 13204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:05.441018 13204 hybrid_clock.cc:648] HybridClock initialized: now 1786156445440948 us; error 57 us; skew 500 ppm
I20260808 02:34:05.441427 13204 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:05 dist-test-slave-45dx krb5kdc[11100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156445, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:05.446089 13204 init.cc:377] Logged in from keytab as kudu/127.24.116.195@KRBTEST.COM (short username kudu)
I20260808 02:34:05.448274 13204 webserver.cc:460] Webserver started at http://127.24.116.195:36445/ using document root <none> and password file <none>
I20260808 02:34:05.449270 13204 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:05.449429 13204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 02:34:05 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156445, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for HTTP/127.24.116.212@KRBTEST.COM
I20260808 02:34:05.472640 13204 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 02:34:05.476487 13230 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:05.478313 13204 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:34:05.478497 13204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "179607ce40074bd2a5004b91dae9feec"
format_stamp: "Formatted at 2026-08-08 02:34:02 on dist-test-slave-45dx"
server_key: "038d7da401383e67f03275bdbe823a1f"
server_key_iv: "63d947fcdac8f823ea806dba2c805d78"
server_key_version: "kuduclusterkey@0"
I20260808 02:34:05.479909 13204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:05.498831 13204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:05.504680 13204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:05.505043 13204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:05.506386 13204 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:34:05.508368 13204 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:34:05.508486 13204 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:05.508592 13204 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:34:05.508679 13204 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 02:34:05 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156444, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for HTTP/127.24.116.212@KRBTEST.COM
I20260808 02:34:05.683260 13204 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:36569
I20260808 02:34:05.683331 13390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:36569 every 8 connection(s)
I20260808 02:34:05.684994 13204 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:34:05.690538 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 13204
I20260808 02:34:05.736650 13397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:05.691761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56220 (local address 127.24.116.254:42935)
0808 02:34:05.713117 (+ 21356us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:05.713124 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:05.713149 (+ 25us) server_negotiation.cc:407] Connection header received
0808 02:34:05.713224 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:05.713231 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:05.713333 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:05.713487 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:05.716497 (+ 3010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:05.717626 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:05.721221 (+ 3595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:05.721944 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:05.722089 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:05.726118 (+ 4029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:05.726126 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:05.726131 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:05.726173 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:05.731989 (+ 5816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:05.733174 (+ 1185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:05.733179 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:05.733183 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:05.733336 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:05.734406 (+ 1070us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:05.734412 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:05.734415 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:05.734868 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:05.735145 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:05.735983 (+ 838us) server_negotiation.cc:299] Negotiation successful
0808 02:34:05.736219 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21200,"thread_start_us":24573,"threads_started":1}
Aug 08 02:34:05 dist-test-slave-45dx krb5kdc[11100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156445, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:34:05.751996 13393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:05.696144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:37123 (local address 127.24.116.254:42935)
0808 02:34:05.714609 (+ 18465us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:05.714614 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:05.714638 (+ 24us) server_negotiation.cc:407] Connection header received
0808 02:34:05.718184 (+ 3546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:05.718191 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:05.718298 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:05.718411 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:05.724649 (+ 6238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:05.725908 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:05.732180 (+ 6272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:05.732861 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:05.732964 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:05.744282 (+ 11318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:05.744290 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:05.744295 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:05.744363 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:05.747944 (+ 3581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:05.748987 (+ 1043us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:05.748993 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:05.748997 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:05.749142 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:05.749776 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:05.749781 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:05.749784 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:05.750129 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:05.750298 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:05.751372 (+ 1074us) server_negotiation.cc:299] Negotiation successful
0808 02:34:05.751598 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18328,"thread_start_us":17442,"threads_started":1}
I20260808 02:34:05.755069 13394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:05.695443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:42935 (local address 127.24.116.195:37123)
0808 02:34:05.702054 (+ 6611us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:05.702108 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:05.715974 (+ 13866us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:05.722706 (+ 6732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:05.722722 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:05.723460 (+ 738us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:34:05.724411 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:05.724442 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:05.727034 (+ 2592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:05.727040 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:05.730228 (+ 3188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:05.730244 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:05.733657 (+ 3413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:05.733665 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:05.733993 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:05.735333 (+ 1340us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:34:05.735372 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:34:05.743934 (+ 8562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:34:05.748129 (+ 4195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:05.748139 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:05.748159 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:05.748839 (+ 680us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:05.749335 (+ 496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:05.749340 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:05.749344 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:05.749630 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:05.750413 (+ 783us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:34:05.750421 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:34:05.750902 (+ 481us) client_negotiation.cc:769] Sending connection context
0808 02:34:05.752930 (+ 2028us) client_negotiation.cc:240] Negotiation successful
0808 02:34:05.753586 (+ 656us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6275,"thread_start_us":5997,"threads_started":1}
I20260808 02:34:05.757071 13391 heartbeater.cc:347] Connected to a master server at 127.24.116.254:42935
I20260808 02:34:05.757414 13391 heartbeater.cc:464] Registering TS with master...
I20260808 02:34:05.758539 13391 heartbeater.cc:511] Master 127.24.116.254:42935 requested a full tablet report, sending...
I20260808 02:34:05.760329 12690 ts_manager.cc:194] Registered new tserver with Master: 179607ce40074bd2a5004b91dae9feec (127.24.116.195:36569)
I20260808 02:34:05.761463 12690 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.195@KRBTEST.COM'} at 127.24.116.195:37123
I20260808 02:34:05.766610 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:34:05.821907 13393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:05.792650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56224 (local address 127.24.116.254:42935)
0808 02:34:05.792851 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:05.792857 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:05.803289 (+ 10432us) server_negotiation.cc:407] Connection header received
0808 02:34:05.803546 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:05.803553 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:05.803650 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:05.803734 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:05.806164 (+ 2430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:05.807334 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:05.809630 (+ 2296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:05.810308 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:05.810413 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:05.814260 (+ 3847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:05.814267 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:05.814271 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:05.814319 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:05.818207 (+ 3888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:05.819201 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:05.819206 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:05.819210 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:05.819394 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:05.819899 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:05.819905 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:05.819909 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:05.820372 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:05.820618 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:05.821231 (+ 613us) server_negotiation.cc:299] Negotiation successful
0808 02:34:05.821511 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 02:34:05.829205 12690 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56224:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:34:05.840765 12690 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:34:05.915572 13419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:05.858253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:46491 (local address 127.0.0.1:59568)
0808 02:34:05.895038 (+ 36785us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:05.895104 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:05.895315 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:05.907152 (+ 11837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:05.907157 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:05.907184 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:34:05.907583 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:05.907594 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:05.909799 (+ 2205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:05.909805 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:05.911950 (+ 2145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:05.911970 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:05.914581 (+ 2611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:05.914588 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:05.914859 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:05.914892 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 02:34:05.914973 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 02:34:05.915112 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36418,"mutex_wait_us":20,"thread_start_us":48301,"threads_started":1}
I20260808 02:34:05.916648 13421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:05.860884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57036 (local address 127.24.116.195:36569)
0808 02:34:05.893488 (+ 32604us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:05.893499 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:05.901511 (+ 8012us) server_negotiation.cc:407] Connection header received
0808 02:34:05.901870 (+ 359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:05.901880 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:05.902162 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:05.902339 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:34:05.903422 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:05.905145 (+ 1723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:05.912135 (+ 6990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:05.913678 (+ 1543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:05.913882 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:05.914061 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:05.916080 (+ 2019us) server_negotiation.cc:299] Negotiation successful
0808 02:34:05.916266 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32356,"thread_start_us":32617,"threads_started":1}
I20260808 02:34:05.917392 13427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:05.860288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:36569 (local address 127.0.0.1:57036)
0808 02:34:05.901378 (+ 41090us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:05.901399 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:05.901635 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:05.902775 (+ 1140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:05.902783 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:05.902815 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:34:05.903184 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:05.903197 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:05.906840 (+ 3643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:05.906849 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:05.910488 (+ 3639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:05.910511 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:05.914223 (+ 3712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:05.914230 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:05.914446 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:05.914498 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 02:34:05.914638 (+ 140us) client_negotiation.cc:240] Negotiation successful
0808 02:34:05.916972 (+ 2334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40954,"mutex_wait_us":1,"thread_start_us":35356,"threads_started":1}
I20260808 02:34:05.921005 13418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:05.858437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59568 (local address 127.24.116.194:46491)
0808 02:34:05.906564 (+ 48127us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:05.906573 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:05.906602 (+ 29us) server_negotiation.cc:407] Connection header received
0808 02:34:05.906693 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:05.906700 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:05.906928 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:05.907777 (+ 849us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:34:05.908015 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:05.909633 (+ 1618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:05.912457 (+ 2824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:05.914027 (+ 1570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:05.914231 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:05.914412 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:05.920435 (+ 6023us) server_negotiation.cc:299] Negotiation successful
0808 02:34:05.920626 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47937,"thread_start_us":47821,"threads_started":1}
I20260808 02:34:05.921659 13296 tablet_service.cc:1467] Processing CreateTablet for tablet 9a9d4ca8bcd949ca92aa5f987fc4d22d (DEFAULT_TABLE table=test-table [id=44ace7304c9c46de9def1e92b389ba10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:34:05.923285 13296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a9d4ca8bcd949ca92aa5f987fc4d22d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:34:05.923874 13417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:05.896589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:37811 (local address 127.0.0.1:53614)
0808 02:34:05.905889 (+ 9300us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:05.905908 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:05.906016 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:05.913317 (+ 7301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:05.913322 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:05.913351 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:34:05.913695 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:05.913708 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:05.918370 (+ 4662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:05.918375 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:05.920390 (+ 2015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:05.920406 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:05.923012 (+ 2606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:05.923021 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:05.923199 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:05.923237 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 02:34:05.923319 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 02:34:05.923549 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9177,"thread_start_us":8668,"threads_started":1}
I20260808 02:34:05.925091 13429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:05.896864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53614 (local address 127.24.116.193:37811)
0808 02:34:05.912457 (+ 15593us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:05.912466 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:05.912495 (+ 29us) server_negotiation.cc:407] Connection header received
0808 02:34:05.912592 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:05.912600 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:05.912846 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:05.913059 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:34:05.914100 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:05.918180 (+ 4080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:05.920607 (+ 2427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:05.922737 (+ 2130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:05.924375 (+ 1638us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:05.924541 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:05.924620 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 02:34:05.924778 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15331,"thread_start_us":15185,"threads_started":1}
I20260808 02:34:05.924799 13096 tablet_service.cc:1467] Processing CreateTablet for tablet 9a9d4ca8bcd949ca92aa5f987fc4d22d (DEFAULT_TABLE table=test-table [id=44ace7304c9c46de9def1e92b389ba10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:34:05.926760 13193 heartbeater.cc:503] Master 127.24.116.254:42935 was elected leader, sending a full tablet report...
I20260808 02:34:05.928972 12890 tablet_service.cc:1467] Processing CreateTablet for tablet 9a9d4ca8bcd949ca92aa5f987fc4d22d (DEFAULT_TABLE table=test-table [id=44ace7304c9c46de9def1e92b389ba10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:34:05.930378 12890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a9d4ca8bcd949ca92aa5f987fc4d22d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:34:05.934197 13096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a9d4ca8bcd949ca92aa5f987fc4d22d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:34:05.945544 13434 tablet_bootstrap.cc:492] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec: Bootstrap starting.
I20260808 02:34:05.949031 13437 tablet_bootstrap.cc:492] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 37a04eb915494d89849650a389693f09: Bootstrap starting.
I20260808 02:34:05.950070 13434 tablet_bootstrap.cc:654] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec: Neither blocks nor log segments found. Creating new log.
I20260808 02:34:05.951499 13434 log.cc:824] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec: Log is configured to *not* fsync() on all Append() calls
I20260808 02:34:05.952392 13440 tablet_bootstrap.cc:492] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P ffe1b39e082240249ec189588cec8c3e: Bootstrap starting.
I20260808 02:34:05.953058 13437 tablet_bootstrap.cc:654] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 37a04eb915494d89849650a389693f09: Neither blocks nor log segments found. Creating new log.
I20260808 02:34:05.954262 13437 log.cc:824] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 37a04eb915494d89849650a389693f09: Log is configured to *not* fsync() on all Append() calls
I20260808 02:34:05.955540 13434 tablet_bootstrap.cc:492] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec: No bootstrap required, opened a new log
I20260808 02:34:05.955816 13434 ts_tablet_manager.cc:1397] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260808 02:34:05.956359 13440 tablet_bootstrap.cc:654] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P ffe1b39e082240249ec189588cec8c3e: Neither blocks nor log segments found. Creating new log.
I20260808 02:34:05.957641 13437 tablet_bootstrap.cc:492] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 37a04eb915494d89849650a389693f09: No bootstrap required, opened a new log
I20260808 02:34:05.957635 13440 log.cc:824] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P ffe1b39e082240249ec189588cec8c3e: Log is configured to *not* fsync() on all Append() calls
I20260808 02:34:05.957902 13437 ts_tablet_manager.cc:1397] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 37a04eb915494d89849650a389693f09: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260808 02:34:05.960690 13440 tablet_bootstrap.cc:492] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P ffe1b39e082240249ec189588cec8c3e: No bootstrap required, opened a new log
I20260808 02:34:05.960955 13440 ts_tablet_manager.cc:1397] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P ffe1b39e082240249ec189588cec8c3e: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 02:34:05.963749 13434 raft_consensus.cc:348] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffe1b39e082240249ec189588cec8c3e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46491 } } peers { permanent_uuid: "179607ce40074bd2a5004b91dae9feec" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36569 } } peers { permanent_uuid: "37a04eb915494d89849650a389693f09" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37811 } }
I20260808 02:34:05.964133 13434 raft_consensus.cc:374] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:34:05.964239 13434 raft_consensus.cc:729] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 179607ce40074bd2a5004b91dae9feec, State: Initialized, Role: FOLLOWER
I20260808 02:34:05.964994 13434 consensus_queue.cc:260] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffe1b39e082240249ec189588cec8c3e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46491 } } peers { permanent_uuid: "179607ce40074bd2a5004b91dae9feec" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36569 } } peers { permanent_uuid: "37a04eb915494d89849650a389693f09" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37811 } }
I20260808 02:34:05.967314 13391 heartbeater.cc:503] Master 127.24.116.254:42935 was elected leader, sending a full tablet report...
I20260808 02:34:05.968009 13434 ts_tablet_manager.cc:1428] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec: Time spent starting tablet: real 0.012s user 0.005s sys 0.008s
I20260808 02:34:05.969319 13437 raft_consensus.cc:348] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 37a04eb915494d89849650a389693f09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffe1b39e082240249ec189588cec8c3e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46491 } } peers { permanent_uuid: "179607ce40074bd2a5004b91dae9feec" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36569 } } peers { permanent_uuid: "37a04eb915494d89849650a389693f09" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37811 } }
I20260808 02:34:05.969772 13437 raft_consensus.cc:374] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 37a04eb915494d89849650a389693f09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:34:05.969879 13437 raft_consensus.cc:729] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 37a04eb915494d89849650a389693f09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37a04eb915494d89849650a389693f09, State: Initialized, Role: FOLLOWER
I20260808 02:34:05.970500 13437 consensus_queue.cc:260] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 37a04eb915494d89849650a389693f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffe1b39e082240249ec189588cec8c3e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46491 } } peers { permanent_uuid: "179607ce40074bd2a5004b91dae9feec" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36569 } } peers { permanent_uuid: "37a04eb915494d89849650a389693f09" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37811 } }
I20260808 02:34:05.971622 13440 raft_consensus.cc:348] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P ffe1b39e082240249ec189588cec8c3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffe1b39e082240249ec189588cec8c3e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46491 } } peers { permanent_uuid: "179607ce40074bd2a5004b91dae9feec" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36569 } } peers { permanent_uuid: "37a04eb915494d89849650a389693f09" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37811 } }
I20260808 02:34:05.972059 13440 raft_consensus.cc:374] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P ffe1b39e082240249ec189588cec8c3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:34:05.972170 13440 raft_consensus.cc:729] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P ffe1b39e082240249ec189588cec8c3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffe1b39e082240249ec189588cec8c3e, State: Initialized, Role: FOLLOWER
I20260808 02:34:05.972489 13437 ts_tablet_manager.cc:1428] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 37a04eb915494d89849650a389693f09: Time spent starting tablet: real 0.014s user 0.011s sys 0.004s
I20260808 02:34:05.972589 12982 heartbeater.cc:503] Master 127.24.116.254:42935 was elected leader, sending a full tablet report...
I20260808 02:34:05.972901 13440 consensus_queue.cc:260] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P ffe1b39e082240249ec189588cec8c3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffe1b39e082240249ec189588cec8c3e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46491 } } peers { permanent_uuid: "179607ce40074bd2a5004b91dae9feec" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36569 } } peers { permanent_uuid: "37a04eb915494d89849650a389693f09" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37811 } }
I20260808 02:34:05.974360 13440 ts_tablet_manager.cc:1428] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P ffe1b39e082240249ec189588cec8c3e: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
W20260808 02:34:06.124946 13194 tablet.cc:2369] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P ffe1b39e082240249ec189588cec8c3e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:34:06.152928 13450 raft_consensus.cc:482] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:34:06.153272 13450 raft_consensus.cc:504] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffe1b39e082240249ec189588cec8c3e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46491 } } peers { permanent_uuid: "179607ce40074bd2a5004b91dae9feec" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36569 } } peers { permanent_uuid: "37a04eb915494d89849650a389693f09" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37811 } }
I20260808 02:34:06.155189 13450 leader_election.cc:288] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffe1b39e082240249ec189588cec8c3e (127.24.116.194:46491), 37a04eb915494d89849650a389693f09 (127.24.116.193:37811)
I20260808 02:34:06.163060 13429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:06.155905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:46829 (local address 127.24.116.193:37811)
0808 02:34:06.156116 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:06.156122 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:06.156617 (+ 495us) server_negotiation.cc:407] Connection header received
0808 02:34:06.156715 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:06.156721 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:06.156832 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:06.156957 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:34:06.157346 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:06.158419 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:06.160729 (+ 2310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:06.162041 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:06.162228 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:06.162310 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:06.162645 (+ 335us) server_negotiation.cc:299] Negotiation successful
0808 02:34:06.162788 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 02:34:06.163051 13394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:06.155501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:37811 (local address 127.24.116.195:46829)
0808 02:34:06.156264 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:06.156287 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:06.156527 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:06.156971 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:06.156976 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:06.156998 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:34:06.157188 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:06.157197 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:06.158583 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:06.158588 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:06.160474 (+ 1886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:06.160491 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:06.162219 (+ 1728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:06.162225 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:06.162460 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:06.162486 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 02:34:06.162602 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 02:34:06.162745 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"mutex_wait_us":89}
I20260808 02:34:06.164235 13418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:06.155743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:58187 (local address 127.24.116.194:46491)
0808 02:34:06.156052 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:06.156063 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:06.156687 (+ 624us) server_negotiation.cc:407] Connection header received
0808 02:34:06.156992 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:06.156997 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:06.157078 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:06.157212 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:34:06.157794 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:06.158657 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:06.161245 (+ 2588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:06.162473 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:06.162634 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:06.162730 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:06.163836 (+ 1106us) server_negotiation.cc:299] Negotiation successful
0808 02:34:06.163986 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260808 02:34:06.164402 13456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:06.155624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:46491 (local address 127.24.116.195:58187)
0808 02:34:06.156570 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:06.156589 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:06.156803 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:06.157233 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:06.157238 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:06.157267 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:34:06.157628 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:06.157636 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:06.158850 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:06.158855 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:06.161070 (+ 2215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:06.161085 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:06.163365 (+ 2280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:06.163372 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:06.163549 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:06.163590 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 02:34:06.163782 (+ 192us) client_negotiation.cc:240] Negotiation successful
0808 02:34:06.163947 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":829,"mutex_wait_us":26,"thread_start_us":604,"threads_started":1}
I20260808 02:34:06.164289 12913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a9d4ca8bcd949ca92aa5f987fc4d22d" candidate_uuid: "179607ce40074bd2a5004b91dae9feec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37a04eb915494d89849650a389693f09" is_pre_election: true
I20260808 02:34:06.165035 12913 raft_consensus.cc:2454] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 37a04eb915494d89849650a389693f09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 179607ce40074bd2a5004b91dae9feec in term 0.
I20260808 02:34:06.165695 13129 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a9d4ca8bcd949ca92aa5f987fc4d22d" candidate_uuid: "179607ce40074bd2a5004b91dae9feec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffe1b39e082240249ec189588cec8c3e" is_pre_election: true
I20260808 02:34:06.165987 13232 leader_election.cc:302] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 179607ce40074bd2a5004b91dae9feec, 37a04eb915494d89849650a389693f09; no voters:
I20260808 02:34:06.166349 13129 raft_consensus.cc:2454] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P ffe1b39e082240249ec189588cec8c3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 179607ce40074bd2a5004b91dae9feec in term 0.
I20260808 02:34:06.166472 13450 raft_consensus.cc:2781] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:34:06.166621 13450 raft_consensus.cc:482] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:34:06.166713 13450 raft_consensus.cc:3037] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:34:06.169744 13450 raft_consensus.cc:504] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffe1b39e082240249ec189588cec8c3e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46491 } } peers { permanent_uuid: "179607ce40074bd2a5004b91dae9feec" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36569 } } peers { permanent_uuid: "37a04eb915494d89849650a389693f09" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37811 } }
I20260808 02:34:06.170389 13450 leader_election.cc:288] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec [CANDIDATE]: Term 1 election: Requested vote from peers ffe1b39e082240249ec189588cec8c3e (127.24.116.194:46491), 37a04eb915494d89849650a389693f09 (127.24.116.193:37811)
I20260808 02:34:06.170852 13129 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a9d4ca8bcd949ca92aa5f987fc4d22d" candidate_uuid: "179607ce40074bd2a5004b91dae9feec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffe1b39e082240249ec189588cec8c3e"
I20260808 02:34:06.170876 12913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a9d4ca8bcd949ca92aa5f987fc4d22d" candidate_uuid: "179607ce40074bd2a5004b91dae9feec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37a04eb915494d89849650a389693f09"
I20260808 02:34:06.171085 12913 raft_consensus.cc:3037] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 37a04eb915494d89849650a389693f09 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:34:06.171085 13129 raft_consensus.cc:3037] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P ffe1b39e082240249ec189588cec8c3e [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:34:06.174482 12913 raft_consensus.cc:2454] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 37a04eb915494d89849650a389693f09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 179607ce40074bd2a5004b91dae9feec in term 1.
I20260808 02:34:06.174482 13129 raft_consensus.cc:2454] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P ffe1b39e082240249ec189588cec8c3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 179607ce40074bd2a5004b91dae9feec in term 1.
I20260808 02:34:06.174964 13232 leader_election.cc:302] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 179607ce40074bd2a5004b91dae9feec, 37a04eb915494d89849650a389693f09; no voters:
I20260808 02:34:06.175351 13450 raft_consensus.cc:2781] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:34:06.175931 13450 raft_consensus.cc:686] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec [term 1 LEADER]: Becoming Leader. State: Replica: 179607ce40074bd2a5004b91dae9feec, State: Running, Role: LEADER
I20260808 02:34:06.176550 13450 consensus_queue.cc:237] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffe1b39e082240249ec189588cec8c3e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46491 } } peers { permanent_uuid: "179607ce40074bd2a5004b91dae9feec" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36569 } } peers { permanent_uuid: "37a04eb915494d89849650a389693f09" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37811 } }
W20260808 02:34:06.181882 12984 tablet.cc:2369] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 37a04eb915494d89849650a389693f09: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:34:06.181443 12689 catalog_manager.cc:5495] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec reported cstate change: term changed from 0 to 1, leader changed from <none> to 179607ce40074bd2a5004b91dae9feec (127.24.116.195). New cstate: current_term: 1 leader_uuid: "179607ce40074bd2a5004b91dae9feec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffe1b39e082240249ec189588cec8c3e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "179607ce40074bd2a5004b91dae9feec" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 36569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37a04eb915494d89849650a389693f09" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37811 } health_report { overall_health: UNKNOWN } } }
W20260808 02:34:06.214263 13398 tablet.cc:2369] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:34:06.245457 13421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:06.240045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57040 (local address 127.24.116.195:36569)
0808 02:34:06.240236 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:06.240241 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:06.240259 (+ 18us) server_negotiation.cc:407] Connection header received
0808 02:34:06.240537 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:06.240541 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:06.240624 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:06.240783 (+ 159us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:34:06.241106 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:06.241861 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:06.243211 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:06.243596 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:06.243688 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:06.244261 (+ 573us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:34:06.244863 (+ 602us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:34:06.244988 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:06.245091 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 02:34:06.245157 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 02:34:06.253598 12913 raft_consensus.cc:1261] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 37a04eb915494d89849650a389693f09 [term 1 FOLLOWER]: Refusing update from remote peer 179607ce40074bd2a5004b91dae9feec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:34:06.253610 13129 raft_consensus.cc:1261] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P ffe1b39e082240249ec189588cec8c3e [term 1 FOLLOWER]: Refusing update from remote peer 179607ce40074bd2a5004b91dae9feec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:34:06.254633 13450 consensus_queue.cc:1035] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec [LEADER]: Connected to new peer: Peer: permanent_uuid: "37a04eb915494d89849650a389693f09" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:34:06.254930 13457 consensus_queue.cc:1035] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffe1b39e082240249ec189588cec8c3e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 46491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:34:06.285389 12689 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:34:06.285684 12689 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:34:06.289224 12689 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bd388ed5b9d54d09a5f521c28b30350a: Sending DeleteTablet for 3 replicas of tablet 9a9d4ca8bcd949ca92aa5f987fc4d22d
I20260808 02:34:06.290452 13096 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a9d4ca8bcd949ca92aa5f987fc4d22d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:34:06 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:59568
I20260808 02:34:06.290489 13296 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a9d4ca8bcd949ca92aa5f987fc4d22d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:34:06 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:57036
I20260808 02:34:06.290532 12890 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a9d4ca8bcd949ca92aa5f987fc4d22d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:34:06 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:53614
I20260808 02:34:06.294495 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 12746
I20260808 02:34:06.300980 13476 tablet_replica.cc:330] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P ffe1b39e082240249ec189588cec8c3e: stopping tablet replica
I20260808 02:34:06.301146 13477 tablet_replica.cc:330] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 37a04eb915494d89849650a389693f09: stopping tablet replica
I20260808 02:34:06.301535 13476 raft_consensus.cc:2229] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P ffe1b39e082240249ec189588cec8c3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:34:06.301587 13477 raft_consensus.cc:2229] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 37a04eb915494d89849650a389693f09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:34:06.302103 13477 raft_consensus.cc:2258] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 37a04eb915494d89849650a389693f09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:34:06.302111 13476 raft_consensus.cc:2258] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P ffe1b39e082240249ec189588cec8c3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:34:06.303730 13478 tablet_replica.cc:330] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec: stopping tablet replica
I20260808 02:34:06.304131 13478 raft_consensus.cc:2229] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:34:06.304829 13478 raft_consensus.cc:2258] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:34:06.305635 13476 ts_tablet_manager.cc:1905] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P ffe1b39e082240249ec189588cec8c3e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:34:06.305630 13477 ts_tablet_manager.cc:1905] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 37a04eb915494d89849650a389693f09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:34:06.308434 13478 ts_tablet_manager.cc:1905] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:34:06.313366 13477 ts_tablet_manager.cc:1918] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 37a04eb915494d89849650a389693f09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:34:06.313546 13477 log.cc:1196] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 37a04eb915494d89849650a389693f09: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/9a9d4ca8bcd949ca92aa5f987fc4d22d
I20260808 02:34:06.314146 13477 ts_tablet_manager.cc:1939] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 37a04eb915494d89849650a389693f09: Deleting consensus metadata
I20260808 02:34:06.316191 12664 catalog_manager.cc:4841] TS 37a04eb915494d89849650a389693f09 (127.24.116.193:37811): tablet 9a9d4ca8bcd949ca92aa5f987fc4d22d (table test-table [id=44ace7304c9c46de9def1e92b389ba10]) successfully deleted
I20260808 02:34:06.317054 13476 ts_tablet_manager.cc:1918] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P ffe1b39e082240249ec189588cec8c3e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:34:06.317226 13476 log.cc:1196] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P ffe1b39e082240249ec189588cec8c3e: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/9a9d4ca8bcd949ca92aa5f987fc4d22d
I20260808 02:34:06.317754 13476 ts_tablet_manager.cc:1939] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P ffe1b39e082240249ec189588cec8c3e: Deleting consensus metadata
I20260808 02:34:06.319566 12663 catalog_manager.cc:4841] TS ffe1b39e082240249ec189588cec8c3e (127.24.116.194:46491): tablet 9a9d4ca8bcd949ca92aa5f987fc4d22d (table test-table [id=44ace7304c9c46de9def1e92b389ba10]) successfully deleted
I20260808 02:34:06.323360 13429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:06.295536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53624 (local address 127.24.116.193:37811)
0808 02:34:06.295759 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:06.295768 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:06.303387 (+ 7619us) server_negotiation.cc:407] Connection header received
0808 02:34:06.303468 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:06.303475 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:06.303547 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:06.303702 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:06.306158 (+ 2456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:06.307349 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:06.309513 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:06.310165 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:06.310265 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:06.314216 (+ 3951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:06.314232 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:06.314254 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:06.314301 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:06.318669 (+ 4368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:06.319781 (+ 1112us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:06.319792 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:06.319796 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:06.319965 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:06.320457 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:06.320462 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:06.320466 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:06.320983 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:06.321321 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:06.322593 (+ 1272us) server_negotiation.cc:299] Negotiation successful
0808 02:34:06.322865 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":88}
I20260808 02:34:06.324440 12976 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:06.324560 13478 ts_tablet_manager.cc:1918] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:34:06.324733 13478 log.cc:1196] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/9a9d4ca8bcd949ca92aa5f987fc4d22d
I20260808 02:34:06.325304 13478 ts_tablet_manager.cc:1939] T 9a9d4ca8bcd949ca92aa5f987fc4d22d P 179607ce40074bd2a5004b91dae9feec: Deleting consensus metadata
I20260808 02:34:06.327189 12664 catalog_manager.cc:4841] TS 179607ce40074bd2a5004b91dae9feec (127.24.116.195:36569): tablet 9a9d4ca8bcd949ca92aa5f987fc4d22d (table test-table [id=44ace7304c9c46de9def1e92b389ba10]) successfully deleted
I20260808 02:34:06.434540 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 12746
I20260808 02:34:06.462250 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 12989
I20260808 02:34:06.477771 13418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:06.463122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59572 (local address 127.24.116.194:46491)
0808 02:34:06.463301 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:06.463308 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:06.463354 (+ 46us) server_negotiation.cc:407] Connection header received
0808 02:34:06.463581 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:06.463586 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:06.463688 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:06.463813 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:06.465309 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:06.466081 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:06.467733 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:06.468545 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:06.468681 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:06.471349 (+ 2668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:06.471364 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:06.471382 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:06.471417 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:06.474621 (+ 3204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:06.475604 (+ 983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:06.475612 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:06.475615 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:06.475781 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:06.476216 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:06.476220 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:06.476222 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:06.476634 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:06.476880 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:06.477269 (+ 389us) server_negotiation.cc:299] Negotiation successful
0808 02:34:06.477439 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 02:34:06.478472 13186 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:06.569857 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 12989
I20260808 02:34:06.598354 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 13204
I20260808 02:34:06.615965 13421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:06.599232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57054 (local address 127.24.116.195:36569)
0808 02:34:06.599425 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:06.599430 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:06.599532 (+ 102us) server_negotiation.cc:407] Connection header received
0808 02:34:06.599745 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:06.599749 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:06.599821 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:06.599929 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:06.601892 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:06.602677 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:06.604849 (+ 2172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:06.605308 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:06.605422 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:06.609174 (+ 3752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:06.609186 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:06.609202 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:06.609242 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:06.612613 (+ 3371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:06.613567 (+ 954us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:06.613574 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:06.613576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:06.613734 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:06.614189 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:06.614193 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:06.614195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:06.614573 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:06.614816 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:06.615181 (+ 365us) server_negotiation.cc:299] Negotiation successful
0808 02:34:06.615489 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 02:34:06.616840 13385 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:06.742113 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 13204
I20260808 02:34:06.772701 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 12642
I20260808 02:34:06.774070 12733 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:06.891366 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 12642
I20260808 02:34:06.926340 25043 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 02:34:07.272562 25043 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 02:34:07.272859 25043 mini_ranger.cc:66] Stopping Ranger...
I20260808 02:34:07.627948 25043 mini_ranger.cc:68] Stopped Ranger
2026-08-08 02:34:07.628 UTC [11146] LOG: received smart shutdown request
2026-08-08 02:34:07.632 UTC [11146] LOG: background worker "logical replication launcher" (PID 11159) exited with exit code 1
2026-08-08 02:34:07.632 UTC [11150] LOG: shutting down
2026-08-08 02:34:07.811 UTC [11146] LOG: database system is shut down
2026-08-08T02:34:07Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (56492 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:34:08 dist-test-slave-45dx krb5kdc[13499](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:34:08 dist-test-slave-45dx krb5kdc[13499](info): set up 2 sockets
Aug 08 02:34:08 dist-test-slave-45dx krb5kdc[13499](info): commencing operation
krb5kdc: starting...
W20260808 02:34:09.294345 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.301s user 0.001s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:34:09 dist-test-slave-45dx krb5kdc[13499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:34:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:34:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:34:09.601558 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:34965
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:46883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:34965,127.24.116.253:42807,127.24.116.252:44417
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:34:09.948253 13519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:09.948670 13519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:09.948834 13519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:09.956228 13519 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:34:09.956425 13519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:09.956540 13519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:09.956626 13519 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:34:09.956710 13519 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:34:09.966876 13519 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:46883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:34965,127.24.116.253:42807,127.24.116.252:44417
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:34965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:09.968281 13519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:09.969699 13519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:09.981843 13524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:09.981781 13525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:09.982261 13527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:09.982527 13519 server_base.cc:1034] running on GCE node
I20260808 02:34:09.983374 13519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:09.984840 13519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:09.986090 13519 hybrid_clock.cc:648] HybridClock initialized: now 1786156449986052 us; error 38 us; skew 500 ppm
I20260808 02:34:09.986469 13519 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:09 dist-test-slave-45dx krb5kdc[13499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156449, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:09.989830 13519 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:34:09.991425 13519 webserver.cc:460] Webserver started at http://127.24.116.254:46617/ using document root <none> and password file <none>
I20260808 02:34:09.992173 13519 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:09.992376 13519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:34:09.992715 13519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:34:09.995755 13519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "d92e29c907cc4ae19c931a2b65e43481"
format_stamp: "Formatted at 2026-08-08 02:34:09 on dist-test-slave-45dx"
server_key: "cdcb00c3da9b7d97a858da15e5d22aab"
server_key_iv: "89dfefd66aa51906f7694dd839300aac"
server_key_version: "encryptionkey@0"
I20260808 02:34:09.996691 13519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "d92e29c907cc4ae19c931a2b65e43481"
format_stamp: "Formatted at 2026-08-08 02:34:09 on dist-test-slave-45dx"
server_key: "cdcb00c3da9b7d97a858da15e5d22aab"
server_key_iv: "89dfefd66aa51906f7694dd839300aac"
server_key_version: "encryptionkey@0"
I20260808 02:34:10.002092 13519 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 02:34:10.006067 13538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:10.007460 13519 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 02:34:10.007668 13519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "d92e29c907cc4ae19c931a2b65e43481"
format_stamp: "Formatted at 2026-08-08 02:34:09 on dist-test-slave-45dx"
server_key: "cdcb00c3da9b7d97a858da15e5d22aab"
server_key_iv: "89dfefd66aa51906f7694dd839300aac"
server_key_version: "encryptionkey@0"
I20260808 02:34:10.007891 13519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:10.038187 13519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:10.043198 13519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:10.043536 13519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:10.063887 13519 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:34965
I20260808 02:34:10.063983 13620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:34965 every 8 connection(s)
I20260808 02:34:10.065445 13519 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:34:10.069571 13621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:34:10.072192 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 13519
I20260808 02:34:10.072494 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:34:10.073529 25043 external_mini_cluster.cc:1428] Setting key e7e12ae9f0b157bd8272f03fcff80081
I20260808 02:34:10.080389 13621 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34965 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:34:10 dist-test-slave-45dx krb5kdc[13499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156449, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.116.253@KRBTEST.COM; defaulting to no policy
I20260808 02:34:10.107312 13624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.084821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60330 (local address 127.24.116.254:34965)
0808 02:34:10.086605 (+ 1784us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:10.086613 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:10.086665 (+ 52us) server_negotiation.cc:407] Connection header received
0808 02:34:10.088221 (+ 1556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:10.088226 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:10.088556 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:10.088757 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:10.090006 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:10.092042 (+ 2036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:10.093589 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:10.094624 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:10.094831 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:10.098430 (+ 3599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:10.098443 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:10.098462 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:10.098504 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:10.102679 (+ 4175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:10.103469 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:10.103480 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:10.103485 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:10.103753 (+ 268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:10.104200 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:10.104208 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:10.104214 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:10.105013 (+ 799us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:10.105240 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:10.105861 (+ 621us) server_negotiation.cc:299] Negotiation successful
0808 02:34:10.106148 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":54,"server-negotiator.queue_time_us":1556,"spinlock_wait_cycles":17664,"thread_start_us":1330,"threads_started":1}
I20260808 02:34:10.107323 13623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.084821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:34965 (local address 127.0.0.1:60330)
0808 02:34:10.085730 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.085780 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:10.087857 (+ 2077us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:10.088822 (+ 965us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:10.088827 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:10.089425 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:34:10.089795 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:10.089813 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:10.092235 (+ 2422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:10.092239 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:10.093424 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:10.093446 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:10.094905 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:10.094911 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:10.095064 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:10.095775 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:34:10.095805 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:34:10.098143 (+ 2338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:34:10.102836 (+ 4693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:10.102847 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:10.102857 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:10.103298 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:10.103888 (+ 590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:10.103891 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:10.103894 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:10.104063 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:10.105202 (+ 1139us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:34:10.105213 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:34:10.105458 (+ 245us) client_negotiation.cc:769] Sending connection context
0808 02:34:10.105683 (+ 225us) client_negotiation.cc:240] Negotiation successful
0808 02:34:10.106391 (+ 708us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"mutex_wait_us":206,"thread_start_us":408,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.253@KRBTEST.COM" created.
I20260808 02:34:10.110425 13621 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } has no permanent_uuid. Determining permanent_uuid...
I20260808 02:34:10.111703 13623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.111143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:42807 (local address 127.0.0.1:54100)
0808 02:34:10.111348 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.111524 (+ 176us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:42807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 02:34:10.112040 13539 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.116.253:42807: connect: Connection refused (error 111)
I20260808 02:34:10.114020 13623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.113542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:42807 (local address 127.0.0.1:54108)
0808 02:34:10.113727 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.113836 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:42807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 02:34:10.114270 13621 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.253:42807: Network error: Client connection negotiation failed: client connection to 127.24.116.253:42807: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.253.keytab.
Entry for principal kudu/127.24.116.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.253.keytab.
I20260808 02:34:10.144521 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.253:42807
--webserver_interface=127.24.116.253
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.253.keytab
--principal=kudu/127.24.116.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:46883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:34965,127.24.116.253:42807,127.24.116.252:44417
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:34:10.163745 13621 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } attempt: 1
I20260808 02:34:10.165132 13623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.164652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:42807 (local address 127.0.0.1:54122)
0808 02:34:10.164857 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.164985 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:42807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260808 02:34:10.166182 13623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.165826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:42807 (local address 127.0.0.1:54128)
0808 02:34:10.165975 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.166053 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:42807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 02:34:10.166493 13621 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.253:42807: Network error: Client connection negotiation failed: client connection to 127.24.116.253:42807: connect: Connection refused (error 111)
I20260808 02:34:10.234830 13621 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } attempt: 2
I20260808 02:34:10.236285 13623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.235677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:42807 (local address 127.0.0.1:54132)
0808 02:34:10.235966 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.236099 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:42807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260808 02:34:10.237473 13623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.237029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:42807 (local address 127.0.0.1:54146)
0808 02:34:10.237195 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.237277 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:42807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 02:34:10.237763 13621 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.253:42807: Network error: Client connection negotiation failed: client connection to 127.24.116.253:42807: connect: Connection refused (error 111)
I20260808 02:34:10.329078 13621 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } attempt: 3
I20260808 02:34:10.330466 13623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.329889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:42807 (local address 127.0.0.1:54162)
0808 02:34:10.330133 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.330267 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:42807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260808 02:34:10.331796 13623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.331265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:42807 (local address 127.0.0.1:54168)
0808 02:34:10.331469 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.331582 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:42807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260808 02:34:10.332077 13621 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.253:42807: Network error: Client connection negotiation failed: client connection to 127.24.116.253:42807: connect: Connection refused (error 111)
I20260808 02:34:10.475386 13621 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } attempt: 4
I20260808 02:34:10.476820 13623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.476068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:42807 (local address 127.0.0.1:54178)
0808 02:34:10.476485 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.476615 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:42807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188}
I20260808 02:34:10.478018 13623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.477581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:42807 (local address 127.0.0.1:54182)
0808 02:34:10.477747 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.477855 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:42807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 02:34:10.478240 13621 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.253:42807: Network error: Client connection negotiation failed: client connection to 127.24.116.253:42807: connect: Connection refused (error 111)
W20260808 02:34:10.503693 13628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:10.504001 13628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:10.504156 13628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:10.511536 13628 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:34:10.511656 13628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:10.511749 13628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:10.511847 13628 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:34:10.511916 13628 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:34:10.522222 13628 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:46883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:34965,127.24.116.253:42807,127.24.116.252:44417
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.253.keytab
--principal=kudu/127.24.116.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.253:42807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.24.116.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:10.523757 13628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:10.525234 13628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:10.537724 13640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:10.538087 13635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:10.538257 13636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:10.538910 13628 server_base.cc:1034] running on GCE node
I20260808 02:34:10.539757 13628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:10.541232 13628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:10.542474 13628 hybrid_clock.cc:648] HybridClock initialized: now 1786156450542428 us; error 43 us; skew 500 ppm
I20260808 02:34:10.542834 13628 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:10 dist-test-slave-45dx krb5kdc[13499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156450, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:10.546284 13628 init.cc:377] Logged in from keytab as kudu/127.24.116.253@KRBTEST.COM (short username kudu)
I20260808 02:34:10.547989 13628 webserver.cc:460] Webserver started at http://127.24.116.253:46101/ using document root <none> and password file <none>
I20260808 02:34:10.548832 13628 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:10.548995 13628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:34:10.549331 13628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:34:10.552548 13628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-1/data/instance:
uuid: "b703f8eb49584974892b2eb8c0f64025"
format_stamp: "Formatted at 2026-08-08 02:34:10 on dist-test-slave-45dx"
server_key: "f7eceec5e9c68e87f8a5cb0ddc53024c"
server_key_iv: "d99da452ec1116a15a7803992b32064e"
server_key_version: "encryptionkey@0"
I20260808 02:34:10.553376 13628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-1/wal/instance:
uuid: "b703f8eb49584974892b2eb8c0f64025"
format_stamp: "Formatted at 2026-08-08 02:34:10 on dist-test-slave-45dx"
server_key: "f7eceec5e9c68e87f8a5cb0ddc53024c"
server_key_iv: "d99da452ec1116a15a7803992b32064e"
server_key_version: "encryptionkey@0"
I20260808 02:34:10.558733 13628 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 02:34:10.562381 13652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:10.563726 13628 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 02:34:10.563938 13628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-1/wal
uuid: "b703f8eb49584974892b2eb8c0f64025"
format_stamp: "Formatted at 2026-08-08 02:34:10 on dist-test-slave-45dx"
server_key: "f7eceec5e9c68e87f8a5cb0ddc53024c"
server_key_iv: "d99da452ec1116a15a7803992b32064e"
server_key_version: "encryptionkey@0"
I20260808 02:34:10.564147 13628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:10.582125 13628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:10.586498 13628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:10.586812 13628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:10.606573 13628 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.253:42807
I20260808 02:34:10.606611 13718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.253:42807 every 8 connection(s)
I20260808 02:34:10.608139 13628 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-1/data/info.pb
I20260808 02:34:10.612130 13720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:34:10.615752 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 13628
I20260808 02:34:10.615983 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-1/wal/instance
I20260808 02:34:10.616535 25043 external_mini_cluster.cc:1428] Setting key ddc6c4efc3eca4add28fe127f6792866
I20260808 02:34:10.619032 13720 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34965 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:34:10 dist-test-slave-45dx krb5kdc[13499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156450, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.253@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:34:10.643020 13728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.621780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60344 (local address 127.24.116.254:34965)
0808 02:34:10.622406 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:10.622416 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:10.623381 (+ 965us) server_negotiation.cc:407] Connection header received
0808 02:34:10.625499 (+ 2118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:10.625508 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:10.625615 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:10.625747 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:10.627630 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:10.628732 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:10.631613 (+ 2881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:10.632054 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:10.632153 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:10.636908 (+ 4755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:10.636914 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:10.636917 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:10.636955 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:10.639746 (+ 2791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:10.640593 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:10.640598 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:10.640604 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:10.640734 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:10.641201 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:10.641208 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:10.641216 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:10.641509 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:10.641673 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:10.642412 (+ 739us) server_negotiation.cc:299] Negotiation successful
0808 02:34:10.642634 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":313,"threads_started":1}
I20260808 02:34:10.644086 13729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.622366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:34965 (local address 127.0.0.1:60344)
0808 02:34:10.623190 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.623245 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:10.625163 (+ 1918us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:10.626082 (+ 919us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:10.626092 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:10.626738 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:34:10.627413 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:10.627435 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:10.628929 (+ 1494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:10.628937 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:10.631438 (+ 2501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:10.631459 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:10.632354 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:10.632366 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:10.632739 (+ 373us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:10.633613 (+ 874us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:34:10.633652 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:34:10.636658 (+ 3006us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:34:10.639908 (+ 3250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:10.639918 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:10.639937 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:10.640471 (+ 534us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:10.640849 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:10.640854 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:10.640857 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:10.641076 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:10.641651 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:34:10.641659 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:34:10.642032 (+ 373us) client_negotiation.cc:769] Sending connection context
0808 02:34:10.642305 (+ 273us) client_negotiation.cc:240] Negotiation successful
0808 02:34:10.642823 (+ 518us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":369,"threads_started":1}
I20260808 02:34:10.646011 13720 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.24.116.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.252@KRBTEST.COM" created.
Aug 08 02:34:10 dist-test-slave-45dx krb5kdc[13499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156450, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.253@KRBTEST.COM for kudu/127.24.116.253@KRBTEST.COM
I20260808 02:34:10.662425 13729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.646922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:42807 (local address 127.0.0.1:54188)
0808 02:34:10.647103 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.647126 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:10.647227 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:10.648368 (+ 1141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:10.648373 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:10.648933 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:34:10.649077 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:10.649086 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:10.650492 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:10.650500 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:10.651474 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:10.651492 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:10.652583 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:10.652597 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:10.652850 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:10.653531 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:34:10.653561 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:34:10.656188 (+ 2627us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:34:10.659744 (+ 3556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:10.659749 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:10.659753 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:10.660132 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:10.660572 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:10.660578 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:10.660581 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:10.660730 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:10.661354 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:34:10.661361 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:34:10.661520 (+ 159us) client_negotiation.cc:769] Sending connection context
0808 02:34:10.661681 (+ 161us) client_negotiation.cc:240] Negotiation successful
0808 02:34:10.661998 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 02:34:10.662513 13731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.647215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54188 (local address 127.24.116.253:42807)
0808 02:34:10.647936 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:10.647943 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:10.647967 (+ 24us) server_negotiation.cc:407] Connection header received
0808 02:34:10.648009 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:10.648015 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:10.648188 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:10.648371 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:10.649243 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:10.650357 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:10.651654 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:10.652396 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:10.652516 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:10.656515 (+ 3999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:10.656529 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:10.656544 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:10.656574 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:10.659584 (+ 3010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:10.660275 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:10.660291 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:10.660294 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:10.660457 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:10.660837 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:10.660844 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:10.660847 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:10.661228 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:10.661468 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:10.661837 (+ 369us) server_negotiation.cc:299] Negotiation successful
0808 02:34:10.662127 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":550,"thread_start_us":420,"threads_started":1}
I20260808 02:34:10.664904 13720 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } has no permanent_uuid. Determining permanent_uuid...
I20260808 02:34:10.666188 13729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.665622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:44417 (local address 127.0.0.1:41894)
0808 02:34:10.665879 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.666011 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
W20260808 02:34:10.666484 13655 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
I20260808 02:34:10.668442 13729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.667956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:44417 (local address 127.0.0.1:41910)
0808 02:34:10.668161 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.668249 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 02:34:10.668695 13720 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:44417: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.252.keytab.
Entry for principal kudu/127.24.116.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.252.keytab.
I20260808 02:34:10.688714 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.252:44417
--webserver_interface=127.24.116.252
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.252.keytab
--principal=kudu/127.24.116.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:46883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:34965,127.24.116.253:42807,127.24.116.252:44417
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:34:10.718076 13720 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } attempt: 1
I20260808 02:34:10.719358 13729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.718862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:44417 (local address 127.0.0.1:41924)
0808 02:34:10.719068 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.719189 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 02:34:10.720474 13729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.720069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:44417 (local address 127.0.0.1:41928)
0808 02:34:10.720221 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.720352 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 02:34:10.720719 13720 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:44417: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
I20260808 02:34:10.777529 13621 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } attempt: 5
Aug 08 02:34:10 dist-test-slave-45dx krb5kdc[13499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156449, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for kudu/127.24.116.253@KRBTEST.COM
I20260808 02:34:10.789002 13720 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } attempt: 2
I20260808 02:34:10.790148 13729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.789626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:44417 (local address 127.0.0.1:41940)
0808 02:34:10.789886 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.789978 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260808 02:34:10.792059 13729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.791585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:44417 (local address 127.0.0.1:41956)
0808 02:34:10.791778 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.791873 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260808 02:34:10.792929 13720 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:44417: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
I20260808 02:34:10.793881 13731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.778462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54190 (local address 127.24.116.253:42807)
0808 02:34:10.778664 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:10.778671 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:10.778698 (+ 27us) server_negotiation.cc:407] Connection header received
0808 02:34:10.778869 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:10.778875 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:10.778962 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:10.779080 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:10.779942 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:10.781057 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:10.782443 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:10.783163 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:10.783305 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:10.786656 (+ 3351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:10.786662 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:10.786667 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:10.786710 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:10.790601 (+ 3891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:10.791366 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:10.791372 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:10.791376 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:10.791531 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:10.792020 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:10.792026 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:10.792030 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:10.792571 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:10.792763 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:10.793282 (+ 519us) server_negotiation.cc:299] Negotiation successful
0808 02:34:10.793535 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 02:34:10.793929 13623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.778306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:42807 (local address 127.0.0.1:54190)
0808 02:34:10.778548 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.778577 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:10.778709 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:10.779156 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:10.779161 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:10.779581 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:34:10.779744 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:10.779752 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:10.781222 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:10.781226 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:10.782285 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:10.782300 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:10.783368 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:10.783373 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:10.783512 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:10.784217 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:34:10.784237 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:34:10.786434 (+ 2197us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:34:10.790789 (+ 4355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:10.790794 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:10.790797 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:10.791232 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:10.791674 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:10.791679 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:10.791683 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:10.791883 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:10.792735 (+ 852us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:34:10.792741 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:34:10.792961 (+ 220us) client_negotiation.cc:769] Sending connection context
0808 02:34:10.793158 (+ 197us) client_negotiation.cc:240] Negotiation successful
0808 02:34:10.793535 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260808 02:34:10.795006 13621 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } has no permanent_uuid. Determining permanent_uuid...
I20260808 02:34:10.796267 13623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.795757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:44417 (local address 127.0.0.1:41958)
0808 02:34:10.796021 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.796119 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260808 02:34:10.797434 13623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.797031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:44417 (local address 127.0.0.1:41962)
0808 02:34:10.797201 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.797294 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 02:34:10.797740 13621 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:44417: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
I20260808 02:34:10.849045 13621 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } attempt: 1
I20260808 02:34:10.850426 13623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.849938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:44417 (local address 127.0.0.1:41978)
0808 02:34:10.850152 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.850262 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260808 02:34:10.851490 13623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.851136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:44417 (local address 127.0.0.1:41994)
0808 02:34:10.851289 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.851374 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 02:34:10.851722 13621 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:44417: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
I20260808 02:34:10.884243 13720 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } attempt: 3
I20260808 02:34:10.885597 13729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.885003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:44417 (local address 127.0.0.1:41998)
0808 02:34:10.885254 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.885389 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260808 02:34:10.886868 13729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.886346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:44417 (local address 127.0.0.1:42002)
0808 02:34:10.886607 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.886708 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149}
W20260808 02:34:10.887102 13720 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:44417: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
I20260808 02:34:10.919955 13621 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } attempt: 2
I20260808 02:34:10.921306 13623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.920758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:44417 (local address 127.0.0.1:42014)
0808 02:34:10.921019 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.921132 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260808 02:34:10.922307 13623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:10.921986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:44417 (local address 127.0.0.1:42024)
0808 02:34:10.922139 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:10.922212 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 02:34:10.922508 13621 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:44417: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
I20260808 02:34:11.028733 13621 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } attempt: 3
I20260808 02:34:11.030062 13623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:11.029455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:44417 (local address 127.0.0.1:42028)
0808 02:34:11.029707 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:11.029819 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260808 02:34:11.030347 13720 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } attempt: 4
I20260808 02:34:11.031255 13623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:11.030828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:44417 (local address 127.0.0.1:42030)
0808 02:34:11.031047 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:11.031129 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260808 02:34:11.031417 13729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:11.030937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:44417 (local address 127.0.0.1:42034)
0808 02:34:11.031135 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:11.031237 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 02:34:11.031454 13621 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:44417: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
I20260808 02:34:11.032562 13729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:11.032184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:44417 (local address 127.0.0.1:42038)
0808 02:34:11.032396 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:11.032465 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260808 02:34:11.032836 13720 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:44417: Network error: Client connection negotiation failed: client connection to 127.24.116.252:44417: connect: Connection refused (error 111)
W20260808 02:34:11.052731 13734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:11.053043 13734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:11.053212 13734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:11.060910 13734 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:34:11.061028 13734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:11.061110 13734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:11.061223 13734 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:34:11.061290 13734 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:34:11.071964 13734 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:46883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:34965,127.24.116.253:42807,127.24.116.252:44417
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.252.keytab
--principal=kudu/127.24.116.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.252:44417
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.24.116.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:11.073297 13734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:11.074610 13734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:11.086861 13739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:11.086835 13740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:11.086841 13745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:11.087653 13734 server_base.cc:1034] running on GCE node
I20260808 02:34:11.088562 13734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:11.089946 13734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:11.091178 13734 hybrid_clock.cc:648] HybridClock initialized: now 1786156451091130 us; error 63 us; skew 500 ppm
I20260808 02:34:11.091523 13734 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:11 dist-test-slave-45dx krb5kdc[13499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156451, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:11.094882 13734 init.cc:377] Logged in from keytab as kudu/127.24.116.252@KRBTEST.COM (short username kudu)
I20260808 02:34:11.096475 13734 webserver.cc:460] Webserver started at http://127.24.116.252:43911/ using document root <none> and password file <none>
I20260808 02:34:11.097188 13734 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:11.097340 13734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:34:11.097674 13734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:34:11.100800 13734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-2/data/instance:
uuid: "01f9ab7307be4ce4b8c2a9527f8987e1"
format_stamp: "Formatted at 2026-08-08 02:34:11 on dist-test-slave-45dx"
server_key: "21419ed3e9adbabc1503a1865375cd5a"
server_key_iv: "72e0868d5a04e4a18a6631a586b642a1"
server_key_version: "encryptionkey@0"
I20260808 02:34:11.101639 13734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-2/wal/instance:
uuid: "01f9ab7307be4ce4b8c2a9527f8987e1"
format_stamp: "Formatted at 2026-08-08 02:34:11 on dist-test-slave-45dx"
server_key: "21419ed3e9adbabc1503a1865375cd5a"
server_key_iv: "72e0868d5a04e4a18a6631a586b642a1"
server_key_version: "encryptionkey@0"
I20260808 02:34:11.107038 13734 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 02:34:11.110771 13764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:11.112260 13734 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 02:34:11.112557 13734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-2/wal
uuid: "01f9ab7307be4ce4b8c2a9527f8987e1"
format_stamp: "Formatted at 2026-08-08 02:34:11 on dist-test-slave-45dx"
server_key: "21419ed3e9adbabc1503a1865375cd5a"
server_key_iv: "72e0868d5a04e4a18a6631a586b642a1"
server_key_version: "encryptionkey@0"
I20260808 02:34:11.112771 13734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:11.148195 13734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:11.153096 13734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:11.153414 13734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:11.172919 13734 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.252:44417
I20260808 02:34:11.172969 13840 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.252:44417 every 8 connection(s)
I20260808 02:34:11.174394 13734 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-2/data/info.pb
I20260808 02:34:11.178459 13841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:34:11.180469 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 13734
I20260808 02:34:11.180675 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156232048520-25043-0/minicluster-data/master-2/wal/instance
I20260808 02:34:11.181288 25043 external_mini_cluster.cc:1428] Setting key 0b6bb4f9c38790963f298bac795fe770
I20260808 02:34:11.189059 13841 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34965 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:34:11 dist-test-slave-45dx krb5kdc[13499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156451, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.252@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
Aug 08 02:34:11 dist-test-slave-45dx krb5kdc[13499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.252@KRBTEST.COM
I20260808 02:34:11.208700 13621 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } attempt: 4
I20260808 02:34:11.214005 13848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:11.191949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60354 (local address 127.24.116.254:34965)
0808 02:34:11.193355 (+ 1406us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:11.193360 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:11.193375 (+ 15us) server_negotiation.cc:407] Connection header received
0808 02:34:11.193426 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:11.193429 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:11.193485 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:11.193611 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:11.194944 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.195626 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.197088 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.197492 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.197625 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:11.205483 (+ 7858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:11.205492 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:11.205497 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:11.205545 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:11.208625 (+ 3080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:11.210868 (+ 2243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:11.210874 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:11.210879 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:11.211129 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:11.211640 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:11.211645 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:11.211649 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:11.211929 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:11.212116 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:11.213192 (+ 1076us) server_negotiation.cc:299] Negotiation successful
0808 02:34:11.213475 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1299,"thread_start_us":1168,"threads_started":1}
I20260808 02:34:11.215181 13846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:11.191853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:34965 (local address 127.0.0.1:60354)
0808 02:34:11.192710 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:11.192754 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:11.192916 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:11.193676 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:11.193683 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:11.194462 (+ 779us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:34:11.194769 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:11.194778 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.195786 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.195800 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:11.196926 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:11.196940 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.197749 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.197757 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:11.197917 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:11.202627 (+ 4710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:34:11.202657 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:34:11.205216 (+ 2559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:34:11.208840 (+ 3624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:11.208862 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:11.208878 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:11.210623 (+ 1745us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:11.211270 (+ 647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:11.211277 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:11.211282 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:11.211536 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:11.212153 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:34:11.212162 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:34:11.212645 (+ 483us) client_negotiation.cc:769] Sending connection context
0808 02:34:11.213044 (+ 399us) client_negotiation.cc:240] Negotiation successful
0808 02:34:11.213568 (+ 524us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":338,"threads_started":1}
I20260808 02:34:11.216152 13845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:11.183548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42052 (local address 127.24.116.252:44417)
0808 02:34:11.184514 (+ 966us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:11.184527 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:11.184572 (+ 45us) server_negotiation.cc:407] Connection header received
0808 02:34:11.186205 (+ 1633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:11.186231 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:11.186668 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:11.187009 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:11.189001 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.190385 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.192262 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.193460 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.193691 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:11.206776 (+ 13085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:11.206787 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:11.206805 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:11.206849 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:11.211158 (+ 4309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:11.212357 (+ 1199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:11.212367 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:11.212371 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:11.212540 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:11.213132 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:11.213137 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:11.213140 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:11.213578 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:11.215259 (+ 1681us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:11.215483 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 02:34:11.215758 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":702,"thread_start_us":436,"threads_started":1}
I20260808 02:34:11.218660 13841 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:34:11 dist-test-slave-45dx krb5kdc[13499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156449, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for kudu/127.24.116.252@KRBTEST.COM
Aug 08 02:34:11 dist-test-slave-45dx krb5kdc[13499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156451, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.252@KRBTEST.COM for kudu/127.24.116.253@KRBTEST.COM
I20260808 02:34:11.228360 13623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:11.209333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:44417 (local address 127.0.0.1:42062)
0808 02:34:11.209514 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:11.209534 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:11.209631 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:11.210599 (+ 968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:11.210604 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:11.211119 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:34:11.211367 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:11.211380 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.213228 (+ 1848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.213233 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:11.214790 (+ 1557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:11.214822 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.215928 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.215936 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:11.216160 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:11.216883 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:34:11.216905 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:34:11.220558 (+ 3653us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:34:11.224877 (+ 4319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:11.224882 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:11.224887 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:11.225556 (+ 669us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:11.226057 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:11.226064 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:11.226070 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:11.226245 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:11.227151 (+ 906us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:34:11.227158 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:34:11.227365 (+ 207us) client_negotiation.cc:769] Sending connection context
0808 02:34:11.227508 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 02:34:11.227828 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 02:34:11.229472 13849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:11.209573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42062 (local address 127.24.116.252:44417)
0808 02:34:11.210327 (+ 754us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:11.210332 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:11.210351 (+ 19us) server_negotiation.cc:407] Connection header received
0808 02:34:11.210388 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:11.210391 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:11.210444 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:11.210571 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:11.211559 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.213069 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.214996 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.215736 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.216635 (+ 899us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:11.220836 (+ 4201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:11.220843 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:11.220850 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:11.220896 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:11.224716 (+ 3820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:11.225731 (+ 1015us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:11.225739 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:11.225742 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:11.225910 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:11.226416 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:11.226423 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:11.226428 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:11.226983 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:11.228791 (+ 1808us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:11.228918 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 02:34:11.229171 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":632,"thread_start_us":440,"threads_started":1}
Aug 08 02:34:11 dist-test-slave-45dx krb5kdc[13499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:34:11.236528 13846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:11.219535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:42807 (local address 127.0.0.1:54198)
0808 02:34:11.219746 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:11.219763 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:11.219859 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:11.220436 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:11.220443 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:11.220897 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:34:11.221065 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:11.221074 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.222399 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.222407 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:11.223653 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:11.223667 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.224558 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.224565 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:11.224881 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:11.225517 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:34:11.225541 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:34:11.228290 (+ 2749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:34:11.233261 (+ 4971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:11.233267 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:11.233270 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:11.233848 (+ 578us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:11.234334 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:11.234339 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:11.234343 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:11.234532 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:11.235372 (+ 840us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:34:11.235378 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:34:11.235554 (+ 176us) client_negotiation.cc:769] Sending connection context
0808 02:34:11.235730 (+ 176us) client_negotiation.cc:240] Negotiation successful
0808 02:34:11.236070 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260808 02:34:11.236558 13731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:11.219606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54198 (local address 127.24.116.253:42807)
0808 02:34:11.219818 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:11.219825 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:11.219848 (+ 23us) server_negotiation.cc:407] Connection header received
0808 02:34:11.219989 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:11.219996 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:11.220084 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:11.220199 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:11.221241 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.222228 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.223828 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.224394 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.224536 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:11.228791 (+ 4255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:11.228804 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:11.228808 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:11.228844 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:11.233116 (+ 4272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:11.233990 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:11.233997 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:11.234001 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:11.234191 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:11.234664 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:11.234670 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:11.234674 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:11.235132 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:11.235297 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:11.235872 (+ 575us) server_negotiation.cc:299] Negotiation successful
0808 02:34:11.236128 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 02:34:11.236903 13621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d92e29c907cc4ae19c931a2b65e43481: Bootstrap starting.
I20260808 02:34:11.238154 13848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:11.219254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60362 (local address 127.24.116.254:34965)
0808 02:34:11.219417 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:11.219422 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:11.219577 (+ 155us) server_negotiation.cc:407] Connection header received
0808 02:34:11.219789 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:11.219796 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:11.219890 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:11.220034 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:11.221704 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.222812 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.224840 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.225474 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.225619 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:11.231409 (+ 5790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:11.231415 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:11.231420 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:11.231463 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:11.234815 (+ 3352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:11.235526 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:11.235531 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:11.235535 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:11.235667 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:11.236159 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:11.236164 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:11.236166 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:11.236592 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:11.236890 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:11.237537 (+ 647us) server_negotiation.cc:299] Negotiation successful
0808 02:34:11.237813 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 02:34:11.238202 13841 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } has no permanent_uuid. Determining permanent_uuid...
I20260808 02:34:11.242039 13621 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d92e29c907cc4ae19c931a2b65e43481: Neither blocks nor log segments found. Creating new log.
I20260808 02:34:11.243427 13621 log.cc:824] T 00000000000000000000000000000000 P d92e29c907cc4ae19c931a2b65e43481: Log is configured to *not* fsync() on all Append() calls
I20260808 02:34:11.247058 13621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d92e29c907cc4ae19c931a2b65e43481: No bootstrap required, opened a new log
Aug 08 02:34:11 dist-test-slave-45dx krb5kdc[13499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156451, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.252@KRBTEST.COM for kudu/127.24.116.252@KRBTEST.COM
Aug 08 02:34:11 dist-test-slave-45dx krb5kdc[13499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.253@KRBTEST.COM
I20260808 02:34:11.257004 13849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:11.239789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42066 (local address 127.24.116.252:44417)
0808 02:34:11.239996 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:11.240005 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:11.240030 (+ 25us) server_negotiation.cc:407] Connection header received
0808 02:34:11.240227 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:11.240232 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:11.240357 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:11.240457 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:11.241540 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.242739 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.244522 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.245236 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.245396 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:11.249660 (+ 4264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:11.249668 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:11.249673 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:11.249711 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:11.253364 (+ 3653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:11.254595 (+ 1231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:11.254601 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:11.254605 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:11.254768 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:11.255249 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:11.255254 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:11.255258 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:11.255640 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:11.255794 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:11.256272 (+ 478us) server_negotiation.cc:299] Negotiation successful
0808 02:34:11.256579 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 02:34:11.257138 13846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:11.239639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:44417 (local address 127.0.0.1:42066)
0808 02:34:11.239965 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:11.239988 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:11.240095 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:11.240608 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:11.240613 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:11.241124 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:34:11.241336 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:11.241353 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.242900 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.242905 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:11.244305 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:11.244375 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.245422 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.245428 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:11.245617 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:11.246354 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:34:11.246385 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:34:11.249425 (+ 3040us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:34:11.253535 (+ 4110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:11.253544 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:11.253551 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:11.254458 (+ 907us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:11.254910 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:11.254917 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:11.254921 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:11.255119 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:11.255789 (+ 670us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:34:11.255804 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:34:11.256007 (+ 203us) client_negotiation.cc:769] Sending connection context
0808 02:34:11.256177 (+ 170us) client_negotiation.cc:240] Negotiation successful
0808 02:34:11.256734 (+ 557us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"mutex_wait_us":167}
I20260808 02:34:11.257424 13621 raft_consensus.cc:348] T 00000000000000000000000000000000 P d92e29c907cc4ae19c931a2b65e43481 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92e29c907cc4ae19c931a2b65e43481" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34965 } } peers { permanent_uuid: "b703f8eb49584974892b2eb8c0f64025" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } } peers { permanent_uuid: "01f9ab7307be4ce4b8c2a9527f8987e1" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } }
I20260808 02:34:11.257876 13621 raft_consensus.cc:374] T 00000000000000000000000000000000 P d92e29c907cc4ae19c931a2b65e43481 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:34:11.258019 13621 raft_consensus.cc:729] T 00000000000000000000000000000000 P d92e29c907cc4ae19c931a2b65e43481 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d92e29c907cc4ae19c931a2b65e43481, State: Initialized, Role: FOLLOWER
I20260808 02:34:11.258869 13621 consensus_queue.cc:260] T 00000000000000000000000000000000 P d92e29c907cc4ae19c931a2b65e43481 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92e29c907cc4ae19c931a2b65e43481" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34965 } } peers { permanent_uuid: "b703f8eb49584974892b2eb8c0f64025" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } } peers { permanent_uuid: "01f9ab7307be4ce4b8c2a9527f8987e1" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } }
I20260808 02:34:11.259775 13731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:11.240533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54200 (local address 127.24.116.253:42807)
0808 02:34:11.240755 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:11.240763 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:11.240784 (+ 21us) server_negotiation.cc:407] Connection header received
0808 02:34:11.240858 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:11.240863 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:11.240940 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:11.241036 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:11.242634 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.243724 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.245868 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.246507 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.246693 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:11.252368 (+ 5675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:11.252378 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:11.252388 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:11.252425 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:11.255946 (+ 3521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:11.256905 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:11.256910 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:11.256913 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:11.257074 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:11.257585 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:11.257590 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:11.257593 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:11.257965 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:11.258522 (+ 557us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:11.259120 (+ 598us) server_negotiation.cc:299] Negotiation successful
0808 02:34:11.259386 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260808 02:34:11.260214 13851 sys_catalog.cc:455] T 00000000000000000000000000000000 P d92e29c907cc4ae19c931a2b65e43481 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92e29c907cc4ae19c931a2b65e43481" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34965 } } peers { permanent_uuid: "b703f8eb49584974892b2eb8c0f64025" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } } peers { permanent_uuid: "01f9ab7307be4ce4b8c2a9527f8987e1" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } } }
I20260808 02:34:11.260731 13851 sys_catalog.cc:458] T 00000000000000000000000000000000 P d92e29c907cc4ae19c931a2b65e43481 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:34:11.261633 13621 sys_catalog.cc:564] T 00000000000000000000000000000000 P d92e29c907cc4ae19c931a2b65e43481 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:34:11.263070 13841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01f9ab7307be4ce4b8c2a9527f8987e1: Bootstrap starting.
I20260808 02:34:11.267237 13841 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 01f9ab7307be4ce4b8c2a9527f8987e1: Neither blocks nor log segments found. Creating new log.
I20260808 02:34:11.269091 13841 log.cc:824] T 00000000000000000000000000000000 P 01f9ab7307be4ce4b8c2a9527f8987e1: Log is configured to *not* fsync() on all Append() calls
I20260808 02:34:11.270133 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260808 02:34:11.287480 13868 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d92e29c907cc4ae19c931a2b65e43481: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 02:34:11.287693 13868 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 02:34:11.288687 13841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01f9ab7307be4ce4b8c2a9527f8987e1: No bootstrap required, opened a new log
I20260808 02:34:11.273344 13519 master_runner.cc:186] Error getting master registration for 127.24.116.253:42807: OK, instance_id { permanent_uuid: "b703f8eb49584974892b2eb8c0f64025" instance_seqno: 1786156450600770 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 02:34:11.290016 13519 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 02:34:11.296602 13550 tablet.cc:2369] T 00000000000000000000000000000000 P d92e29c907cc4ae19c931a2b65e43481: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:34:11.299119 13841 raft_consensus.cc:348] T 00000000000000000000000000000000 P 01f9ab7307be4ce4b8c2a9527f8987e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92e29c907cc4ae19c931a2b65e43481" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34965 } } peers { permanent_uuid: "b703f8eb49584974892b2eb8c0f64025" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } } peers { permanent_uuid: "01f9ab7307be4ce4b8c2a9527f8987e1" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } }
I20260808 02:34:11.299677 13841 raft_consensus.cc:374] T 00000000000000000000000000000000 P 01f9ab7307be4ce4b8c2a9527f8987e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:34:11.299870 13841 raft_consensus.cc:729] T 00000000000000000000000000000000 P 01f9ab7307be4ce4b8c2a9527f8987e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01f9ab7307be4ce4b8c2a9527f8987e1, State: Initialized, Role: FOLLOWER
I20260808 02:34:11.300822 13841 consensus_queue.cc:260] T 00000000000000000000000000000000 P 01f9ab7307be4ce4b8c2a9527f8987e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92e29c907cc4ae19c931a2b65e43481" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34965 } } peers { permanent_uuid: "b703f8eb49584974892b2eb8c0f64025" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } } peers { permanent_uuid: "01f9ab7307be4ce4b8c2a9527f8987e1" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } }
I20260808 02:34:11.305166 13882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01f9ab7307be4ce4b8c2a9527f8987e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92e29c907cc4ae19c931a2b65e43481" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34965 } } peers { permanent_uuid: "b703f8eb49584974892b2eb8c0f64025" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } } peers { permanent_uuid: "01f9ab7307be4ce4b8c2a9527f8987e1" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } } }
I20260808 02:34:11.305663 13882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01f9ab7307be4ce4b8c2a9527f8987e1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:34:11.306620 13841 sys_catalog.cc:564] T 00000000000000000000000000000000 P 01f9ab7307be4ce4b8c2a9527f8987e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:34:11.331195 13731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:11.294683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54206 (local address 127.24.116.253:42807)
0808 02:34:11.294870 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:11.294876 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:11.295038 (+ 162us) server_negotiation.cc:407] Connection header received
0808 02:34:11.295355 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:11.295361 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:11.295448 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:11.295525 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:11.298482 (+ 2957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.299705 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.302330 (+ 2625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.303346 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.303492 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:11.319880 (+ 16388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:11.319889 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:11.319896 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:11.319954 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:11.324285 (+ 4331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:11.325387 (+ 1102us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:11.325394 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:11.325398 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:11.325561 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:11.326062 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:11.326068 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:11.326072 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:11.326497 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:11.326777 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:11.330478 (+ 3701us) server_negotiation.cc:299] Negotiation successful
0808 02:34:11.330758 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 02:34:11.332062 13720 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } attempt: 5
Aug 08 02:34:11 dist-test-slave-45dx krb5kdc[13499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156450, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.253@KRBTEST.COM for kudu/127.24.116.252@KRBTEST.COM
I20260808 02:34:11.347314 13848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:11.295437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60364 (local address 127.24.116.254:34965)
0808 02:34:11.295603 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:11.295609 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:11.309591 (+ 13982us) server_negotiation.cc:407] Connection header received
0808 02:34:11.309825 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:11.309831 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:11.309932 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:11.310044 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:11.315577 (+ 5533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.317058 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.326912 (+ 9854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.327757 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.327906 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:11.337969 (+ 10063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:11.337977 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:11.337982 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:11.338033 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:11.342289 (+ 4256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:11.343593 (+ 1304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:11.343602 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:11.343607 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:11.343808 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:11.344709 (+ 901us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:11.344718 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:11.344723 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:11.345194 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:11.345511 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:11.346521 (+ 1010us) server_negotiation.cc:299] Negotiation successful
0808 02:34:11.346831 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260808 02:34:11.347450 13899 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 01f9ab7307be4ce4b8c2a9527f8987e1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 02:34:11.347625 13899 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 02:34:11.323968 13734 master_runner.cc:186] Error getting master registration for 127.24.116.253:42807: OK, instance_id { permanent_uuid: "b703f8eb49584974892b2eb8c0f64025" instance_seqno: 1786156450600770 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 02:34:11.353551 13734 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 02:34:11.357651 13729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:11.335141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:44417 (local address 127.0.0.1:42088)
0808 02:34:11.335567 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:11.335591 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:11.335711 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:11.336993 (+ 1282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:11.337002 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:11.337714 (+ 712us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:34:11.338011 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:11.338029 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.340029 (+ 2000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.340038 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:11.342034 (+ 1996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:11.342056 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.343715 (+ 1659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.343734 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:11.344047 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:11.344765 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:34:11.344787 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:34:11.347715 (+ 2928us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:34:11.354086 (+ 6371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:11.354094 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:11.354101 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:11.354718 (+ 617us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:11.355299 (+ 581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:11.355305 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:11.355310 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:11.355532 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:11.356463 (+ 931us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:34:11.356469 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:34:11.356657 (+ 188us) client_negotiation.cc:769] Sending connection context
0808 02:34:11.356816 (+ 159us) client_negotiation.cc:240] Negotiation successful
0808 02:34:11.357173 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279}
I20260808 02:34:11.358633 13849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:11.297849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42082 (local address 127.24.116.252:44417)
0808 02:34:11.298038 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:11.298048 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:11.319587 (+ 21539us) server_negotiation.cc:407] Connection header received
0808 02:34:11.319831 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:11.319836 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:11.319922 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:11.320026 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:11.332362 (+ 12336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.333781 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.339327 (+ 5546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.344029 (+ 4702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.344140 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:11.348128 (+ 3988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:11.348135 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:11.348139 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:11.348184 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:11.354534 (+ 6350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:11.355555 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:11.355562 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:11.355569 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:11.355782 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:11.356344 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:11.356350 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:11.356354 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:11.356713 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:11.357033 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:11.357924 (+ 891us) server_negotiation.cc:299] Negotiation successful
0808 02:34:11.358179 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 02:34:11.359302 13845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:11.336053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42088 (local address 127.24.116.252:44417)
0808 02:34:11.336336 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:11.336346 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:11.336375 (+ 29us) server_negotiation.cc:407] Connection header received
0808 02:34:11.336452 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:11.336460 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:11.336573 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:11.336716 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:11.338265 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.339796 (+ 1531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.342278 (+ 2482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:11.343245 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:11.343406 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:11.347936 (+ 4530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:11.347942 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:11.347946 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:11.347992 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:11.353855 (+ 5863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:11.354928 (+ 1073us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:11.354934 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:11.354938 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:11.355117 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:11.355718 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:11.355725 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:11.355733 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:11.356249 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:11.358454 (+ 2205us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:11.358585 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 02:34:11.358883 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65,"spinlock_wait_cycles":27904}
I20260808 02:34:11.366178 13720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025: Bootstrap starting.
I20260808 02:34:11.371039 13720 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025: Neither blocks nor log segments found. Creating new log.
I20260808 02:34:11.372617 13720 log.cc:824] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025: Log is configured to *not* fsync() on all Append() calls
I20260808 02:34:11.382095 13720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025: No bootstrap required, opened a new log
I20260808 02:34:11.395008 13720 raft_consensus.cc:348] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92e29c907cc4ae19c931a2b65e43481" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34965 } } peers { permanent_uuid: "b703f8eb49584974892b2eb8c0f64025" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } } peers { permanent_uuid: "01f9ab7307be4ce4b8c2a9527f8987e1" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } }
I20260808 02:34:11.395546 13720 raft_consensus.cc:374] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:34:11.395684 13720 raft_consensus.cc:729] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b703f8eb49584974892b2eb8c0f64025, State: Initialized, Role: FOLLOWER
I20260808 02:34:11.396461 13720 consensus_queue.cc:260] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92e29c907cc4ae19c931a2b65e43481" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34965 } } peers { permanent_uuid: "b703f8eb49584974892b2eb8c0f64025" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } } peers { permanent_uuid: "01f9ab7307be4ce4b8c2a9527f8987e1" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } }
I20260808 02:34:11.400051 13906 sys_catalog.cc:455] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92e29c907cc4ae19c931a2b65e43481" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34965 } } peers { permanent_uuid: "b703f8eb49584974892b2eb8c0f64025" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } } peers { permanent_uuid: "01f9ab7307be4ce4b8c2a9527f8987e1" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } } }
I20260808 02:34:11.400622 13906 sys_catalog.cc:458] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:34:11.401721 13720 sys_catalog.cc:564] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 02:34:11.405722 13774 tablet.cc:2369] T 00000000000000000000000000000000 P 01f9ab7307be4ce4b8c2a9527f8987e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:34:11.423612 13628 master_runner.cc:263] No leader master found from master b703f8eb49584974892b2eb8c0f64025
I20260808 02:34:11.423792 13628 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 02:34:11.430748 13920 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 02:34:11.431028 13920 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 02:34:11.448647 13906 raft_consensus.cc:482] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:34:11.449012 13906 raft_consensus.cc:504] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92e29c907cc4ae19c931a2b65e43481" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34965 } } peers { permanent_uuid: "b703f8eb49584974892b2eb8c0f64025" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } } peers { permanent_uuid: "01f9ab7307be4ce4b8c2a9527f8987e1" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } }
I20260808 02:34:11.450835 13906 leader_election.cc:288] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d92e29c907cc4ae19c931a2b65e43481 (127.24.116.254:34965), 01f9ab7307be4ce4b8c2a9527f8987e1 (127.24.116.252:44417)
I20260808 02:34:11.452579 13575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b703f8eb49584974892b2eb8c0f64025" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d92e29c907cc4ae19c931a2b65e43481" is_pre_election: true
I20260808 02:34:11.453329 13575 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d92e29c907cc4ae19c931a2b65e43481 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b703f8eb49584974892b2eb8c0f64025 in term 0.
I20260808 02:34:11.454037 13806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b703f8eb49584974892b2eb8c0f64025" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01f9ab7307be4ce4b8c2a9527f8987e1" is_pre_election: true
I20260808 02:34:11.454649 13806 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 01f9ab7307be4ce4b8c2a9527f8987e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b703f8eb49584974892b2eb8c0f64025 in term 0.
I20260808 02:34:11.455528 13655 leader_election.cc:302] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01f9ab7307be4ce4b8c2a9527f8987e1, b703f8eb49584974892b2eb8c0f64025; no voters:
I20260808 02:34:11.461292 13906 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:34:11.461485 13906 raft_consensus.cc:482] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:34:11.461594 13906 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:34:11.470018 13906 raft_consensus.cc:504] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92e29c907cc4ae19c931a2b65e43481" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34965 } } peers { permanent_uuid: "b703f8eb49584974892b2eb8c0f64025" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } } peers { permanent_uuid: "01f9ab7307be4ce4b8c2a9527f8987e1" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } }
I20260808 02:34:11.472810 13575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b703f8eb49584974892b2eb8c0f64025" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d92e29c907cc4ae19c931a2b65e43481"
I20260808 02:34:11.475880 13575 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d92e29c907cc4ae19c931a2b65e43481 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:34:11.484786 13575 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d92e29c907cc4ae19c931a2b65e43481 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b703f8eb49584974892b2eb8c0f64025 in term 1.
I20260808 02:34:11.485520 13657 leader_election.cc:302] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b703f8eb49584974892b2eb8c0f64025, d92e29c907cc4ae19c931a2b65e43481; no voters:
I20260808 02:34:11.490088 13806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b703f8eb49584974892b2eb8c0f64025" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01f9ab7307be4ce4b8c2a9527f8987e1"
I20260808 02:34:11.490350 13806 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 01f9ab7307be4ce4b8c2a9527f8987e1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:34:11.494220 13806 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 01f9ab7307be4ce4b8c2a9527f8987e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b703f8eb49584974892b2eb8c0f64025 in term 1.
I20260808 02:34:11.501271 13906 leader_election.cc:288] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [CANDIDATE]: Term 1 election: Requested vote from peers d92e29c907cc4ae19c931a2b65e43481 (127.24.116.254:34965), 01f9ab7307be4ce4b8c2a9527f8987e1 (127.24.116.252:44417)
I20260808 02:34:11.502033 13906 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:34:11.502466 13906 raft_consensus.cc:686] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [term 1 LEADER]: Becoming Leader. State: Replica: b703f8eb49584974892b2eb8c0f64025, State: Running, Role: LEADER
I20260808 02:34:11.503765 13906 consensus_queue.cc:237] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92e29c907cc4ae19c931a2b65e43481" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34965 } } peers { permanent_uuid: "b703f8eb49584974892b2eb8c0f64025" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } } peers { permanent_uuid: "01f9ab7307be4ce4b8c2a9527f8987e1" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } }
I20260808 02:34:11.531247 13923 sys_catalog.cc:455] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b703f8eb49584974892b2eb8c0f64025. Latest consensus state: current_term: 1 leader_uuid: "b703f8eb49584974892b2eb8c0f64025" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92e29c907cc4ae19c931a2b65e43481" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34965 } } peers { permanent_uuid: "b703f8eb49584974892b2eb8c0f64025" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } } peers { permanent_uuid: "01f9ab7307be4ce4b8c2a9527f8987e1" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } } }
I20260808 02:34:11.531898 13923 sys_catalog.cc:458] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [sys.catalog]: This master's current role is: LEADER
I20260808 02:34:11.540952 13925 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:34:11.543251 13925 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:34:11.561992 13806 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 01f9ab7307be4ce4b8c2a9527f8987e1 [term 1 FOLLOWER]: Refusing update from remote peer b703f8eb49584974892b2eb8c0f64025: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:34:11.563333 13575 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d92e29c907cc4ae19c931a2b65e43481 [term 1 FOLLOWER]: Refusing update from remote peer b703f8eb49584974892b2eb8c0f64025: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:34:11.564742 13906 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d92e29c907cc4ae19c931a2b65e43481" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:34:11.566104 13906 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01f9ab7307be4ce4b8c2a9527f8987e1" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 02:34:11.589615 13660 tablet.cc:2369] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:34:11.597400 13851 sys_catalog.cc:455] T 00000000000000000000000000000000 P d92e29c907cc4ae19c931a2b65e43481 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b703f8eb49584974892b2eb8c0f64025. Latest consensus state: current_term: 1 leader_uuid: "b703f8eb49584974892b2eb8c0f64025" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92e29c907cc4ae19c931a2b65e43481" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34965 } } peers { permanent_uuid: "b703f8eb49584974892b2eb8c0f64025" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } } peers { permanent_uuid: "01f9ab7307be4ce4b8c2a9527f8987e1" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } } }
I20260808 02:34:11.597774 13851 sys_catalog.cc:458] T 00000000000000000000000000000000 P d92e29c907cc4ae19c931a2b65e43481 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:34:11.603063 13928 mvcc.cc:205] Tried to move back new op lower bound from 7316096825586028544 to 7316096825373036544. Current Snapshot: MvccSnapshot[applied={T|T < 7316096825586028544}]
I20260808 02:34:11.607898 13882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01f9ab7307be4ce4b8c2a9527f8987e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b703f8eb49584974892b2eb8c0f64025. Latest consensus state: current_term: 1 leader_uuid: "b703f8eb49584974892b2eb8c0f64025" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92e29c907cc4ae19c931a2b65e43481" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34965 } } peers { permanent_uuid: "b703f8eb49584974892b2eb8c0f64025" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } } peers { permanent_uuid: "01f9ab7307be4ce4b8c2a9527f8987e1" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } } }
I20260808 02:34:11.608238 13882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01f9ab7307be4ce4b8c2a9527f8987e1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:34:11.620870 13882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01f9ab7307be4ce4b8c2a9527f8987e1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b703f8eb49584974892b2eb8c0f64025" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92e29c907cc4ae19c931a2b65e43481" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34965 } } peers { permanent_uuid: "b703f8eb49584974892b2eb8c0f64025" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } } peers { permanent_uuid: "01f9ab7307be4ce4b8c2a9527f8987e1" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } } }
I20260808 02:34:11.621215 13882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01f9ab7307be4ce4b8c2a9527f8987e1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:34:11.640839 13923 sys_catalog.cc:455] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b703f8eb49584974892b2eb8c0f64025" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92e29c907cc4ae19c931a2b65e43481" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34965 } } peers { permanent_uuid: "b703f8eb49584974892b2eb8c0f64025" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } } peers { permanent_uuid: "01f9ab7307be4ce4b8c2a9527f8987e1" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } } }
I20260808 02:34:11.641155 13923 sys_catalog.cc:458] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [sys.catalog]: This master's current role is: LEADER
I20260808 02:34:11.641431 13923 sys_catalog.cc:455] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b703f8eb49584974892b2eb8c0f64025" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92e29c907cc4ae19c931a2b65e43481" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34965 } } peers { permanent_uuid: "b703f8eb49584974892b2eb8c0f64025" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } } peers { permanent_uuid: "01f9ab7307be4ce4b8c2a9527f8987e1" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } } }
I20260808 02:34:11.641645 13923 sys_catalog.cc:458] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025 [sys.catalog]: This master's current role is: LEADER
I20260808 02:34:11.646826 13851 sys_catalog.cc:455] T 00000000000000000000000000000000 P d92e29c907cc4ae19c931a2b65e43481 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b703f8eb49584974892b2eb8c0f64025" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92e29c907cc4ae19c931a2b65e43481" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34965 } } peers { permanent_uuid: "b703f8eb49584974892b2eb8c0f64025" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 42807 } } peers { permanent_uuid: "01f9ab7307be4ce4b8c2a9527f8987e1" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 44417 } } }
I20260808 02:34:11.647114 13851 sys_catalog.cc:458] T 00000000000000000000000000000000 P d92e29c907cc4ae19c931a2b65e43481 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:34:11.648211 13925 catalog_manager.cc:1347] Generated new cluster ID: 7a0c556739e2409e8f142db580a93eb8
I20260808 02:34:11.648366 13925 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:34:11.704296 13925 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:34:11.706472 13925 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:34:11.739611 13925 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b703f8eb49584974892b2eb8c0f64025: Generated new TSK 0
I20260808 02:34:11.740927 13925 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:34:12.289980 13868 catalog_manager.cc:1259] Loaded cluster ID: 7a0c556739e2409e8f142db580a93eb8
I20260808 02:34:12.290093 13868 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d92e29c907cc4ae19c931a2b65e43481: loading cluster ID for follower catalog manager: success
I20260808 02:34:12.292559 13868 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d92e29c907cc4ae19c931a2b65e43481: acquiring CA information for follower catalog manager: success
I20260808 02:34:12.294324 13868 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d92e29c907cc4ae19c931a2b65e43481: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 02:34:12.349800 13899 catalog_manager.cc:1259] Loaded cluster ID: 7a0c556739e2409e8f142db580a93eb8
I20260808 02:34:12.349921 13899 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 01f9ab7307be4ce4b8c2a9527f8987e1: loading cluster ID for follower catalog manager: success
I20260808 02:34:12.352483 13899 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 01f9ab7307be4ce4b8c2a9527f8987e1: acquiring CA information for follower catalog manager: success
I20260808 02:34:12.354349 13899 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 01f9ab7307be4ce4b8c2a9527f8987e1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 02:34:12.375144 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 13519
I20260808 02:34:12.376566 13613 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:12.489979 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 13519
I20260808 02:34:12.524411 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 13628
I20260808 02:34:12.525760 13713 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:12.636374 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 13628
W20260808 02:34:12.665665 13765 connection.cc:535] server connection from 127.0.0.1:42088 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 02:34:12.666043 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 13734
I20260808 02:34:12.667193 13832 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:12.776374 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 13734
2026-08-08T02:34:12Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (4836 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:34:12 dist-test-slave-45dx krb5kdc[13959](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:34:12 dist-test-slave-45dx krb5kdc[13959](info): set up 2 sockets
Aug 08 02:34:12 dist-test-slave-45dx krb5kdc[13959](info): commencing operation
krb5kdc: starting...
W20260808 02:34:14.133118 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.304s user 0.003s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:34:14 dist-test-slave-45dx krb5kdc[13959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156454, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:34:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:34:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:34:14.448931 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:45113
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:41567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:45113
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:34:14.802222 13979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:14.802505 13979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:14.802673 13979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:14.809958 13979 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:34:14.810067 13979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:14.810178 13979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:14.810286 13979 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:34:14.810374 13979 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:34:14.820372 13979 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:41567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:45113
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:45113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:14.821746 13979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:14.823148 13979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:14.835539 13995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:14.835642 13991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:14.835618 13993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:14.836601 13979 server_base.cc:1034] running on GCE node
I20260808 02:34:14.837414 13979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:14.838861 13979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:14.840116 13979 hybrid_clock.cc:648] HybridClock initialized: now 1786156454840071 us; error 50 us; skew 500 ppm
I20260808 02:34:14.840554 13979 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:14 dist-test-slave-45dx krb5kdc[13959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156454, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:14.848945 13979 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:34:14.850616 13979 webserver.cc:460] Webserver started at http://127.24.116.254:44607/ using document root <none> and password file <none>
I20260808 02:34:14.851368 13979 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:14.851532 13979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:34:14.851871 13979 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:34:14.855054 13979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "44ac59cea44549298776d25de8ba9254"
format_stamp: "Formatted at 2026-08-08 02:34:14 on dist-test-slave-45dx"
server_key: "4f92f6355641e799e77d188ba37ca7db"
server_key_iv: "0e6d6a265298345d781555a8e9ccb7bb"
server_key_version: "encryptionkey@0"
I20260808 02:34:14.855849 13979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "44ac59cea44549298776d25de8ba9254"
format_stamp: "Formatted at 2026-08-08 02:34:14 on dist-test-slave-45dx"
server_key: "4f92f6355641e799e77d188ba37ca7db"
server_key_iv: "0e6d6a265298345d781555a8e9ccb7bb"
server_key_version: "encryptionkey@0"
I20260808 02:34:14.861573 13979 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 02:34:14.865321 14002 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:14.866686 13979 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 02:34:14.866879 13979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "44ac59cea44549298776d25de8ba9254"
format_stamp: "Formatted at 2026-08-08 02:34:14 on dist-test-slave-45dx"
server_key: "4f92f6355641e799e77d188ba37ca7db"
server_key_iv: "0e6d6a265298345d781555a8e9ccb7bb"
server_key_version: "encryptionkey@0"
I20260808 02:34:14.867089 13979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:14.888902 13979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:14.893147 13979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:14.893458 13979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:14.913734 13979 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:45113
I20260808 02:34:14.913947 14078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:45113 every 8 connection(s)
I20260808 02:34:14.915216 13979 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:34:14.919282 14079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:34:14.921006 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 13979
I20260808 02:34:14.921265 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:34:14.922170 25043 external_mini_cluster.cc:1428] Setting key 65b8dc1f7c6bcdb3cd5732a189568df1
I20260808 02:34:14.934999 14079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44ac59cea44549298776d25de8ba9254: Bootstrap starting.
Aug 08 02:34:14 dist-test-slave-45dx krb5kdc[13959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156454, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:34:14.939240 14079 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44ac59cea44549298776d25de8ba9254: Neither blocks nor log segments found. Creating new log.
I20260808 02:34:14.940661 14079 log.cc:824] T 00000000000000000000000000000000 P 44ac59cea44549298776d25de8ba9254: Log is configured to *not* fsync() on all Append() calls
I20260808 02:34:14.944428 14079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44ac59cea44549298776d25de8ba9254: No bootstrap required, opened a new log
I20260808 02:34:14.948580 14083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:14.924246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42212 (local address 127.24.116.254:45113)
0808 02:34:14.925173 (+ 927us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:14.925185 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:14.925231 (+ 46us) server_negotiation.cc:407] Connection header received
0808 02:34:14.926865 (+ 1634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:14.926889 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:14.927307 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:14.927672 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:14.929759 (+ 2087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:14.931092 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:14.933087 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:14.933783 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:14.933951 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:14.939151 (+ 5200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:14.939159 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:14.939173 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:14.939218 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:14.943081 (+ 3863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:14.944159 (+ 1078us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:14.944167 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:14.944173 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:14.944476 (+ 303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:14.945014 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:14.945019 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:14.945022 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:14.945798 (+ 776us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:14.946100 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:14.946566 (+ 466us) server_negotiation.cc:299] Negotiation successful
0808 02:34:14.947067 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":699,"thread_start_us":419,"threads_started":1}
I20260808 02:34:14.953720 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:34:14.956543 14079 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44ac59cea44549298776d25de8ba9254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44ac59cea44549298776d25de8ba9254" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 45113 } }
I20260808 02:34:14.957187 14079 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44ac59cea44549298776d25de8ba9254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:34:14.957372 14079 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44ac59cea44549298776d25de8ba9254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44ac59cea44549298776d25de8ba9254, State: Initialized, Role: FOLLOWER
I20260808 02:34:14.958043 14079 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44ac59cea44549298776d25de8ba9254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44ac59cea44549298776d25de8ba9254" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 45113 } }
I20260808 02:34:14.958344 14079 raft_consensus.cc:388] T 00000000000000000000000000000000 P 44ac59cea44549298776d25de8ba9254 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:34:14.958506 14079 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44ac59cea44549298776d25de8ba9254 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:34:14.958701 14079 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44ac59cea44549298776d25de8ba9254 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:34:14.961294 14079 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44ac59cea44549298776d25de8ba9254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44ac59cea44549298776d25de8ba9254" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 45113 } }
I20260808 02:34:14.961910 14079 leader_election.cc:302] T 00000000000000000000000000000000 P 44ac59cea44549298776d25de8ba9254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44ac59cea44549298776d25de8ba9254; no voters:
I20260808 02:34:14.962582 14079 leader_election.cc:288] T 00000000000000000000000000000000 P 44ac59cea44549298776d25de8ba9254 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:34:14.962683 14087 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44ac59cea44549298776d25de8ba9254 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:34:14.963641 14087 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44ac59cea44549298776d25de8ba9254 [term 1 LEADER]: Becoming Leader. State: Replica: 44ac59cea44549298776d25de8ba9254, State: Running, Role: LEADER
I20260808 02:34:14.964381 14087 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44ac59cea44549298776d25de8ba9254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44ac59cea44549298776d25de8ba9254" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 45113 } }
I20260808 02:34:14.965171 14079 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44ac59cea44549298776d25de8ba9254 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:34:14.967664 14089 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44ac59cea44549298776d25de8ba9254 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44ac59cea44549298776d25de8ba9254" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44ac59cea44549298776d25de8ba9254" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 45113 } } }
I20260808 02:34:14.967669 14090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44ac59cea44549298776d25de8ba9254 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44ac59cea44549298776d25de8ba9254. Latest consensus state: current_term: 1 leader_uuid: "44ac59cea44549298776d25de8ba9254" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44ac59cea44549298776d25de8ba9254" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 45113 } } }
I20260808 02:34:14.968152 14089 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44ac59cea44549298776d25de8ba9254 [sys.catalog]: This master's current role is: LEADER
I20260808 02:34:14.968250 14090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44ac59cea44549298776d25de8ba9254 [sys.catalog]: This master's current role is: LEADER
I20260808 02:34:14.973852 14095 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:34:14.980731 14095 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:34:14.989941 14095 catalog_manager.cc:1347] Generated new cluster ID: 98b9b850c1434f7aacd7befa66094ea7
I20260808 02:34:14.990070 14095 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:34:15.006991 14095 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:34:15.008529 14095 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:34:15.019905 14095 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44ac59cea44549298776d25de8ba9254: Generated new TSK 0
I20260808 02:34:15.020924 14095 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:34:15.068297 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 13979
I20260808 02:34:15.069768 14069 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:15.166342 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 13979
2026-08-08T02:34:15Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2380 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:34:15 dist-test-slave-45dx krb5kdc[14125](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:34:15 dist-test-slave-45dx krb5kdc[14125](info): set up 2 sockets
Aug 08 02:34:15 dist-test-slave-45dx krb5kdc[14125](info): commencing operation
krb5kdc: starting...
W20260808 02:34:16.506305 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.296s user 0.000s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:34:16 dist-test-slave-45dx krb5kdc[14125](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:34:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:34:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:34:16.812602 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:40999
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:34351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:40999
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:34:17.163244 14143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:17.163527 14143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:17.163682 14143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:17.170867 14143 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:34:17.170969 14143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:17.171058 14143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:17.171159 14143 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:34:17.171248 14143 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:34:17.181038 14143 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:34351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:40999
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:40999
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:17.182446 14143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:17.183760 14143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:17.196187 14151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:17.196202 14150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:17.196686 14158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:17.197018 14143 server_base.cc:1034] running on GCE node
I20260808 02:34:17.197875 14143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:17.199302 14143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:17.200497 14143 hybrid_clock.cc:648] HybridClock initialized: now 1786156457200452 us; error 43 us; skew 500 ppm
I20260808 02:34:17.200860 14143 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:17 dist-test-slave-45dx krb5kdc[14125](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156457, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:17.204109 14143 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:34:17.205729 14143 webserver.cc:460] Webserver started at http://127.24.116.254:33189/ using document root <none> and password file <none>
I20260808 02:34:17.206393 14143 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:17.206498 14143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:34:17.206768 14143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:34:17.209956 14143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "2b8132c78e754d6d85edfa6cb7dd576a"
format_stamp: "Formatted at 2026-08-08 02:34:17 on dist-test-slave-45dx"
server_key: "2de4410fa74cc18ca512e4fa75f090f6"
server_key_iv: "b12ca95cc73cb83c4357c7e4f34b7957"
server_key_version: "encryptionkey@0"
I20260808 02:34:17.210799 14143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "2b8132c78e754d6d85edfa6cb7dd576a"
format_stamp: "Formatted at 2026-08-08 02:34:17 on dist-test-slave-45dx"
server_key: "2de4410fa74cc18ca512e4fa75f090f6"
server_key_iv: "b12ca95cc73cb83c4357c7e4f34b7957"
server_key_version: "encryptionkey@0"
I20260808 02:34:17.216132 14143 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 02:34:17.219944 14165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:17.221477 14143 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:34:17.221679 14143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "2b8132c78e754d6d85edfa6cb7dd576a"
format_stamp: "Formatted at 2026-08-08 02:34:17 on dist-test-slave-45dx"
server_key: "2de4410fa74cc18ca512e4fa75f090f6"
server_key_iv: "b12ca95cc73cb83c4357c7e4f34b7957"
server_key_version: "encryptionkey@0"
I20260808 02:34:17.221906 14143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:17.240548 14143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:17.245163 14143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:17.245487 14143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:17.273785 14143 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:40999
I20260808 02:34:17.273789 14244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:40999 every 8 connection(s)
I20260808 02:34:17.275235 14143 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:34:17.279093 14245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:34:17.282312 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 14143
I20260808 02:34:17.282565 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:34:17.283453 25043 external_mini_cluster.cc:1428] Setting key 07ce6b258d66eba68f38ced05fdabadc
I20260808 02:34:17.292424 14245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a: Bootstrap starting.
I20260808 02:34:17.296370 14245 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a: Neither blocks nor log segments found. Creating new log.
I20260808 02:34:17.297770 14245 log.cc:824] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a: Log is configured to *not* fsync() on all Append() calls
Aug 08 02:34:17 dist-test-slave-45dx krb5kdc[14125](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:34:17.301333 14245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a: No bootstrap required, opened a new log
I20260808 02:34:17.307989 14248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:17.285660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47810 (local address 127.24.116.254:40999)
0808 02:34:17.286460 (+ 800us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:17.286472 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:17.286513 (+ 41us) server_negotiation.cc:407] Connection header received
0808 02:34:17.288128 (+ 1615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:17.288150 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:17.288605 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:17.288950 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:17.290814 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:17.292129 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:17.294057 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:17.294724 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:17.294885 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:17.300442 (+ 5557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:17.300450 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:17.300467 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:17.300506 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:17.303768 (+ 3262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:17.304621 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:17.304627 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:17.304633 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:17.304807 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:17.305263 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:17.305266 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:17.305268 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:17.305784 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:17.306082 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:17.306501 (+ 419us) server_negotiation.cc:299] Negotiation successful
0808 02:34:17.306911 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":395,"threads_started":1}
I20260808 02:34:17.311151 14245 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8132c78e754d6d85edfa6cb7dd576a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40999 } }
I20260808 02:34:17.311564 14245 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:34:17.311685 14245 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b8132c78e754d6d85edfa6cb7dd576a, State: Initialized, Role: FOLLOWER
I20260808 02:34:17.312235 14245 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8132c78e754d6d85edfa6cb7dd576a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40999 } }
I20260808 02:34:17.312552 14245 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:34:17.312695 14245 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:34:17.312872 14245 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:34:17.315101 14245 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8132c78e754d6d85edfa6cb7dd576a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40999 } }
I20260808 02:34:17.315599 14245 leader_election.cc:302] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2b8132c78e754d6d85edfa6cb7dd576a; no voters:
I20260808 02:34:17.316200 14245 leader_election.cc:288] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:34:17.316370 14250 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:34:17.318156 14250 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 1 LEADER]: Becoming Leader. State: Replica: 2b8132c78e754d6d85edfa6cb7dd576a, State: Running, Role: LEADER
I20260808 02:34:17.318500 14245 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:34:17.318775 14250 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8132c78e754d6d85edfa6cb7dd576a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40999 } }
I20260808 02:34:17.321656 14252 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b8132c78e754d6d85edfa6cb7dd576a. Latest consensus state: current_term: 1 leader_uuid: "2b8132c78e754d6d85edfa6cb7dd576a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8132c78e754d6d85edfa6cb7dd576a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40999 } } }
I20260808 02:34:17.322080 14252 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [sys.catalog]: This master's current role is: LEADER
I20260808 02:34:17.322449 14251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2b8132c78e754d6d85edfa6cb7dd576a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8132c78e754d6d85edfa6cb7dd576a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40999 } } }
I20260808 02:34:17.322778 14251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [sys.catalog]: This master's current role is: LEADER
I20260808 02:34:17.324618 14270 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:34:17.329701 14270 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:34:17.339046 14270 catalog_manager.cc:1347] Generated new cluster ID: 39253cc6a1084f4dba63b050417cbc7e
I20260808 02:34:17.339187 14270 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:34:17.357172 14270 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:34:17.358507 14270 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:34:17.364549 14270 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a: Generated new TSK 0
I20260808 02:34:17.365597 14270 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.116.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
I20260808 02:34:17.447757 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:40999
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:34351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:34:17.796547 14284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:17.796835 14284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:17.797014 14284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:17.804343 14284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:17.804489 14284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:17.804677 14284 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:34:17.814718 14284 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:34351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:40999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:17.816051 14284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:17.817440 14284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:17.831444 14291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:17.831503 14292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:17.831547 14294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:17.832434 14284 server_base.cc:1034] running on GCE node
I20260808 02:34:17.833153 14284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:17.834131 14284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:17.835371 14284 hybrid_clock.cc:648] HybridClock initialized: now 1786156457835323 us; error 57 us; skew 500 ppm
I20260808 02:34:17.835695 14284 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:17 dist-test-slave-45dx krb5kdc[14125](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156457, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:17.839227 14284 init.cc:377] Logged in from keytab as kudu/127.24.116.193@KRBTEST.COM (short username kudu)
I20260808 02:34:17.840687 14284 webserver.cc:460] Webserver started at http://127.24.116.193:39863/ using document root <none> and password file <none>
I20260808 02:34:17.841322 14284 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:17.841437 14284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:34:17.841691 14284 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:34:17.844734 14284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0"
format_stamp: "Formatted at 2026-08-08 02:34:17 on dist-test-slave-45dx"
server_key: "fc5597f3dd5cf3ae132e8c5972086a55"
server_key_iv: "15f17ed78f0dfeed285388b4613cef90"
server_key_version: "encryptionkey@0"
I20260808 02:34:17.845482 14284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0"
format_stamp: "Formatted at 2026-08-08 02:34:17 on dist-test-slave-45dx"
server_key: "fc5597f3dd5cf3ae132e8c5972086a55"
server_key_iv: "15f17ed78f0dfeed285388b4613cef90"
server_key_version: "encryptionkey@0"
I20260808 02:34:17.850685 14284 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 02:34:17.854176 14301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:17.855510 14284 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 02:34:17.855647 14284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0"
format_stamp: "Formatted at 2026-08-08 02:34:17 on dist-test-slave-45dx"
server_key: "fc5597f3dd5cf3ae132e8c5972086a55"
server_key_iv: "15f17ed78f0dfeed285388b4613cef90"
server_key_version: "encryptionkey@0"
I20260808 02:34:17.855808 14284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:17.892293 14284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:17.896495 14284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:17.896749 14284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:17.897794 14284 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:34:17.899120 14284 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:34:17.899204 14284 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:17.899292 14284 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:34:17.899336 14284 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:17.934255 14284 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:44737
I20260808 02:34:17.934304 14476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:44737 every 8 connection(s)
I20260808 02:34:17.935580 14284 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:34:17.938606 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 14284
I20260808 02:34:17.938880 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:34:17.939574 25043 external_mini_cluster.cc:1428] Setting key d67fbdd9f776d9843904a6735822407f
Aug 08 02:34:17 dist-test-slave-45dx krb5kdc[14125](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156457, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:34:17.957909 14482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:17.938231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:52021 (local address 127.24.116.254:40999)
0808 02:34:17.938733 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:17.938740 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:17.939885 (+ 1145us) server_negotiation.cc:407] Connection header received
0808 02:34:17.942039 (+ 2154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:17.942044 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:17.942129 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:17.942247 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:17.943827 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:17.945032 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:17.946678 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:17.947392 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:17.947539 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:17.951038 (+ 3499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:17.951047 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:17.951055 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:17.951100 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:17.954520 (+ 3420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:17.955531 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:17.955535 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:17.955537 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:17.955653 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:17.956155 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:17.956158 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:17.956160 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:17.956490 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:17.956603 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:17.957483 (+ 880us) server_negotiation.cc:299] Negotiation successful
0808 02:34:17.957644 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":245,"threads_started":1}
I20260808 02:34:17.959565 14484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:17.938839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.193:52021)
0808 02:34:17.939696 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:17.939743 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:17.941769 (+ 2026us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:17.942470 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:17.942478 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:17.943094 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:34:17.943648 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:17.943669 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:17.945222 (+ 1553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:17.945227 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:17.946511 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:17.946524 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:17.947610 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:17.947615 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:17.947817 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:17.948572 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:34:17.948594 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:34:17.950811 (+ 2217us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:34:17.954692 (+ 3881us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:17.954703 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:17.954723 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:17.955410 (+ 687us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:17.955769 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:17.955778 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:17.955784 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:17.956044 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:17.956618 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:34:17.956629 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:34:17.957075 (+ 446us) client_negotiation.cc:769] Sending connection context
0808 02:34:17.957401 (+ 326us) client_negotiation.cc:240] Negotiation successful
0808 02:34:17.957984 (+ 583us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":405,"threads_started":1}
I20260808 02:34:17.961261 14477 heartbeater.cc:347] Connected to a master server at 127.24.116.254:40999
I20260808 02:34:17.961576 14477 heartbeater.cc:464] Registering TS with master...
I20260808 02:34:17.962342 14477 heartbeater.cc:511] Master 127.24.116.254:40999 requested a full tablet report, sending...
I20260808 02:34:17.964542 14196 ts_manager.cc:194] Registered new tserver with Master: 12ef8ba2ffee4ebda4fde4fd0dd824c0 (127.24.116.193:44737)
I20260808 02:34:17.966027 14196 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.193@KRBTEST.COM'} at 127.24.116.193:52021
WARNING: no policy specified for kudu/127.24.116.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
I20260808 02:34:18.010099 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:40999
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:34351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:34:18.362406 14488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:18.362726 14488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:18.362896 14488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:18.371631 14488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:18.371798 14488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:18.371979 14488 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:34:18.382302 14488 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:34351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:40999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:18.383744 14488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:18.385247 14488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:18.398396 14497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:18.398742 14502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:18.398706 14498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:18.399803 14488 server_base.cc:1034] running on GCE node
I20260808 02:34:18.400514 14488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:18.401513 14488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:18.402755 14488 hybrid_clock.cc:648] HybridClock initialized: now 1786156458402720 us; error 49 us; skew 500 ppm
I20260808 02:34:18.403103 14488 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:18 dist-test-slave-45dx krb5kdc[14125](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156458, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:18.406461 14488 init.cc:377] Logged in from keytab as kudu/127.24.116.194@KRBTEST.COM (short username kudu)
I20260808 02:34:18.408077 14488 webserver.cc:460] Webserver started at http://127.24.116.194:37025/ using document root <none> and password file <none>
I20260808 02:34:18.408844 14488 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:18.409003 14488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:34:18.409382 14488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:34:18.412536 14488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "ff42a9e1dabf4317bf1873613119da2e"
format_stamp: "Formatted at 2026-08-08 02:34:18 on dist-test-slave-45dx"
server_key: "38c9a7a06d47e9e1e666fe50c3f64f97"
server_key_iv: "34096fb925512e2af2b50f72444df562"
server_key_version: "encryptionkey@0"
I20260808 02:34:18.413443 14488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "ff42a9e1dabf4317bf1873613119da2e"
format_stamp: "Formatted at 2026-08-08 02:34:18 on dist-test-slave-45dx"
server_key: "38c9a7a06d47e9e1e666fe50c3f64f97"
server_key_iv: "34096fb925512e2af2b50f72444df562"
server_key_version: "encryptionkey@0"
I20260808 02:34:18.419384 14488 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 02:34:18.423285 14511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:18.424886 14488 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:34:18.425077 14488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "ff42a9e1dabf4317bf1873613119da2e"
format_stamp: "Formatted at 2026-08-08 02:34:18 on dist-test-slave-45dx"
server_key: "38c9a7a06d47e9e1e666fe50c3f64f97"
server_key_iv: "34096fb925512e2af2b50f72444df562"
server_key_version: "encryptionkey@0"
I20260808 02:34:18.425343 14488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:18.446848 14488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:18.451314 14488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:18.451653 14488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:18.452732 14488 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:34:18.454156 14488 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:34:18.454272 14488 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:18.454430 14488 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:34:18.454507 14488 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:18.489647 14488 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:38881
I20260808 02:34:18.489740 14676 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:38881 every 8 connection(s)
I20260808 02:34:18.490973 14488 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:34:18.501281 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 14488
I20260808 02:34:18.501490 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:34:18.502127 25043 external_mini_cluster.cc:1428] Setting key 12e38d8a476dc3cbcc4cd47ae9dc65bd
Aug 08 02:34:18 dist-test-slave-45dx krb5kdc[14125](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156458, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:34:18.511642 14684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:18.493693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:51485 (local address 127.24.116.254:40999)
0808 02:34:18.494153 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:18.494158 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:18.495148 (+ 990us) server_negotiation.cc:407] Connection header received
0808 02:34:18.497068 (+ 1920us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:18.497072 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:18.497142 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:18.497242 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:18.498686 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:18.499388 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:18.501043 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:18.501766 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:18.501898 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:18.505639 (+ 3741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:18.505645 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:18.505648 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:18.505680 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:18.508452 (+ 2772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:18.509219 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:18.509226 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:18.509234 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:18.509373 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:18.509829 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:18.509834 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:18.509837 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:18.510101 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:18.510263 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:18.510991 (+ 728us) server_negotiation.cc:299] Negotiation successful
0808 02:34:18.511225 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":237,"threads_started":1}
I20260808 02:34:18.512813 14685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:18.494273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.194:51485)
0808 02:34:18.494987 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:18.495025 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:18.496809 (+ 1784us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:18.497469 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:18.497476 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:18.497980 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:34:18.498526 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:18.498543 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:18.499527 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:18.499531 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:18.500888 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:18.500901 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:18.501974 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:18.501979 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:18.502171 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:18.502985 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:34:18.503027 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:34:18.505404 (+ 2377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:34:18.508591 (+ 3187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:18.508601 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:18.508617 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:18.509079 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:18.509494 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:18.509499 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:18.509503 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:18.509698 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:18.510245 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:34:18.510254 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:34:18.510614 (+ 360us) client_negotiation.cc:769] Sending connection context
0808 02:34:18.510897 (+ 283us) client_negotiation.cc:240] Negotiation successful
0808 02:34:18.511478 (+ 581us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":268,"threads_started":1}
I20260808 02:34:18.514484 14678 heartbeater.cc:347] Connected to a master server at 127.24.116.254:40999
I20260808 02:34:18.514816 14678 heartbeater.cc:464] Registering TS with master...
I20260808 02:34:18.515618 14678 heartbeater.cc:511] Master 127.24.116.254:40999 requested a full tablet report, sending...
I20260808 02:34:18.517326 14196 ts_manager.cc:194] Registered new tserver with Master: ff42a9e1dabf4317bf1873613119da2e (127.24.116.194:38881)
I20260808 02:34:18.518198 14196 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.194@KRBTEST.COM'} at 127.24.116.194:51485
WARNING: no policy specified for kudu/127.24.116.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
I20260808 02:34:18.571717 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:40999
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:34351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:34:18.916750 14690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:18.917105 14690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:18.917275 14690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:18.924536 14690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:18.924708 14690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:18.924901 14690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:34:18.935527 14690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:34351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:40999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:18.936837 14690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:18.938194 14690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:18.951797 14698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:18.951733 14700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:18.952050 14695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:18.952905 14690 server_base.cc:1034] running on GCE node
I20260808 02:34:18.953514 14690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:18.954422 14690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:18.955624 14690 hybrid_clock.cc:648] HybridClock initialized: now 1786156458955583 us; error 34 us; skew 500 ppm
I20260808 02:34:18.955956 14690 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:18 dist-test-slave-45dx krb5kdc[14125](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156458, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:18.959295 14690 init.cc:377] Logged in from keytab as kudu/127.24.116.195@KRBTEST.COM (short username kudu)
I20260808 02:34:18.960893 14690 webserver.cc:460] Webserver started at http://127.24.116.195:33665/ using document root <none> and password file <none>
I20260808 02:34:18.961582 14690 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:18.961689 14690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:34:18.961957 14690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:34:18.964996 14690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e"
format_stamp: "Formatted at 2026-08-08 02:34:18 on dist-test-slave-45dx"
server_key: "f842be762b60d7f9e4cdfa354f96732d"
server_key_iv: "7868d89305f5898995ab48e465d8144f"
server_key_version: "encryptionkey@0"
I20260808 02:34:18.965767 14690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e"
format_stamp: "Formatted at 2026-08-08 02:34:18 on dist-test-slave-45dx"
server_key: "f842be762b60d7f9e4cdfa354f96732d"
server_key_iv: "7868d89305f5898995ab48e465d8144f"
server_key_version: "encryptionkey@0"
I20260808 02:34:18.969201 14477 heartbeater.cc:503] Master 127.24.116.254:40999 was elected leader, sending a full tablet report...
I20260808 02:34:18.971421 14690 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 02:34:18.974922 14709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:18.976347 14690 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 02:34:18.976537 14690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e"
format_stamp: "Formatted at 2026-08-08 02:34:18 on dist-test-slave-45dx"
server_key: "f842be762b60d7f9e4cdfa354f96732d"
server_key_iv: "7868d89305f5898995ab48e465d8144f"
server_key_version: "encryptionkey@0"
I20260808 02:34:18.976744 14690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:19.006175 14690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:19.010317 14690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:19.010633 14690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:19.011631 14690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:34:19.013268 14690 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:34:19.013391 14690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:19.013543 14690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:34:19.013626 14690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:19.048708 14690 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:33309
I20260808 02:34:19.048756 14871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:33309 every 8 connection(s)
I20260808 02:34:19.050055 14690 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:34:19.051033 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 14690
I20260808 02:34:19.051230 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:34:19.051836 25043 external_mini_cluster.cc:1428] Setting key d268945c014afdd3cee7d01f65bc5907
Aug 08 02:34:19 dist-test-slave-45dx krb5kdc[14125](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156458, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:34:19.070990 14874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:19.053148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:33681 (local address 127.24.116.254:40999)
0808 02:34:19.053634 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:19.053640 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:19.054863 (+ 1223us) server_negotiation.cc:407] Connection header received
0808 02:34:19.056774 (+ 1911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:19.056778 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:19.056847 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:19.056947 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:19.058417 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.059144 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.060800 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.061172 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.061262 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:19.064575 (+ 3313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:19.064580 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:19.064583 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:19.064613 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:19.067815 (+ 3202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:19.068641 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:19.068646 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:19.068650 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:19.068796 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:19.069228 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:19.069233 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:19.069237 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:19.069503 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:19.069696 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:19.070347 (+ 651us) server_negotiation.cc:299] Negotiation successful
0808 02:34:19.070586 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":240,"threads_started":1}
I20260808 02:34:19.071874 14878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:19.053852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.195:33681)
0808 02:34:19.054691 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:19.054740 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:19.056528 (+ 1788us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:19.057164 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:19.057171 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:19.057703 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:34:19.058263 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:19.058278 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.059269 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.059273 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:19.060682 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:19.060695 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.061358 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.061363 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:19.061544 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:19.062182 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:34:19.062204 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:34:19.064401 (+ 2197us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:34:19.067973 (+ 3572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:19.067981 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:19.067997 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:19.068518 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:19.068915 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:19.068920 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:19.068924 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:19.069106 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:19.069667 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:34:19.069675 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:34:19.070007 (+ 332us) client_negotiation.cc:769] Sending connection context
0808 02:34:19.070255 (+ 248us) client_negotiation.cc:240] Negotiation successful
0808 02:34:19.070771 (+ 516us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":376,"threads_started":1}
I20260808 02:34:19.073187 14872 heartbeater.cc:347] Connected to a master server at 127.24.116.254:40999
I20260808 02:34:19.073490 14872 heartbeater.cc:464] Registering TS with master...
I20260808 02:34:19.074182 14872 heartbeater.cc:511] Master 127.24.116.254:40999 requested a full tablet report, sending...
I20260808 02:34:19.075493 14196 ts_manager.cc:194] Registered new tserver with Master: b7ebd0d20bbc485ba0dd4eb23e98dd9e (127.24.116.195:33309)
I20260808 02:34:19.076277 14196 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.195@KRBTEST.COM'} at 127.24.116.195:33681
I20260808 02:34:19.079938 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:34:19.097333 14874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:19.084634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47826 (local address 127.24.116.254:40999)
0808 02:34:19.084808 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:19.084815 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:19.085194 (+ 379us) server_negotiation.cc:407] Connection header received
0808 02:34:19.085403 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:19.085408 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:19.085489 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:19.085587 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:19.087032 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.087750 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.089139 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.089530 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.089657 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:19.091977 (+ 2320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:19.091983 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:19.091988 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:19.092023 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:19.094479 (+ 2456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:19.095211 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:19.095218 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:19.095221 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:19.095361 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:19.095767 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:19.095772 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:19.095775 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:19.096111 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:19.096408 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:19.096746 (+ 338us) server_negotiation.cc:299] Negotiation successful
0808 02:34:19.096984 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 02:34:19.101212 14196 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47826:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:34:19.108086 14196 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:34:19.132357 14895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:19.120516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:44737 (local address 127.0.0.1:51020)
0808 02:34:19.121790 (+ 1274us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:19.121859 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:19.122032 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:19.123228 (+ 1196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:19.123236 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:19.123271 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:34:19.123817 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:19.123838 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.126309 (+ 2471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.126313 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:19.129079 (+ 2766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:19.129097 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.131194 (+ 2097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.131201 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:19.131470 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:19.131536 (+ 66us) client_negotiation.cc:769] Sending connection context
0808 02:34:19.131627 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 02:34:19.131765 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":676,"mutex_wait_us":28,"thread_start_us":1489,"threads_started":1}
I20260808 02:34:19.133028 14893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:19.120527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44864 (local address 127.24.116.194:38881)
0808 02:34:19.121182 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:19.121190 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:19.122687 (+ 1497us) server_negotiation.cc:407] Connection header received
0808 02:34:19.122991 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:19.122999 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:19.123221 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:19.123382 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:34:19.124466 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.126082 (+ 1616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.130167 (+ 4085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.131699 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.131882 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:19.132071 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:19.132506 (+ 435us) server_negotiation.cc:299] Negotiation successful
0808 02:34:19.132681 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":606,"threads_started":1}
I20260808 02:34:19.133270 14894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:19.120863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51020 (local address 127.24.116.193:44737)
0808 02:34:19.122536 (+ 1673us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:19.122544 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:19.122576 (+ 32us) server_negotiation.cc:407] Connection header received
0808 02:34:19.122713 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:19.122723 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:19.122986 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:19.124049 (+ 1063us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:34:19.124375 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.126086 (+ 1711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.129257 (+ 3171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.130868 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.132517 (+ 1649us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:19.132671 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:19.132744 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 02:34:19.132900 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1502,"thread_start_us":1334,"threads_started":1}
I20260808 02:34:19.133867 14898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:19.120948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:38881 (local address 127.0.0.1:44864)
0808 02:34:19.122571 (+ 1623us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:19.122594 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:19.122788 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:19.123712 (+ 924us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:19.123722 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:19.123749 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:34:19.124224 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:19.124237 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.126304 (+ 2067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.126309 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:19.129970 (+ 3661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:19.129987 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.131940 (+ 1953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.131949 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:19.132212 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:19.132262 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 02:34:19.133263 (+ 1001us) client_negotiation.cc:240] Negotiation successful
0808 02:34:19.133426 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1511,"mutex_wait_us":1226,"thread_start_us":410,"threads_started":1}
I20260808 02:34:19.136495 14899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:19.122744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:33309 (local address 127.0.0.1:57680)
0808 02:34:19.127415 (+ 4671us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:19.127440 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:19.127575 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:19.128395 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:19.128400 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:19.128427 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:34:19.128925 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:19.128938 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.130837 (+ 1899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.130842 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:19.133519 (+ 2677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:19.133533 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.135700 (+ 2167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.135705 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:19.135871 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:19.135903 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 02:34:19.135990 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 02:34:19.136106 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4523,"mutex_wait_us":28,"thread_start_us":4325,"threads_started":1}
I20260808 02:34:19.136668 14900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:19.123153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57680 (local address 127.24.116.195:33309)
0808 02:34:19.127038 (+ 3885us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:19.127048 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:19.127712 (+ 664us) server_negotiation.cc:407] Connection header received
0808 02:34:19.127841 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:19.127849 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:19.128075 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:19.128263 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:34:19.129124 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.130659 (+ 1535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.133688 (+ 3029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.135181 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.135381 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:19.135552 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:19.136107 (+ 555us) server_negotiation.cc:299] Negotiation successful
0808 02:34:19.136268 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3702,"thread_start_us":3505,"threads_started":1}
I20260808 02:34:19.137682 14375 tablet_service.cc:1467] Processing CreateTablet for tablet 676548bffc4443ac9e4fa116c39fdee9 (DEFAULT_TABLE table=test-table [id=f97c7794b32e43bf9c8a6374e177402b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:34:19.137611 14581 tablet_service.cc:1467] Processing CreateTablet for tablet 676548bffc4443ac9e4fa116c39fdee9 (DEFAULT_TABLE table=test-table [id=f97c7794b32e43bf9c8a6374e177402b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:34:19.138996 14375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 676548bffc4443ac9e4fa116c39fdee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:34:19.139056 14581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 676548bffc4443ac9e4fa116c39fdee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:34:19.140376 14779 tablet_service.cc:1467] Processing CreateTablet for tablet 676548bffc4443ac9e4fa116c39fdee9 (DEFAULT_TABLE table=test-table [id=f97c7794b32e43bf9c8a6374e177402b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:34:19.141804 14779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 676548bffc4443ac9e4fa116c39fdee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:34:19.151515 14903 tablet_bootstrap.cc:492] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: Bootstrap starting.
I20260808 02:34:19.154196 14905 tablet_bootstrap.cc:492] T 676548bffc4443ac9e4fa116c39fdee9 P ff42a9e1dabf4317bf1873613119da2e: Bootstrap starting.
I20260808 02:34:19.155025 14903 tablet_bootstrap.cc:654] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: Neither blocks nor log segments found. Creating new log.
I20260808 02:34:19.156354 14903 log.cc:824] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: Log is configured to *not* fsync() on all Append() calls
I20260808 02:34:19.157114 14906 tablet_bootstrap.cc:492] T 676548bffc4443ac9e4fa116c39fdee9 P b7ebd0d20bbc485ba0dd4eb23e98dd9e: Bootstrap starting.
I20260808 02:34:19.158455 14905 tablet_bootstrap.cc:654] T 676548bffc4443ac9e4fa116c39fdee9 P ff42a9e1dabf4317bf1873613119da2e: Neither blocks nor log segments found. Creating new log.
I20260808 02:34:19.159961 14905 log.cc:824] T 676548bffc4443ac9e4fa116c39fdee9 P ff42a9e1dabf4317bf1873613119da2e: Log is configured to *not* fsync() on all Append() calls
I20260808 02:34:19.160422 14906 tablet_bootstrap.cc:654] T 676548bffc4443ac9e4fa116c39fdee9 P b7ebd0d20bbc485ba0dd4eb23e98dd9e: Neither blocks nor log segments found. Creating new log.
I20260808 02:34:19.161439 14906 log.cc:824] T 676548bffc4443ac9e4fa116c39fdee9 P b7ebd0d20bbc485ba0dd4eb23e98dd9e: Log is configured to *not* fsync() on all Append() calls
I20260808 02:34:19.164136 14906 tablet_bootstrap.cc:492] T 676548bffc4443ac9e4fa116c39fdee9 P b7ebd0d20bbc485ba0dd4eb23e98dd9e: No bootstrap required, opened a new log
I20260808 02:34:19.164450 14903 tablet_bootstrap.cc:492] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: No bootstrap required, opened a new log
I20260808 02:34:19.164475 14906 ts_tablet_manager.cc:1397] T 676548bffc4443ac9e4fa116c39fdee9 P b7ebd0d20bbc485ba0dd4eb23e98dd9e: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260808 02:34:19.164723 14903 ts_tablet_manager.cc:1397] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.007s
I20260808 02:34:19.166599 14905 tablet_bootstrap.cc:492] T 676548bffc4443ac9e4fa116c39fdee9 P ff42a9e1dabf4317bf1873613119da2e: No bootstrap required, opened a new log
I20260808 02:34:19.166927 14905 ts_tablet_manager.cc:1397] T 676548bffc4443ac9e4fa116c39fdee9 P ff42a9e1dabf4317bf1873613119da2e: Time spent bootstrapping tablet: real 0.013s user 0.010s sys 0.000s
I20260808 02:34:19.171797 14906 raft_consensus.cc:348] T 676548bffc4443ac9e4fa116c39fdee9 P b7ebd0d20bbc485ba0dd4eb23e98dd9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff42a9e1dabf4317bf1873613119da2e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38881 } } peers { permanent_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 44737 } } peers { permanent_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33309 } }
I20260808 02:34:19.172178 14906 raft_consensus.cc:374] T 676548bffc4443ac9e4fa116c39fdee9 P b7ebd0d20bbc485ba0dd4eb23e98dd9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:34:19.172307 14906 raft_consensus.cc:729] T 676548bffc4443ac9e4fa116c39fdee9 P b7ebd0d20bbc485ba0dd4eb23e98dd9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ebd0d20bbc485ba0dd4eb23e98dd9e, State: Initialized, Role: FOLLOWER
I20260808 02:34:19.172959 14906 consensus_queue.cc:260] T 676548bffc4443ac9e4fa116c39fdee9 P b7ebd0d20bbc485ba0dd4eb23e98dd9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff42a9e1dabf4317bf1873613119da2e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38881 } } peers { permanent_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 44737 } } peers { permanent_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33309 } }
I20260808 02:34:19.174129 14872 heartbeater.cc:503] Master 127.24.116.254:40999 was elected leader, sending a full tablet report...
I20260808 02:34:19.174607 14906 ts_tablet_manager.cc:1428] T 676548bffc4443ac9e4fa116c39fdee9 P b7ebd0d20bbc485ba0dd4eb23e98dd9e: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20260808 02:34:19.176192 14903 raft_consensus.cc:348] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff42a9e1dabf4317bf1873613119da2e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38881 } } peers { permanent_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 44737 } } peers { permanent_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33309 } }
I20260808 02:34:19.176733 14903 raft_consensus.cc:374] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:34:19.176885 14903 raft_consensus.cc:729] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ef8ba2ffee4ebda4fde4fd0dd824c0, State: Initialized, Role: FOLLOWER
I20260808 02:34:19.177181 14905 raft_consensus.cc:348] T 676548bffc4443ac9e4fa116c39fdee9 P ff42a9e1dabf4317bf1873613119da2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff42a9e1dabf4317bf1873613119da2e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38881 } } peers { permanent_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 44737 } } peers { permanent_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33309 } }
I20260808 02:34:19.177582 14905 raft_consensus.cc:374] T 676548bffc4443ac9e4fa116c39fdee9 P ff42a9e1dabf4317bf1873613119da2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:34:19.177702 14905 raft_consensus.cc:729] T 676548bffc4443ac9e4fa116c39fdee9 P ff42a9e1dabf4317bf1873613119da2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff42a9e1dabf4317bf1873613119da2e, State: Initialized, Role: FOLLOWER
I20260808 02:34:19.177640 14903 consensus_queue.cc:260] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff42a9e1dabf4317bf1873613119da2e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38881 } } peers { permanent_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 44737 } } peers { permanent_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33309 } }
I20260808 02:34:19.178411 14905 consensus_queue.cc:260] T 676548bffc4443ac9e4fa116c39fdee9 P ff42a9e1dabf4317bf1873613119da2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff42a9e1dabf4317bf1873613119da2e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38881 } } peers { permanent_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 44737 } } peers { permanent_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33309 } }
I20260808 02:34:19.179533 14903 ts_tablet_manager.cc:1428] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: Time spent starting tablet: real 0.015s user 0.009s sys 0.003s
I20260808 02:34:19.180640 14678 heartbeater.cc:503] Master 127.24.116.254:40999 was elected leader, sending a full tablet report...
I20260808 02:34:19.181270 14905 ts_tablet_manager.cc:1428] T 676548bffc4443ac9e4fa116c39fdee9 P ff42a9e1dabf4317bf1873613119da2e: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
W20260808 02:34:19.188000 14478 tablet.cc:2369] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:34:19.225433 14920 raft_consensus.cc:482] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:34:19.225807 14920 raft_consensus.cc:504] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff42a9e1dabf4317bf1873613119da2e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38881 } } peers { permanent_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 44737 } } peers { permanent_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33309 } }
I20260808 02:34:19.227875 14920 leader_election.cc:288] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff42a9e1dabf4317bf1873613119da2e (127.24.116.194:38881), b7ebd0d20bbc485ba0dd4eb23e98dd9e (127.24.116.195:33309)
I20260808 02:34:19.235220 14893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:19.228475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:54091 (local address 127.24.116.194:38881)
0808 02:34:19.228759 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:19.228768 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:19.229590 (+ 822us) server_negotiation.cc:407] Connection header received
0808 02:34:19.229865 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:19.229870 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:19.229934 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:19.230037 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:34:19.230761 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.231463 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.233517 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.234262 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.234437 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:19.234511 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:19.234819 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 02:34:19.234942 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260808 02:34:19.235234 14900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:19.228670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:35343 (local address 127.24.116.195:33309)
0808 02:34:19.228943 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:19.228952 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:19.229748 (+ 796us) server_negotiation.cc:407] Connection header received
0808 02:34:19.229862 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:19.229866 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:19.229926 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:19.230021 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:34:19.230709 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.231474 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.233481 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.234239 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.234404 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:19.234496 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:19.234854 (+ 358us) server_negotiation.cc:299] Negotiation successful
0808 02:34:19.234972 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 02:34:19.235636 14922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:19.228362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:38881 (local address 127.24.116.193:54091)
0808 02:34:19.229470 (+ 1108us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:19.229488 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:19.229689 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:19.230076 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:19.230083 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:19.230106 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:34:19.230590 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:19.230601 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.231605 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.231614 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:19.233336 (+ 1722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:19.233349 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.234523 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.234531 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:19.234659 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:19.234681 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 02:34:19.234755 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 02:34:19.234906 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":959,"mutex_wait_us":114,"thread_start_us":647,"threads_started":1}
I20260808 02:34:19.235657 14923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:19.228508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:33309 (local address 127.24.116.193:35343)
0808 02:34:19.229577 (+ 1069us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:19.229592 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:19.229702 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:19.230040 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:19.230044 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:19.230067 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:34:19.230527 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:19.230539 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.231631 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.231634 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:19.233318 (+ 1684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:19.233330 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.234475 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.234482 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:19.234627 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:19.234689 (+ 62us) client_negotiation.cc:769] Sending connection context
0808 02:34:19.234800 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 02:34:19.234938 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":960,"mutex_wait_us":27,"thread_start_us":653,"threads_started":1}
I20260808 02:34:19.236672 14614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "676548bffc4443ac9e4fa116c39fdee9" candidate_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff42a9e1dabf4317bf1873613119da2e" is_pre_election: true
I20260808 02:34:19.236720 14812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "676548bffc4443ac9e4fa116c39fdee9" candidate_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e" is_pre_election: true
I20260808 02:34:19.237164 14614 raft_consensus.cc:2454] T 676548bffc4443ac9e4fa116c39fdee9 P ff42a9e1dabf4317bf1873613119da2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12ef8ba2ffee4ebda4fde4fd0dd824c0 in term 0.
I20260808 02:34:19.237259 14812 raft_consensus.cc:2454] T 676548bffc4443ac9e4fa116c39fdee9 P b7ebd0d20bbc485ba0dd4eb23e98dd9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12ef8ba2ffee4ebda4fde4fd0dd824c0 in term 0.
I20260808 02:34:19.237933 14306 leader_election.cc:302] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 12ef8ba2ffee4ebda4fde4fd0dd824c0, b7ebd0d20bbc485ba0dd4eb23e98dd9e, ff42a9e1dabf4317bf1873613119da2e; no voters:
I20260808 02:34:19.238279 14920 raft_consensus.cc:2781] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:34:19.238442 14920 raft_consensus.cc:482] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:34:19.238556 14920 raft_consensus.cc:3037] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:34:19.240909 14920 raft_consensus.cc:504] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff42a9e1dabf4317bf1873613119da2e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38881 } } peers { permanent_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 44737 } } peers { permanent_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33309 } }
I20260808 02:34:19.241602 14920 leader_election.cc:288] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [CANDIDATE]: Term 1 election: Requested vote from peers ff42a9e1dabf4317bf1873613119da2e (127.24.116.194:38881), b7ebd0d20bbc485ba0dd4eb23e98dd9e (127.24.116.195:33309)
I20260808 02:34:19.241984 14614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "676548bffc4443ac9e4fa116c39fdee9" candidate_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff42a9e1dabf4317bf1873613119da2e"
I20260808 02:34:19.242092 14812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "676548bffc4443ac9e4fa116c39fdee9" candidate_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e"
I20260808 02:34:19.242184 14614 raft_consensus.cc:3037] T 676548bffc4443ac9e4fa116c39fdee9 P ff42a9e1dabf4317bf1873613119da2e [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:34:19.242318 14812 raft_consensus.cc:3037] T 676548bffc4443ac9e4fa116c39fdee9 P b7ebd0d20bbc485ba0dd4eb23e98dd9e [term 0 FOLLOWER]: Advancing to term 1
W20260808 02:34:19.243108 14682 tablet.cc:2369] T 676548bffc4443ac9e4fa116c39fdee9 P ff42a9e1dabf4317bf1873613119da2e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:34:19.244863 14614 raft_consensus.cc:2454] T 676548bffc4443ac9e4fa116c39fdee9 P ff42a9e1dabf4317bf1873613119da2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12ef8ba2ffee4ebda4fde4fd0dd824c0 in term 1.
I20260808 02:34:19.245173 14812 raft_consensus.cc:2454] T 676548bffc4443ac9e4fa116c39fdee9 P b7ebd0d20bbc485ba0dd4eb23e98dd9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12ef8ba2ffee4ebda4fde4fd0dd824c0 in term 1.
I20260808 02:34:19.245299 14306 leader_election.cc:302] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12ef8ba2ffee4ebda4fde4fd0dd824c0, ff42a9e1dabf4317bf1873613119da2e; no voters:
I20260808 02:34:19.245705 14920 raft_consensus.cc:2781] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:34:19.246212 14920 raft_consensus.cc:686] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 1 LEADER]: Becoming Leader. State: Replica: 12ef8ba2ffee4ebda4fde4fd0dd824c0, State: Running, Role: LEADER
I20260808 02:34:19.246694 14920 consensus_queue.cc:237] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff42a9e1dabf4317bf1873613119da2e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38881 } } peers { permanent_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 44737 } } peers { permanent_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33309 } }
I20260808 02:34:19.251453 14194 catalog_manager.cc:5495] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 12ef8ba2ffee4ebda4fde4fd0dd824c0 (127.24.116.193). New cstate: current_term: 1 leader_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff42a9e1dabf4317bf1873613119da2e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33309 } health_report { overall_health: UNKNOWN } } }
I20260808 02:34:19.293139 14894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:19.287496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51026 (local address 127.24.116.193:44737)
0808 02:34:19.287728 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:19.287737 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:19.287816 (+ 79us) server_negotiation.cc:407] Connection header received
0808 02:34:19.288086 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:19.288090 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:19.288173 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:19.288366 (+ 193us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:34:19.288764 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.289473 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.290925 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.291351 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.291487 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:19.292002 (+ 515us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:34:19.292552 (+ 550us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:34:19.292705 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:19.292786 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 02:34:19.292877 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260808 02:34:19.301441 14812 raft_consensus.cc:1261] T 676548bffc4443ac9e4fa116c39fdee9 P b7ebd0d20bbc485ba0dd4eb23e98dd9e [term 1 FOLLOWER]: Refusing update from remote peer 12ef8ba2ffee4ebda4fde4fd0dd824c0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:34:19.301440 14614 raft_consensus.cc:1261] T 676548bffc4443ac9e4fa116c39fdee9 P ff42a9e1dabf4317bf1873613119da2e [term 1 FOLLOWER]: Refusing update from remote peer 12ef8ba2ffee4ebda4fde4fd0dd824c0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260808 02:34:19.301864 14873 tablet.cc:2369] T 676548bffc4443ac9e4fa116c39fdee9 P b7ebd0d20bbc485ba0dd4eb23e98dd9e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:34:19.302580 14925 consensus_queue.cc:1035] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff42a9e1dabf4317bf1873613119da2e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:34:19.302950 14920 consensus_queue.cc:1035] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:34:19.328446 14193 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47826:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:34:19.328779 14193 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47826:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:34:19.333020 14193 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a: Sending DeleteTablet for 3 replicas of tablet 676548bffc4443ac9e4fa116c39fdee9
I20260808 02:34:19.334390 14581 tablet_service.cc:1514] Processing DeleteTablet for tablet 676548bffc4443ac9e4fa116c39fdee9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:34:19 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:44864
I20260808 02:34:19.334404 14375 tablet_service.cc:1514] Processing DeleteTablet for tablet 676548bffc4443ac9e4fa116c39fdee9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:34:19 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:51020
I20260808 02:34:19.335222 14779 tablet_service.cc:1514] Processing DeleteTablet for tablet 676548bffc4443ac9e4fa116c39fdee9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:34:19 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:57680
I20260808 02:34:19.335402 14949 tablet_replica.cc:330] T 676548bffc4443ac9e4fa116c39fdee9 P ff42a9e1dabf4317bf1873613119da2e: stopping tablet replica
I20260808 02:34:19.335867 14949 raft_consensus.cc:2229] T 676548bffc4443ac9e4fa116c39fdee9 P ff42a9e1dabf4317bf1873613119da2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:34:19.336443 14949 raft_consensus.cc:2258] T 676548bffc4443ac9e4fa116c39fdee9 P ff42a9e1dabf4317bf1873613119da2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:34:19.336548 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 14284
I20260808 02:34:19.337460 14950 tablet_replica.cc:330] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: stopping tablet replica
I20260808 02:34:19.338187 14950 raft_consensus.cc:2229] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:34:19.338996 14950 raft_consensus.cc:2258] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:34:19.342329 14950 ts_tablet_manager.cc:1905] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:34:19.343245 14949 ts_tablet_manager.cc:1905] T 676548bffc4443ac9e4fa116c39fdee9 P ff42a9e1dabf4317bf1873613119da2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:34:19.351083 14950 ts_tablet_manager.cc:1918] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:34:19.351328 14950 log.cc:1196] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/676548bffc4443ac9e4fa116c39fdee9
Aug 08 02:34:19 dist-test-slave-45dx krb5kdc[14125](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.193@KRBTEST.COM
I20260808 02:34:19.352137 14950 ts_tablet_manager.cc:1939] T 676548bffc4443ac9e4fa116c39fdee9 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: Deleting consensus metadata
I20260808 02:34:19.354344 14166 catalog_manager.cc:4841] TS 12ef8ba2ffee4ebda4fde4fd0dd824c0 (127.24.116.193:44737): tablet 676548bffc4443ac9e4fa116c39fdee9 (table test-table [id=f97c7794b32e43bf9c8a6374e177402b]) successfully deleted
I20260808 02:34:19.355885 14952 tablet_replica.cc:330] T 676548bffc4443ac9e4fa116c39fdee9 P b7ebd0d20bbc485ba0dd4eb23e98dd9e: stopping tablet replica
I20260808 02:34:19.356524 14952 raft_consensus.cc:2229] T 676548bffc4443ac9e4fa116c39fdee9 P b7ebd0d20bbc485ba0dd4eb23e98dd9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:34:19.356806 14949 ts_tablet_manager.cc:1918] T 676548bffc4443ac9e4fa116c39fdee9 P ff42a9e1dabf4317bf1873613119da2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:34:19.357052 14949 log.cc:1196] T 676548bffc4443ac9e4fa116c39fdee9 P ff42a9e1dabf4317bf1873613119da2e: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/676548bffc4443ac9e4fa116c39fdee9
I20260808 02:34:19.357153 14952 raft_consensus.cc:2258] T 676548bffc4443ac9e4fa116c39fdee9 P b7ebd0d20bbc485ba0dd4eb23e98dd9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:34:19.357978 14949 ts_tablet_manager.cc:1939] T 676548bffc4443ac9e4fa116c39fdee9 P ff42a9e1dabf4317bf1873613119da2e: Deleting consensus metadata
I20260808 02:34:19.359572 14952 ts_tablet_manager.cc:1905] T 676548bffc4443ac9e4fa116c39fdee9 P b7ebd0d20bbc485ba0dd4eb23e98dd9e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:34:19.359965 14167 catalog_manager.cc:4841] TS ff42a9e1dabf4317bf1873613119da2e (127.24.116.194:38881): tablet 676548bffc4443ac9e4fa116c39fdee9 (table test-table [id=f97c7794b32e43bf9c8a6374e177402b]) successfully deleted
I20260808 02:34:19.361655 14894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:19.337574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51034 (local address 127.24.116.193:44737)
0808 02:34:19.337765 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:19.337771 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:19.339892 (+ 2121us) server_negotiation.cc:407] Connection header received
0808 02:34:19.340125 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:19.340131 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:19.340212 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:19.340375 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:19.342448 (+ 2073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.343718 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.345803 (+ 2085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.346550 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.346652 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:19.352974 (+ 6322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:19.352988 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:19.353009 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:19.353063 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:19.357485 (+ 4422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:19.358508 (+ 1023us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:19.358518 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:19.358521 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:19.358775 (+ 254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:19.359270 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:19.359275 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:19.359279 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:19.359836 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:19.360126 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:19.360789 (+ 663us) server_negotiation.cc:299] Negotiation successful
0808 02:34:19.361048 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 02:34:19.362360 14469 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:19.367178 14952 ts_tablet_manager.cc:1918] T 676548bffc4443ac9e4fa116c39fdee9 P b7ebd0d20bbc485ba0dd4eb23e98dd9e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:34:19.367353 14952 log.cc:1196] T 676548bffc4443ac9e4fa116c39fdee9 P b7ebd0d20bbc485ba0dd4eb23e98dd9e: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/676548bffc4443ac9e4fa116c39fdee9
I20260808 02:34:19.367818 14952 ts_tablet_manager.cc:1939] T 676548bffc4443ac9e4fa116c39fdee9 P b7ebd0d20bbc485ba0dd4eb23e98dd9e: Deleting consensus metadata
I20260808 02:34:19.369465 14166 catalog_manager.cc:4841] TS b7ebd0d20bbc485ba0dd4eb23e98dd9e (127.24.116.195:33309): tablet 676548bffc4443ac9e4fa116c39fdee9 (table test-table [id=f97c7794b32e43bf9c8a6374e177402b]) successfully deleted
I20260808 02:34:19.462383 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 14284
I20260808 02:34:19.490763 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 14488
Aug 08 02:34:19 dist-test-slave-45dx krb5kdc[14125](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.194@KRBTEST.COM
I20260808 02:34:19.507840 14893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:19.491662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44870 (local address 127.24.116.194:38881)
0808 02:34:19.491836 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:19.491843 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:19.491917 (+ 74us) server_negotiation.cc:407] Connection header received
0808 02:34:19.492070 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:19.492076 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:19.492170 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:19.492281 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:19.493595 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.494854 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.496225 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.496939 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.497082 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:19.501797 (+ 4715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:19.501811 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:19.501829 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:19.501869 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:19.505027 (+ 3158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:19.505848 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:19.505855 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:19.505857 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:19.505984 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:19.506386 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:19.506390 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:19.506391 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:19.506775 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:19.506998 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:19.507350 (+ 352us) server_negotiation.cc:299] Negotiation successful
0808 02:34:19.507513 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 02:34:19.508590 14669 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:19.598932 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 14488
I20260808 02:34:19.628077 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 14690
Aug 08 02:34:19 dist-test-slave-45dx krb5kdc[14125](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.195@KRBTEST.COM
I20260808 02:34:19.643322 14900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:19.628955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57692 (local address 127.24.116.195:33309)
0808 02:34:19.629131 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:19.629135 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:19.629177 (+ 42us) server_negotiation.cc:407] Connection header received
0808 02:34:19.629369 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:19.629373 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:19.629454 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:19.629546 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:19.630877 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.631590 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.633036 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:19.633427 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:19.633522 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:19.637979 (+ 4457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:19.637994 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:19.638012 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:19.638045 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:19.640763 (+ 2718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:19.641471 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:19.641478 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:19.641481 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:19.641608 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:19.641997 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:19.642000 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:19.642002 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:19.642347 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:19.642568 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:19.642899 (+ 331us) server_negotiation.cc:299] Negotiation successful
0808 02:34:19.643068 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 02:34:19.644114 14865 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:19.734170 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 14690
I20260808 02:34:19.755051 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 14143
I20260808 02:34:19.756263 14239 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:19.869496 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 14143
I20260808 02:34:19.897624 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:40999
--webserver_interface=127.24.116.254
--webserver_port=33189
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:34351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:40999
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:34:20.251080 14960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:20.251405 14960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:20.251567 14960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:20.258839 14960 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:34:20.258940 14960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:20.259035 14960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:20.259137 14960 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:34:20.259228 14960 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:34:20.272917 14960 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:34351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:40999
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:40999
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=33189
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:20.274348 14960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:20.275805 14960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:20.304625 14968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:20.304710 14974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:20.304664 14970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:20.305620 14960 server_base.cc:1034] running on GCE node
I20260808 02:34:20.306640 14960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:20.308171 14960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:20.309393 14960 hybrid_clock.cc:648] HybridClock initialized: now 1786156460309357 us; error 59 us; skew 500 ppm
I20260808 02:34:20.309846 14960 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:20 dist-test-slave-45dx krb5kdc[14125](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156460, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:20.318143 14960 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:34:20.320117 14960 webserver.cc:460] Webserver started at http://127.24.116.254:33189/ using document root <none> and password file <none>
I20260808 02:34:20.320978 14960 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:20.321151 14960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:34:20.327724 14960 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.002s
I20260808 02:34:20.330919 14985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:20.332466 14960 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 02:34:20.332664 14960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "2b8132c78e754d6d85edfa6cb7dd576a"
format_stamp: "Formatted at 2026-08-08 02:34:17 on dist-test-slave-45dx"
server_key: "2de4410fa74cc18ca512e4fa75f090f6"
server_key_iv: "b12ca95cc73cb83c4357c7e4f34b7957"
server_key_version: "encryptionkey@0"
I20260808 02:34:20.333773 14960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:20.349152 14960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:20.353463 14960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:20.353868 14960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:20.374634 14960 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:40999
I20260808 02:34:20.374653 15057 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:40999 every 8 connection(s)
I20260808 02:34:20.376857 14960 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:34:20.377933 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 14960
I20260808 02:34:20.379174 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:44737
--local_ip_for_outbound_sockets=127.24.116.193
--tserver_master_addrs=127.24.116.254:40999
--webserver_port=39863
--webserver_interface=127.24.116.193
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:34351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:34:20.385161 15060 sys_catalog.cc:263] Verifying existing consensus state
I20260808 02:34:20.388721 15060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a: Bootstrap starting.
I20260808 02:34:20.416870 15060 log.cc:824] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a: Log is configured to *not* fsync() on all Append() calls
I20260808 02:34:20.433531 15060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 02:34:20.434229 15060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a: Bootstrap complete.
I20260808 02:34:20.448342 15060 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8132c78e754d6d85edfa6cb7dd576a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40999 } }
I20260808 02:34:20.449591 15060 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b8132c78e754d6d85edfa6cb7dd576a, State: Initialized, Role: FOLLOWER
I20260808 02:34:20.450387 15060 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8132c78e754d6d85edfa6cb7dd576a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40999 } }
I20260808 02:34:20.450671 15060 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:34:20.450814 15060 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:34:20.450999 15060 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 1 FOLLOWER]: Advancing to term 2
I20260808 02:34:20.456943 15060 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8132c78e754d6d85edfa6cb7dd576a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40999 } }
I20260808 02:34:20.457691 15060 leader_election.cc:302] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2b8132c78e754d6d85edfa6cb7dd576a; no voters:
I20260808 02:34:20.458441 15060 leader_election.cc:288] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 02:34:20.458582 15065 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 2 FOLLOWER]: Leader election won for term 2
I20260808 02:34:20.460119 15065 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 2 LEADER]: Becoming Leader. State: Replica: 2b8132c78e754d6d85edfa6cb7dd576a, State: Running, Role: LEADER
I20260808 02:34:20.460724 15065 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8132c78e754d6d85edfa6cb7dd576a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40999 } }
I20260808 02:34:20.461225 15060 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:34:20.463153 15068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b8132c78e754d6d85edfa6cb7dd576a. Latest consensus state: current_term: 2 leader_uuid: "2b8132c78e754d6d85edfa6cb7dd576a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8132c78e754d6d85edfa6cb7dd576a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40999 } } }
I20260808 02:34:20.463511 15068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [sys.catalog]: This master's current role is: LEADER
I20260808 02:34:20.464066 15067 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2b8132c78e754d6d85edfa6cb7dd576a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8132c78e754d6d85edfa6cb7dd576a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40999 } } }
I20260808 02:34:20.464406 15067 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [sys.catalog]: This master's current role is: LEADER
I20260808 02:34:20.466486 15072 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:34:20.475963 15072 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:34:20.477696 15072 catalog_manager.cc:1259] Loaded cluster ID: 39253cc6a1084f4dba63b050417cbc7e
I20260808 02:34:20.477857 15072 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:34:20.481595 15072 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 02:34:20.500780 15072 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 02:34:20.510715 15072 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:34:20.512758 15072 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a: Loaded TSK: 0
I20260808 02:34:20.514509 15072 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 02:34:20.777112 15062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:20.777392 15062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:20.777539 15062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:20.785336 15062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:20.785451 15062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:20.785620 15062 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:34:20.795755 15062 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:34351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:44737
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=39863
--tserver_master_addrs=127.24.116.254:40999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:20.797261 15062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:20.798621 15062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:20.818240 15106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:20.818243 15111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:20.818831 15098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:20.819096 15062 server_base.cc:1034] running on GCE node
I20260808 02:34:20.819783 15062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:20.820931 15062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:20.822160 15062 hybrid_clock.cc:648] HybridClock initialized: now 1786156460822111 us; error 43 us; skew 500 ppm
I20260808 02:34:20.822528 15062 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:20 dist-test-slave-45dx krb5kdc[14125](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156460, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:20.826025 15062 init.cc:377] Logged in from keytab as kudu/127.24.116.193@KRBTEST.COM (short username kudu)
I20260808 02:34:20.827685 15062 webserver.cc:460] Webserver started at http://127.24.116.193:39863/ using document root <none> and password file <none>
I20260808 02:34:20.828469 15062 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:20.828657 15062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:34:20.834496 15062 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 02:34:20.837456 15119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:20.838920 15062 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 02:34:20.839112 15062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0"
format_stamp: "Formatted at 2026-08-08 02:34:17 on dist-test-slave-45dx"
server_key: "fc5597f3dd5cf3ae132e8c5972086a55"
server_key_iv: "15f17ed78f0dfeed285388b4613cef90"
server_key_version: "encryptionkey@0"
I20260808 02:34:20.840107 15062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:20.863658 15062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:20.868110 15062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:20.868440 15062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:20.869525 15062 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:34:20.871001 15062 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:34:20.871095 15062 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:20.871254 15062 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:34:20.871341 15062 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:20.906687 15062 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:44737
I20260808 02:34:20.906786 15291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:44737 every 8 connection(s)
I20260808 02:34:20.908394 15062 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:34:20.917950 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 15062
I20260808 02:34:20.918764 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:38881
--local_ip_for_outbound_sockets=127.24.116.194
--tserver_master_addrs=127.24.116.254:40999
--webserver_port=37025
--webserver_interface=127.24.116.194
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:34351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 02:34:20 dist-test-slave-45dx krb5kdc[14125](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156460, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:34:20.933889 15300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:20.911681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.193:44399)
0808 02:34:20.912582 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:20.912620 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:20.914331 (+ 1711us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:20.915643 (+ 1312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:20.915650 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:20.916188 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:34:20.916853 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:20.916870 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:20.918584 (+ 1714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:20.918592 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:20.920852 (+ 2260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:20.920870 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:20.921876 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:20.921886 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:20.922193 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:20.922990 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:34:20.923032 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:34:20.926076 (+ 3044us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:34:20.929530 (+ 3454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:20.929542 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:20.929560 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:20.930184 (+ 624us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:20.930615 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:20.930622 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:20.930629 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:20.930890 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:20.931877 (+ 987us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:34:20.931882 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:34:20.932183 (+ 301us) client_negotiation.cc:769] Sending connection context
0808 02:34:20.932468 (+ 285us) client_negotiation.cc:240] Negotiation successful
0808 02:34:20.932861 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"thread_start_us":369,"threads_started":1}
I20260808 02:34:20.934394 15298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:20.911597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:44399 (local address 127.24.116.254:40999)
0808 02:34:20.912331 (+ 734us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:20.912368 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:20.912761 (+ 393us) server_negotiation.cc:407] Connection header received
0808 02:34:20.914848 (+ 2087us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:20.914861 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:20.915187 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:20.915484 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:20.917084 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:20.918409 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:20.920996 (+ 2587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:20.921614 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:20.921773 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:20.926376 (+ 4603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:20.926384 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:20.926397 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:20.926432 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:20.929388 (+ 2956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:20.930327 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:20.930334 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:20.930339 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:20.930493 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:20.931029 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:20.931036 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:20.931041 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:20.931731 (+ 690us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:20.931934 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:20.932739 (+ 805us) server_negotiation.cc:299] Negotiation successful
0808 02:34:20.933190 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":265,"threads_started":1}
I20260808 02:34:20.937259 15292 heartbeater.cc:347] Connected to a master server at 127.24.116.254:40999
I20260808 02:34:20.937645 15292 heartbeater.cc:464] Registering TS with master...
I20260808 02:34:20.938633 15292 heartbeater.cc:511] Master 127.24.116.254:40999 requested a full tablet report, sending...
I20260808 02:34:20.941201 15006 ts_manager.cc:194] Registered new tserver with Master: 12ef8ba2ffee4ebda4fde4fd0dd824c0 (127.24.116.193:44737)
I20260808 02:34:20.943572 15006 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.193@KRBTEST.COM'} at 127.24.116.193:44399
W20260808 02:34:21.268071 15301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:21.268383 15301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:21.268478 15301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:21.275602 15301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:21.275712 15301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:21.275830 15301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:34:21.285831 15301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:34351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:38881
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=37025
--tserver_master_addrs=127.24.116.254:40999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:21.287189 15301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:21.288484 15301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:21.302256 15313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:21.302210 15318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:21.302309 15310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:21.303187 15301 server_base.cc:1034] running on GCE node
I20260808 02:34:21.303820 15301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:21.304910 15301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:21.306183 15301 hybrid_clock.cc:648] HybridClock initialized: now 1786156461306143 us; error 53 us; skew 500 ppm
I20260808 02:34:21.306530 15301 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:21 dist-test-slave-45dx krb5kdc[14125](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156461, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:21.309898 15301 init.cc:377] Logged in from keytab as kudu/127.24.116.194@KRBTEST.COM (short username kudu)
I20260808 02:34:21.311473 15301 webserver.cc:460] Webserver started at http://127.24.116.194:37025/ using document root <none> and password file <none>
I20260808 02:34:21.312165 15301 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:21.312382 15301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:34:21.317754 15301 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260808 02:34:21.320619 15330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:21.322207 15301 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 02:34:21.322429 15301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "ff42a9e1dabf4317bf1873613119da2e"
format_stamp: "Formatted at 2026-08-08 02:34:18 on dist-test-slave-45dx"
server_key: "38c9a7a06d47e9e1e666fe50c3f64f97"
server_key_iv: "34096fb925512e2af2b50f72444df562"
server_key_version: "encryptionkey@0"
I20260808 02:34:21.323499 15301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:21.350905 15301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:21.355511 15301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:21.355837 15301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:21.357051 15301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:34:21.358559 15301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:34:21.358692 15301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:21.358824 15301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:34:21.358919 15301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:21.398643 15301 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:38881
I20260808 02:34:21.398738 15523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:38881 every 8 connection(s)
I20260808 02:34:21.400238 15301 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:34:21.404541 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 15301
I20260808 02:34:21.405226 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:33309
--local_ip_for_outbound_sockets=127.24.116.195
--tserver_master_addrs=127.24.116.254:40999
--webserver_port=33665
--webserver_interface=127.24.116.195
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:34351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 02:34:21 dist-test-slave-45dx krb5kdc[14125](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156461, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:34:21.425590 15298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:21.402936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:51573 (local address 127.24.116.254:40999)
0808 02:34:21.403161 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:21.403166 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:21.404382 (+ 1216us) server_negotiation.cc:407] Connection header received
0808 02:34:21.406460 (+ 2078us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:21.406467 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:21.406581 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:21.406705 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:21.408420 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:21.409348 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:21.411941 (+ 2593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:21.412678 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:21.412812 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:21.417717 (+ 4905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:21.417727 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:21.417733 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:21.417783 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:21.421690 (+ 3907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:21.422634 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:21.422643 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:21.422649 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:21.422845 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:21.423333 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:21.423341 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:21.423347 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:21.423817 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:21.423980 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:21.424847 (+ 867us) server_negotiation.cc:299] Negotiation successful
0808 02:34:21.425132 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 02:34:21.426342 15527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:21.403430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.194:51573)
0808 02:34:21.404191 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:21.404233 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:21.406169 (+ 1936us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:21.406961 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:21.406969 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:21.407639 (+ 670us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:34:21.408209 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:21.408227 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:21.409538 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:21.409547 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:21.411760 (+ 2213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:21.411779 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:21.412945 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:21.412955 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:21.413296 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:21.414131 (+ 835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:34:21.414166 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:34:21.417458 (+ 3292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:34:21.421945 (+ 4487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:21.421955 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:21.421970 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:21.422471 (+ 501us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:21.422976 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:21.422980 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:21.422983 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:21.423204 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:21.423955 (+ 751us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:34:21.423961 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:34:21.424403 (+ 442us) client_negotiation.cc:769] Sending connection context
0808 02:34:21.424668 (+ 265us) client_negotiation.cc:240] Negotiation successful
0808 02:34:21.425135 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":317,"threads_started":1}
I20260808 02:34:21.428068 15524 heartbeater.cc:347] Connected to a master server at 127.24.116.254:40999
I20260808 02:34:21.428485 15524 heartbeater.cc:464] Registering TS with master...
I20260808 02:34:21.429520 15524 heartbeater.cc:511] Master 127.24.116.254:40999 requested a full tablet report, sending...
I20260808 02:34:21.431298 15006 ts_manager.cc:194] Registered new tserver with Master: ff42a9e1dabf4317bf1873613119da2e (127.24.116.194:38881)
I20260808 02:34:21.432374 15006 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.194@KRBTEST.COM'} at 127.24.116.194:51573
W20260808 02:34:21.773492 15529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:21.773756 15529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:21.773939 15529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:21.780962 15529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:21.781157 15529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:21.781363 15529 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:34:21.791177 15529 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:34351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:33309
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=33665
--tserver_master_addrs=127.24.116.254:40999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:21.792518 15529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:21.793882 15529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:21.807256 15539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:21.807338 15541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:21.807225 15537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:21.808193 15529 server_base.cc:1034] running on GCE node
I20260808 02:34:21.808887 15529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:21.809899 15529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:21.811137 15529 hybrid_clock.cc:648] HybridClock initialized: now 1786156461811071 us; error 59 us; skew 500 ppm
I20260808 02:34:21.811480 15529 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:21 dist-test-slave-45dx krb5kdc[14125](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156461, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:21.815079 15529 init.cc:377] Logged in from keytab as kudu/127.24.116.195@KRBTEST.COM (short username kudu)
I20260808 02:34:21.816880 15529 webserver.cc:460] Webserver started at http://127.24.116.195:33665/ using document root <none> and password file <none>
I20260808 02:34:21.817735 15529 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:21.817927 15529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:34:21.824395 15529 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 02:34:21.827677 15557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:21.829435 15529 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:34:21.829639 15529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e"
format_stamp: "Formatted at 2026-08-08 02:34:18 on dist-test-slave-45dx"
server_key: "f842be762b60d7f9e4cdfa354f96732d"
server_key_iv: "7868d89305f5898995ab48e465d8144f"
server_key_version: "encryptionkey@0"
I20260808 02:34:21.830715 15529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:21.851342 15529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:21.856371 15529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:21.856712 15529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:21.857833 15529 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:34:21.859314 15529 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:34:21.859463 15529 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:21.859620 15529 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:34:21.859720 15529 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:21.898062 15529 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:33309
I20260808 02:34:21.898157 15720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:33309 every 8 connection(s)
I20260808 02:34:21.899585 15529 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:34:21.903959 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 15529
Aug 08 02:34:21 dist-test-slave-45dx krb5kdc[14125](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156461, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:34:21.921644 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:21.905175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47834 (local address 127.24.116.254:40999)
0808 02:34:21.907001 (+ 1826us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:21.907006 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:21.907032 (+ 26us) server_negotiation.cc:407] Connection header received
0808 02:34:21.907082 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:21.907089 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:21.907130 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:21.907244 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:21.909004 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:21.910284 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:21.911794 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:21.912270 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:21.912477 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:21.915478 (+ 3001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:21.915483 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:21.915486 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:21.915515 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:21.918757 (+ 3242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:21.919462 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:21.919468 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:21.919471 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:21.919600 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:21.920006 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:21.920012 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:21.920015 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:21.920351 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:21.920652 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:21.920959 (+ 307us) server_negotiation.cc:299] Negotiation successful
0808 02:34:21.921191 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":1721,"thread_start_us":572,"threads_started":1}
I20260808 02:34:21.923044 15298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:21.902595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:44693 (local address 127.24.116.254:40999)
0808 02:34:21.902772 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:21.902777 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:21.904109 (+ 1332us) server_negotiation.cc:407] Connection header received
0808 02:34:21.906714 (+ 2605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:21.906719 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:21.906815 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:21.906923 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:21.909145 (+ 2222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:21.910284 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:21.912617 (+ 2333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:21.913088 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:21.913231 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:21.917042 (+ 3811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:21.917047 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:21.917050 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:21.917088 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:21.919734 (+ 2646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:21.920566 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:21.920571 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:21.920581 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:21.920697 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:21.921154 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:21.921159 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:21.921163 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:21.921465 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:21.921632 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:21.922617 (+ 985us) server_negotiation.cc:299] Negotiation successful
0808 02:34:21.922777 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":59}
I20260808 02:34:21.924465 15724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:21.903021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.195:44693)
0808 02:34:21.903903 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:21.903970 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:21.906442 (+ 2472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:21.907320 (+ 878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:21.907335 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:21.908097 (+ 762us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:34:21.908948 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:21.908974 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:21.910460 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:21.910466 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:21.912452 (+ 1986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:21.912466 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:21.913346 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:21.913354 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:21.913612 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:21.914279 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:34:21.914302 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:34:21.916796 (+ 2494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:34:21.919893 (+ 3097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:21.919902 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:21.919920 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:21.920440 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:21.920822 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:21.920827 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:21.920830 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:21.921028 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:21.921621 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:34:21.921632 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:34:21.922160 (+ 528us) client_negotiation.cc:769] Sending connection context
0808 02:34:21.922486 (+ 326us) client_negotiation.cc:240] Negotiation successful
0808 02:34:21.923062 (+ 576us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":329,"threads_started":1}
I20260808 02:34:21.925966 15722 heartbeater.cc:347] Connected to a master server at 127.24.116.254:40999
I20260808 02:34:21.926286 15722 heartbeater.cc:464] Registering TS with master...
I20260808 02:34:21.927083 15722 heartbeater.cc:511] Master 127.24.116.254:40999 requested a full tablet report, sending...
I20260808 02:34:21.928678 15006 ts_manager.cc:194] Registered new tserver with Master: b7ebd0d20bbc485ba0dd4eb23e98dd9e (127.24.116.195:33309)
I20260808 02:34:21.929512 15006 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.195@KRBTEST.COM'} at 127.24.116.195:44693
I20260808 02:34:21.937547 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:34:21.945380 15298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:21.938636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47840 (local address 127.24.116.254:40999)
0808 02:34:21.938884 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:21.938891 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:21.939251 (+ 360us) server_negotiation.cc:407] Connection header received
0808 02:34:21.939457 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:21.939461 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:21.939596 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:21.939721 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:34:21.940276 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:21.941164 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:21.942867 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:21.943348 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:21.943447 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:21.944091 (+ 644us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:34:21.944756 (+ 665us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:34:21.944893 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:21.944996 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 02:34:21.945068 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 02:34:21.947036 15292 heartbeater.cc:503] Master 127.24.116.254:40999 was elected leader, sending a full tablet report...
I20260808 02:34:21.946452 15006 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:47840:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:34:21.954435 15006 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:34:21.979537 15735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:21.966767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:33309 (local address 127.0.0.1:57702)
0808 02:34:21.968461 (+ 1694us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:21.968508 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:21.968698 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:21.971084 (+ 2386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:21.971092 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:21.971130 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:34:21.971600 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:21.971621 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:21.973992 (+ 2371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:21.973997 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:21.976544 (+ 2547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:21.976571 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:21.978485 (+ 1914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:21.978491 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:21.978680 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:21.978735 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 02:34:21.978842 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 02:34:21.979074 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1313,"mutex_wait_us":23,"thread_start_us":1163,"threads_started":1}
I20260808 02:34:21.980967 15737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:21.967144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57702 (local address 127.24.116.195:33309)
0808 02:34:21.970389 (+ 3245us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:21.970398 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:21.970446 (+ 48us) server_negotiation.cc:407] Connection header received
0808 02:34:21.970546 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:21.970554 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:21.970825 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:21.971828 (+ 1003us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:34:21.972130 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:21.973832 (+ 1702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:21.976771 (+ 2939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:21.978226 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:21.980108 (+ 1882us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:21.980324 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:21.980400 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 02:34:21.980578 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3064,"thread_start_us":2887,"threads_started":1}
I20260808 02:34:21.982290 15738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:21.967758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44886 (local address 127.24.116.194:38881)
0808 02:34:21.969441 (+ 1683us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:21.969454 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:21.971356 (+ 1902us) server_negotiation.cc:407] Connection header received
0808 02:34:21.971466 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:21.971477 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:21.971709 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:21.971926 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:34:21.972844 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:21.975504 (+ 2660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:21.979168 (+ 3664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:21.980682 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:21.980865 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:21.981050 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:21.981761 (+ 711us) server_negotiation.cc:299] Negotiation successful
0808 02:34:21.981948 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1493,"thread_start_us":1353,"threads_started":1}
I20260808 02:34:21.983583 15736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:21.967185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:38881 (local address 127.0.0.1:44886)
0808 02:34:21.971081 (+ 3896us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:21.971100 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:21.971211 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:21.972177 (+ 966us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:21.972185 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:21.972217 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:34:21.972633 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:21.972652 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:21.975669 (+ 3017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:21.975675 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:21.978992 (+ 3317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:21.979006 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:21.981214 (+ 2208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:21.981223 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:21.981443 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:21.981475 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 02:34:21.981555 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 02:34:21.983107 (+ 1552us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3758,"mutex_wait_us":1,"thread_start_us":2505,"threads_started":1}
I20260808 02:34:21.985386 15624 tablet_service.cc:1467] Processing CreateTablet for tablet c0b2571b12f142fd9ee243556f3f9516 (DEFAULT_TABLE table=test-table [id=f01c096da1fd4030a3bfd2c0ba6626d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:34:21.987000 15624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0b2571b12f142fd9ee243556f3f9516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:34:21.987418 15411 tablet_service.cc:1467] Processing CreateTablet for tablet c0b2571b12f142fd9ee243556f3f9516 (DEFAULT_TABLE table=test-table [id=f01c096da1fd4030a3bfd2c0ba6626d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:34:21.989005 15411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0b2571b12f142fd9ee243556f3f9516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:34:21.990586 15735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:21.969094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:44737 (local address 127.0.0.1:51036)
0808 02:34:21.979776 (+ 10682us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:21.979795 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:21.979893 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:21.982704 (+ 2811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:21.982709 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:21.982742 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:34:21.983096 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:21.983110 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:21.985408 (+ 2298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:21.985415 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:21.987223 (+ 1808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:21.987239 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:21.989687 (+ 2448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:21.989694 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:21.989897 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:21.989934 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 02:34:21.990057 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 02:34:21.990228 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10586,"thread_start_us":11496,"threads_started":1}
I20260808 02:34:21.990823 15741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:21.969795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51036 (local address 127.24.116.193:44737)
0808 02:34:21.982101 (+ 12306us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:21.982108 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:21.982138 (+ 30us) server_negotiation.cc:407] Connection header received
0808 02:34:21.982229 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:21.982235 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:21.982475 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:21.982723 (+ 248us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:34:21.983334 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:21.985201 (+ 1867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:21.987417 (+ 2216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:21.989135 (+ 1718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:21.989376 (+ 241us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:21.989553 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:21.990134 (+ 581us) server_negotiation.cc:299] Negotiation successful
0808 02:34:21.990318 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12010,"thread_start_us":11781,"threads_started":1}
I20260808 02:34:21.994964 15180 tablet_service.cc:1467] Processing CreateTablet for tablet c0b2571b12f142fd9ee243556f3f9516 (DEFAULT_TABLE table=test-table [id=f01c096da1fd4030a3bfd2c0ba6626d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:34:21.996496 15180 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0b2571b12f142fd9ee243556f3f9516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:34:22.002874 15742 tablet_bootstrap.cc:492] T c0b2571b12f142fd9ee243556f3f9516 P ff42a9e1dabf4317bf1873613119da2e: Bootstrap starting.
I20260808 02:34:22.005144 15743 tablet_bootstrap.cc:492] T c0b2571b12f142fd9ee243556f3f9516 P b7ebd0d20bbc485ba0dd4eb23e98dd9e: Bootstrap starting.
I20260808 02:34:22.007946 15743 tablet_bootstrap.cc:654] T c0b2571b12f142fd9ee243556f3f9516 P b7ebd0d20bbc485ba0dd4eb23e98dd9e: Neither blocks nor log segments found. Creating new log.
I20260808 02:34:22.008162 15742 tablet_bootstrap.cc:654] T c0b2571b12f142fd9ee243556f3f9516 P ff42a9e1dabf4317bf1873613119da2e: Neither blocks nor log segments found. Creating new log.
I20260808 02:34:22.009241 15743 log.cc:824] T c0b2571b12f142fd9ee243556f3f9516 P b7ebd0d20bbc485ba0dd4eb23e98dd9e: Log is configured to *not* fsync() on all Append() calls
I20260808 02:34:22.009488 15742 log.cc:824] T c0b2571b12f142fd9ee243556f3f9516 P ff42a9e1dabf4317bf1873613119da2e: Log is configured to *not* fsync() on all Append() calls
I20260808 02:34:22.012348 15742 tablet_bootstrap.cc:492] T c0b2571b12f142fd9ee243556f3f9516 P ff42a9e1dabf4317bf1873613119da2e: No bootstrap required, opened a new log
I20260808 02:34:22.012645 15743 tablet_bootstrap.cc:492] T c0b2571b12f142fd9ee243556f3f9516 P b7ebd0d20bbc485ba0dd4eb23e98dd9e: No bootstrap required, opened a new log
I20260808 02:34:22.012785 15742 ts_tablet_manager.cc:1397] T c0b2571b12f142fd9ee243556f3f9516 P ff42a9e1dabf4317bf1873613119da2e: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260808 02:34:22.012815 15748 tablet_bootstrap.cc:492] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: Bootstrap starting.
I20260808 02:34:22.012916 15743 ts_tablet_manager.cc:1397] T c0b2571b12f142fd9ee243556f3f9516 P b7ebd0d20bbc485ba0dd4eb23e98dd9e: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.005s
I20260808 02:34:22.016369 15748 tablet_bootstrap.cc:654] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: Neither blocks nor log segments found. Creating new log.
I20260808 02:34:22.017660 15748 log.cc:824] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: Log is configured to *not* fsync() on all Append() calls
I20260808 02:34:22.020849 15748 tablet_bootstrap.cc:492] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: No bootstrap required, opened a new log
I20260808 02:34:22.021119 15748 ts_tablet_manager.cc:1397] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 02:34:22.021204 15743 raft_consensus.cc:348] T c0b2571b12f142fd9ee243556f3f9516 P b7ebd0d20bbc485ba0dd4eb23e98dd9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33309 } } peers { permanent_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 44737 } } peers { permanent_uuid: "ff42a9e1dabf4317bf1873613119da2e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38881 } }
I20260808 02:34:22.021603 15743 raft_consensus.cc:374] T c0b2571b12f142fd9ee243556f3f9516 P b7ebd0d20bbc485ba0dd4eb23e98dd9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:34:22.021755 15743 raft_consensus.cc:729] T c0b2571b12f142fd9ee243556f3f9516 P b7ebd0d20bbc485ba0dd4eb23e98dd9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ebd0d20bbc485ba0dd4eb23e98dd9e, State: Initialized, Role: FOLLOWER
I20260808 02:34:22.022357 15743 consensus_queue.cc:260] T c0b2571b12f142fd9ee243556f3f9516 P b7ebd0d20bbc485ba0dd4eb23e98dd9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33309 } } peers { permanent_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 44737 } } peers { permanent_uuid: "ff42a9e1dabf4317bf1873613119da2e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38881 } }
I20260808 02:34:22.023496 15722 heartbeater.cc:503] Master 127.24.116.254:40999 was elected leader, sending a full tablet report...
I20260808 02:34:22.024153 15743 ts_tablet_manager.cc:1428] T c0b2571b12f142fd9ee243556f3f9516 P b7ebd0d20bbc485ba0dd4eb23e98dd9e: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260808 02:34:22.024336 15742 raft_consensus.cc:348] T c0b2571b12f142fd9ee243556f3f9516 P ff42a9e1dabf4317bf1873613119da2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33309 } } peers { permanent_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 44737 } } peers { permanent_uuid: "ff42a9e1dabf4317bf1873613119da2e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38881 } }
I20260808 02:34:22.024756 15742 raft_consensus.cc:374] T c0b2571b12f142fd9ee243556f3f9516 P ff42a9e1dabf4317bf1873613119da2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:34:22.024854 15742 raft_consensus.cc:729] T c0b2571b12f142fd9ee243556f3f9516 P ff42a9e1dabf4317bf1873613119da2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff42a9e1dabf4317bf1873613119da2e, State: Initialized, Role: FOLLOWER
I20260808 02:34:22.027035 15742 consensus_queue.cc:260] T c0b2571b12f142fd9ee243556f3f9516 P ff42a9e1dabf4317bf1873613119da2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33309 } } peers { permanent_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 44737 } } peers { permanent_uuid: "ff42a9e1dabf4317bf1873613119da2e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38881 } }
I20260808 02:34:22.028213 15524 heartbeater.cc:503] Master 127.24.116.254:40999 was elected leader, sending a full tablet report...
I20260808 02:34:22.029052 15742 ts_tablet_manager.cc:1428] T c0b2571b12f142fd9ee243556f3f9516 P ff42a9e1dabf4317bf1873613119da2e: Time spent starting tablet: real 0.016s user 0.008s sys 0.005s
I20260808 02:34:22.031440 15748 raft_consensus.cc:348] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33309 } } peers { permanent_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 44737 } } peers { permanent_uuid: "ff42a9e1dabf4317bf1873613119da2e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38881 } }
I20260808 02:34:22.031879 15748 raft_consensus.cc:374] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:34:22.032047 15748 raft_consensus.cc:729] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ef8ba2ffee4ebda4fde4fd0dd824c0, State: Initialized, Role: FOLLOWER
I20260808 02:34:22.032676 15748 consensus_queue.cc:260] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33309 } } peers { permanent_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 44737 } } peers { permanent_uuid: "ff42a9e1dabf4317bf1873613119da2e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38881 } }
I20260808 02:34:22.034412 15748 ts_tablet_manager.cc:1428] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: Time spent starting tablet: real 0.013s user 0.006s sys 0.007s
W20260808 02:34:22.151404 15723 tablet.cc:2369] T c0b2571b12f142fd9ee243556f3f9516 P b7ebd0d20bbc485ba0dd4eb23e98dd9e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:34:22.153687 15526 tablet.cc:2369] T c0b2571b12f142fd9ee243556f3f9516 P ff42a9e1dabf4317bf1873613119da2e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:34:22.160959 15295 tablet.cc:2369] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:34:22.205816 15755 raft_consensus.cc:482] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:34:22.206166 15755 raft_consensus.cc:504] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33309 } } peers { permanent_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 44737 } } peers { permanent_uuid: "ff42a9e1dabf4317bf1873613119da2e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38881 } }
I20260808 02:34:22.208154 15755 leader_election.cc:288] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ebd0d20bbc485ba0dd4eb23e98dd9e (127.24.116.195:33309), ff42a9e1dabf4317bf1873613119da2e (127.24.116.194:38881)
I20260808 02:34:22.216589 15738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:22.208816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:60565 (local address 127.24.116.194:38881)
0808 02:34:22.209043 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:22.209052 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:22.210237 (+ 1185us) server_negotiation.cc:407] Connection header received
0808 02:34:22.210408 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:22.210411 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:22.210502 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:22.210595 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:34:22.211267 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:22.211972 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:22.214731 (+ 2759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:22.215483 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:22.215600 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:22.215650 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:22.216166 (+ 516us) server_negotiation.cc:299] Negotiation successful
0808 02:34:22.216317 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 02:34:22.216641 15737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:22.208578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:34091 (local address 127.24.116.195:33309)
0808 02:34:22.208881 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:22.208892 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:22.210021 (+ 1129us) server_negotiation.cc:407] Connection header received
0808 02:34:22.210247 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:22.210254 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:22.210375 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:22.210470 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:34:22.211175 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:22.212031 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:22.214681 (+ 2650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:22.215595 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:22.215771 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:22.215858 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:22.216175 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 02:34:22.216354 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 02:34:22.216729 15756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:22.208557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:33309 (local address 127.24.116.193:34091)
0808 02:34:22.209874 (+ 1317us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:22.209898 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:22.210050 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:22.210518 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:22.210523 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:22.210554 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:34:22.211010 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:22.211022 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:22.212203 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:22.212210 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:22.214494 (+ 2284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:22.214506 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:22.215837 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:22.215842 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:22.215997 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:22.216020 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 02:34:22.216127 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 02:34:22.216331 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1119,"mutex_wait_us":148,"thread_start_us":698,"threads_started":1}
I20260808 02:34:22.217324 15757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:22.208654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:38881 (local address 127.24.116.193:60565)
0808 02:34:22.210098 (+ 1444us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:22.210113 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:22.210281 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:22.210663 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:22.210666 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:22.210700 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:34:22.211105 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:22.211117 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:22.212145 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:22.212154 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:22.214527 (+ 2373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:22.214540 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:22.215713 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:22.215720 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:22.215987 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:22.216015 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 02:34:22.216125 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 02:34:22.216355 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1267,"mutex_wait_us":106,"thread_start_us":1061,"threads_started":1}
I20260808 02:34:22.217945 15656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0b2571b12f142fd9ee243556f3f9516" candidate_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e" is_pre_election: true
I20260808 02:34:22.218447 15656 raft_consensus.cc:2454] T c0b2571b12f142fd9ee243556f3f9516 P b7ebd0d20bbc485ba0dd4eb23e98dd9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12ef8ba2ffee4ebda4fde4fd0dd824c0 in term 0.
I20260808 02:34:22.218551 15445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0b2571b12f142fd9ee243556f3f9516" candidate_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff42a9e1dabf4317bf1873613119da2e" is_pre_election: true
I20260808 02:34:22.219098 15120 leader_election.cc:302] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12ef8ba2ffee4ebda4fde4fd0dd824c0, b7ebd0d20bbc485ba0dd4eb23e98dd9e; no voters:
I20260808 02:34:22.219101 15445 raft_consensus.cc:2454] T c0b2571b12f142fd9ee243556f3f9516 P ff42a9e1dabf4317bf1873613119da2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12ef8ba2ffee4ebda4fde4fd0dd824c0 in term 0.
I20260808 02:34:22.219532 15755 raft_consensus.cc:2781] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:34:22.219749 15755 raft_consensus.cc:482] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:34:22.219899 15755 raft_consensus.cc:3037] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:34:22.222455 15755 raft_consensus.cc:504] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33309 } } peers { permanent_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 44737 } } peers { permanent_uuid: "ff42a9e1dabf4317bf1873613119da2e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38881 } }
I20260808 02:34:22.223266 15755 leader_election.cc:288] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [CANDIDATE]: Term 1 election: Requested vote from peers b7ebd0d20bbc485ba0dd4eb23e98dd9e (127.24.116.195:33309), ff42a9e1dabf4317bf1873613119da2e (127.24.116.194:38881)
I20260808 02:34:22.223711 15656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0b2571b12f142fd9ee243556f3f9516" candidate_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e"
I20260808 02:34:22.223742 15445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0b2571b12f142fd9ee243556f3f9516" candidate_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff42a9e1dabf4317bf1873613119da2e"
I20260808 02:34:22.223950 15445 raft_consensus.cc:3037] T c0b2571b12f142fd9ee243556f3f9516 P ff42a9e1dabf4317bf1873613119da2e [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:34:22.223930 15656 raft_consensus.cc:3037] T c0b2571b12f142fd9ee243556f3f9516 P b7ebd0d20bbc485ba0dd4eb23e98dd9e [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:34:22.226302 15445 raft_consensus.cc:2454] T c0b2571b12f142fd9ee243556f3f9516 P ff42a9e1dabf4317bf1873613119da2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12ef8ba2ffee4ebda4fde4fd0dd824c0 in term 1.
I20260808 02:34:22.226593 15656 raft_consensus.cc:2454] T c0b2571b12f142fd9ee243556f3f9516 P b7ebd0d20bbc485ba0dd4eb23e98dd9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12ef8ba2ffee4ebda4fde4fd0dd824c0 in term 1.
I20260808 02:34:22.226749 15122 leader_election.cc:302] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12ef8ba2ffee4ebda4fde4fd0dd824c0, ff42a9e1dabf4317bf1873613119da2e; no voters:
I20260808 02:34:22.227072 15755 raft_consensus.cc:2781] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:34:22.227576 15755 raft_consensus.cc:686] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 1 LEADER]: Becoming Leader. State: Replica: 12ef8ba2ffee4ebda4fde4fd0dd824c0, State: Running, Role: LEADER
I20260808 02:34:22.228173 15755 consensus_queue.cc:237] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33309 } } peers { permanent_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 44737 } } peers { permanent_uuid: "ff42a9e1dabf4317bf1873613119da2e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38881 } }
I20260808 02:34:22.233661 15006 catalog_manager.cc:5495] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 12ef8ba2ffee4ebda4fde4fd0dd824c0 (127.24.116.193). New cstate: current_term: 1 leader_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff42a9e1dabf4317bf1873613119da2e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38881 } health_report { overall_health: UNKNOWN } } }
I20260808 02:34:22.283140 15741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:22.272012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39812 (local address 127.24.116.193:44737)
0808 02:34:22.272375 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:22.272381 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:22.276424 (+ 4043us) server_negotiation.cc:407] Connection header received
0808 02:34:22.276580 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:22.276588 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:22.276705 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:22.276860 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:34:22.277496 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:22.278499 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:22.280484 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:22.280992 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:22.281176 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:22.281762 (+ 586us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:34:22.282473 (+ 711us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:34:22.282586 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:22.282775 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 02:34:22.282876 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260808 02:34:22.291560 15445 raft_consensus.cc:1261] T c0b2571b12f142fd9ee243556f3f9516 P ff42a9e1dabf4317bf1873613119da2e [term 1 FOLLOWER]: Refusing update from remote peer 12ef8ba2ffee4ebda4fde4fd0dd824c0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:34:22.291560 15656 raft_consensus.cc:1261] T c0b2571b12f142fd9ee243556f3f9516 P b7ebd0d20bbc485ba0dd4eb23e98dd9e [term 1 FOLLOWER]: Refusing update from remote peer 12ef8ba2ffee4ebda4fde4fd0dd824c0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:34:22.292768 15758 consensus_queue.cc:1035] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:34:22.293183 15755 consensus_queue.cc:1035] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff42a9e1dabf4317bf1873613119da2e" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:34:22.304639 15760 mvcc.cc:205] Tried to move back new op lower bound from 7316096869535477760 to 7316096869291573248. Current Snapshot: MvccSnapshot[applied={T|T < 7316096869535477760}]
I20260808 02:34:22.306078 15763 mvcc.cc:205] Tried to move back new op lower bound from 7316096869535477760 to 7316096869291573248. Current Snapshot: MvccSnapshot[applied={T|T < 7316096869535477760}]
I20260808 02:34:22.324510 15005 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:47840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:34:22.324805 15005 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:47840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:34:22.328809 15005 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a: Sending DeleteTablet for 3 replicas of tablet c0b2571b12f142fd9ee243556f3f9516
I20260808 02:34:22.330093 15411 tablet_service.cc:1514] Processing DeleteTablet for tablet c0b2571b12f142fd9ee243556f3f9516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:34:22 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:44886
I20260808 02:34:22.330134 15624 tablet_service.cc:1514] Processing DeleteTablet for tablet c0b2571b12f142fd9ee243556f3f9516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:34:22 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:57702
I20260808 02:34:22.331043 15774 tablet_replica.cc:330] T c0b2571b12f142fd9ee243556f3f9516 P ff42a9e1dabf4317bf1873613119da2e: stopping tablet replica
I20260808 02:34:22.331161 15180 tablet_service.cc:1514] Processing DeleteTablet for tablet c0b2571b12f142fd9ee243556f3f9516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:34:22 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:51036
I20260808 02:34:22.331674 15774 raft_consensus.cc:2229] T c0b2571b12f142fd9ee243556f3f9516 P ff42a9e1dabf4317bf1873613119da2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:34:22.332291 15774 raft_consensus.cc:2258] T c0b2571b12f142fd9ee243556f3f9516 P ff42a9e1dabf4317bf1873613119da2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:34:22.333065 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 15062
I20260808 02:34:22.338975 15777 tablet_replica.cc:330] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: stopping tablet replica
I20260808 02:34:22.339612 15777 raft_consensus.cc:2229] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:34:22.342219 15777 raft_consensus.cc:2258] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:34:22.343463 15774 ts_tablet_manager.cc:1905] T c0b2571b12f142fd9ee243556f3f9516 P ff42a9e1dabf4317bf1873613119da2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:34:22.344992 15777 ts_tablet_manager.cc:1905] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:34:22.349135 15776 tablet_replica.cc:330] T c0b2571b12f142fd9ee243556f3f9516 P b7ebd0d20bbc485ba0dd4eb23e98dd9e: stopping tablet replica
I20260808 02:34:22.349627 15776 raft_consensus.cc:2229] T c0b2571b12f142fd9ee243556f3f9516 P b7ebd0d20bbc485ba0dd4eb23e98dd9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:34:22.350176 15776 raft_consensus.cc:2258] T c0b2571b12f142fd9ee243556f3f9516 P b7ebd0d20bbc485ba0dd4eb23e98dd9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:34:22.352377 15776 ts_tablet_manager.cc:1905] T c0b2571b12f142fd9ee243556f3f9516 P b7ebd0d20bbc485ba0dd4eb23e98dd9e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:34:22.355489 15741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:22.334030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39820 (local address 127.24.116.193:44737)
0808 02:34:22.334209 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:22.334215 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:22.334353 (+ 138us) server_negotiation.cc:407] Connection header received
0808 02:34:22.334540 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:22.334547 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:22.334648 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:22.334776 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:22.336662 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:22.338378 (+ 1716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:22.340733 (+ 2355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:22.341722 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:22.341934 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:22.345692 (+ 3758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:22.345709 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:22.345731 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:22.345791 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:22.350618 (+ 4827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:22.351544 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:22.351552 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:22.351559 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:22.351720 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:22.352175 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:22.352180 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:22.352183 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:22.352743 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:22.353106 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:22.353441 (+ 335us) server_negotiation.cc:299] Negotiation successful
0808 02:34:22.355084 (+ 1643us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 02:34:22.356514 15282 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:22.358552 15774 ts_tablet_manager.cc:1918] T c0b2571b12f142fd9ee243556f3f9516 P ff42a9e1dabf4317bf1873613119da2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:34:22.358762 15774 log.cc:1196] T c0b2571b12f142fd9ee243556f3f9516 P ff42a9e1dabf4317bf1873613119da2e: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/c0b2571b12f142fd9ee243556f3f9516
I20260808 02:34:22.359488 15774 ts_tablet_manager.cc:1939] T c0b2571b12f142fd9ee243556f3f9516 P ff42a9e1dabf4317bf1873613119da2e: Deleting consensus metadata
I20260808 02:34:22.359941 15776 ts_tablet_manager.cc:1918] T c0b2571b12f142fd9ee243556f3f9516 P b7ebd0d20bbc485ba0dd4eb23e98dd9e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:34:22.360110 15776 log.cc:1196] T c0b2571b12f142fd9ee243556f3f9516 P b7ebd0d20bbc485ba0dd4eb23e98dd9e: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/c0b2571b12f142fd9ee243556f3f9516
I20260808 02:34:22.360716 15776 ts_tablet_manager.cc:1939] T c0b2571b12f142fd9ee243556f3f9516 P b7ebd0d20bbc485ba0dd4eb23e98dd9e: Deleting consensus metadata
I20260808 02:34:22.362025 14987 catalog_manager.cc:4841] TS ff42a9e1dabf4317bf1873613119da2e (127.24.116.194:38881): tablet c0b2571b12f142fd9ee243556f3f9516 (table test-table [id=f01c096da1fd4030a3bfd2c0ba6626d2]) successfully deleted
I20260808 02:34:22.362288 14986 catalog_manager.cc:4841] TS b7ebd0d20bbc485ba0dd4eb23e98dd9e (127.24.116.195:33309): tablet c0b2571b12f142fd9ee243556f3f9516 (table test-table [id=f01c096da1fd4030a3bfd2c0ba6626d2]) successfully deleted
I20260808 02:34:22.463243 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 15062
W20260808 02:34:22.492156 14986 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.116.193:44737 (error 108)
I20260808 02:34:22.492503 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 15301
I20260808 02:34:22.494320 15780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:22.493576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:44737 (local address 127.0.0.1:39824)
0808 02:34:22.494050 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:22.494155 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.193:44737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":254,"threads_started":1}
W20260808 02:34:22.494643 14986 catalog_manager.cc:4584] TS 12ef8ba2ffee4ebda4fde4fd0dd824c0 (127.24.116.193:44737): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c0b2571b12f142fd9ee243556f3f9516: Network error: Client connection negotiation failed: client connection to 127.24.116.193:44737: connect: Connection refused (error 111)
I20260808 02:34:22.508067 15738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:22.493570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54800 (local address 127.24.116.194:38881)
0808 02:34:22.493780 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:22.493787 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:22.493810 (+ 23us) server_negotiation.cc:407] Connection header received
0808 02:34:22.494036 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:22.494042 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:22.494138 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:22.494285 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:22.495822 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:22.496771 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:22.498254 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:22.498715 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:22.498867 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:22.501820 (+ 2953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:22.501835 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:22.501851 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:22.501885 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:22.504976 (+ 3091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:22.505763 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:22.505772 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:22.505774 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:22.505908 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:22.506333 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:22.506341 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:22.506344 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:22.506753 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:22.507080 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:22.507438 (+ 358us) server_negotiation.cc:299] Negotiation successful
0808 02:34:22.507687 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 02:34:22.509012 15517 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:22.548564 15780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:22.548020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:44737 (local address 127.0.0.1:39830)
0808 02:34:22.548256 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:22.548400 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.193:44737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260808 02:34:22.549845 15780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:22.549373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:44737 (local address 127.0.0.1:39840)
0808 02:34:22.549551 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:22.549633 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.193:44737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260808 02:34:22.600359 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 15301
I20260808 02:34:22.610522 15780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:22.609909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:44737 (local address 127.0.0.1:39854)
0808 02:34:22.610200 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:22.610301 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.193:44737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146}
I20260808 02:34:22.612262 15780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:22.611566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:44737 (local address 127.0.0.1:39860)
0808 02:34:22.611828 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:22.611969 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.193:44737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 02:34:22.633311 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 15529
I20260808 02:34:22.648252 15737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:22.634251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40910 (local address 127.24.116.195:33309)
0808 02:34:22.634469 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:22.634474 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:22.634495 (+ 21us) server_negotiation.cc:407] Connection header received
0808 02:34:22.634638 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:22.634643 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:22.634710 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:22.634796 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:22.636579 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:22.637359 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:22.639066 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:22.639505 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:22.639605 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:22.642600 (+ 2995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:22.642617 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:22.642634 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:22.642676 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:22.645592 (+ 2916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:22.646310 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:22.646319 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:22.646321 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:22.646489 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:22.646830 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:22.646833 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:22.646835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:22.647231 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:22.647470 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:22.647705 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 02:34:22.647871 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 02:34:22.648976 15715 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:22.693306 15780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:22.692739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:44737 (local address 127.0.0.1:39868)
0808 02:34:22.692993 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:22.693117 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.193:44737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260808 02:34:22.694476 15780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:22.693983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:44737 (local address 127.0.0.1:39872)
0808 02:34:22.694209 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:22.694299 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.193:44737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
I20260808 02:34:22.739620 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 15529
I20260808 02:34:22.768234 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 14960
I20260808 02:34:22.769695 15050 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:22.885422 15780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:22.883978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:44737 (local address 127.0.0.1:39882)
0808 02:34:22.884816 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:22.885119 (+ 303us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.193:44737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":537}
I20260808 02:34:22.885753 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 14960
I20260808 02:34:22.917402 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:40999
--webserver_interface=127.24.116.254
--webserver_port=33189
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:34351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:40999
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:34:23.265618 15787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:23.265935 15787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:23.266099 15787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:23.273267 15787 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:34:23.273372 15787 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:23.273460 15787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:23.273571 15787 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:34:23.273653 15787 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:34:23.283468 15787 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:34351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:40999
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:40999
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=33189
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:23.284773 15787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:23.286051 15787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:23.297498 15796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:23.297427 15792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:23.297806 15794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:23.298702 15787 server_base.cc:1034] running on GCE node
I20260808 02:34:23.299520 15787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:23.300907 15787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:23.302117 15787 hybrid_clock.cc:648] HybridClock initialized: now 1786156463302065 us; error 36 us; skew 500 ppm
I20260808 02:34:23.302465 15787 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:23 dist-test-slave-45dx krb5kdc[14125](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156463, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:23.306033 15787 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:34:23.307575 15787 webserver.cc:460] Webserver started at http://127.24.116.254:33189/ using document root <none> and password file <none>
I20260808 02:34:23.308280 15787 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:23.308488 15787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:34:23.313853 15787 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 02:34:23.316781 15813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:23.318085 15787 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 02:34:23.318287 15787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "2b8132c78e754d6d85edfa6cb7dd576a"
format_stamp: "Formatted at 2026-08-08 02:34:17 on dist-test-slave-45dx"
server_key: "2de4410fa74cc18ca512e4fa75f090f6"
server_key_iv: "b12ca95cc73cb83c4357c7e4f34b7957"
server_key_version: "encryptionkey@0"
I20260808 02:34:23.319319 15787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:23.336414 15787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:23.340667 15787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:23.340979 15787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:23.360854 15787 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:40999
I20260808 02:34:23.360874 15894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:40999 every 8 connection(s)
I20260808 02:34:23.362403 15787 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:34:23.366556 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 15787
I20260808 02:34:23.367427 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:44737
--local_ip_for_outbound_sockets=127.24.116.193
--tserver_master_addrs=127.24.116.254:40999
--webserver_port=39863
--webserver_interface=127.24.116.193
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:34351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:34:23.369520 15895 sys_catalog.cc:263] Verifying existing consensus state
I20260808 02:34:23.372893 15895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a: Bootstrap starting.
I20260808 02:34:23.394935 15895 log.cc:824] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a: Log is configured to *not* fsync() on all Append() calls
I20260808 02:34:23.411726 15895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 02:34:23.412384 15895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a: Bootstrap complete.
I20260808 02:34:23.421804 15895 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8132c78e754d6d85edfa6cb7dd576a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40999 } }
I20260808 02:34:23.422845 15895 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b8132c78e754d6d85edfa6cb7dd576a, State: Initialized, Role: FOLLOWER
I20260808 02:34:23.423547 15895 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8132c78e754d6d85edfa6cb7dd576a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40999 } }
I20260808 02:34:23.423811 15895 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:34:23.423940 15895 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:34:23.424182 15895 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 2 FOLLOWER]: Advancing to term 3
I20260808 02:34:23.428644 15895 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8132c78e754d6d85edfa6cb7dd576a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40999 } }
I20260808 02:34:23.429180 15895 leader_election.cc:302] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2b8132c78e754d6d85edfa6cb7dd576a; no voters:
I20260808 02:34:23.429891 15895 leader_election.cc:288] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 02:34:23.430028 15903 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 3 FOLLOWER]: Leader election won for term 3
I20260808 02:34:23.431315 15903 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [term 3 LEADER]: Becoming Leader. State: Replica: 2b8132c78e754d6d85edfa6cb7dd576a, State: Running, Role: LEADER
I20260808 02:34:23.431895 15903 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8132c78e754d6d85edfa6cb7dd576a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40999 } }
I20260808 02:34:23.432220 15895 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:34:23.434665 15904 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "2b8132c78e754d6d85edfa6cb7dd576a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8132c78e754d6d85edfa6cb7dd576a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40999 } } }
I20260808 02:34:23.435273 15904 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [sys.catalog]: This master's current role is: LEADER
I20260808 02:34:23.435842 15905 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b8132c78e754d6d85edfa6cb7dd576a. Latest consensus state: current_term: 3 leader_uuid: "2b8132c78e754d6d85edfa6cb7dd576a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8132c78e754d6d85edfa6cb7dd576a" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40999 } } }
I20260808 02:34:23.436163 15905 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b8132c78e754d6d85edfa6cb7dd576a [sys.catalog]: This master's current role is: LEADER
I20260808 02:34:23.443063 15913 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:34:23.452616 15913 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:34:23.454156 15913 catalog_manager.cc:1259] Loaded cluster ID: 39253cc6a1084f4dba63b050417cbc7e
I20260808 02:34:23.454352 15913 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 02:34:23.457047 15913 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f8a4902b9ad google::LogMessage::Fail() at ??:0
@ 0x7f8a4902e88a google::LogMessage::SendToLog() at ??:0
@ 0x7f8a4902b4de google::LogMessage::Flush() at ??:0
@ 0x7f8a4902ca19 google::LogMessageFatal::~LogMessageFatal() at ??:0
I20260808 02:34:23.472554 15928 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7f8a5ea62512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f8a5ea5f976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f8a5eae7610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f8a5eae7439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f8a4bc77345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f8a4bc7a91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f8a4bc7a799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f8a4bc55eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f8a4ef2f6db start_thread at ??:0
@ 0x7f8a47ec561f clone at ??:0
W20260808 02:34:23.763154 15900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:23.763501 15900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:23.763736 15900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:23.771180 15900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:23.771349 15900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:23.771543 15900 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:34:23.782455 15900 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:34351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:44737
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=39863
--tserver_master_addrs=127.24.116.254:40999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:23.783921 15900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:23.785372 15900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:23.798885 15953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:23.798929 15954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:23.798929 15957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:23.800017 15900 server_base.cc:1034] running on GCE node
I20260808 02:34:23.800751 15900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:23.801754 15900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:23.802997 15900 hybrid_clock.cc:648] HybridClock initialized: now 1786156463802942 us; error 47 us; skew 500 ppm
I20260808 02:34:23.803347 15900 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:23 dist-test-slave-45dx krb5kdc[14125](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156463, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:23.806660 15900 init.cc:377] Logged in from keytab as kudu/127.24.116.193@KRBTEST.COM (short username kudu)
I20260808 02:34:23.808120 15900 webserver.cc:460] Webserver started at http://127.24.116.193:39863/ using document root <none> and password file <none>
I20260808 02:34:23.808940 15900 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:23.809114 15900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:34:23.814580 15900 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 02:34:23.817653 15965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:23.819074 15900 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:34:23.819264 15900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "12ef8ba2ffee4ebda4fde4fd0dd824c0"
format_stamp: "Formatted at 2026-08-08 02:34:17 on dist-test-slave-45dx"
server_key: "fc5597f3dd5cf3ae132e8c5972086a55"
server_key_iv: "15f17ed78f0dfeed285388b4613cef90"
server_key_version: "encryptionkey@0"
I20260808 02:34:23.820367 15900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:23.839587 15900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:23.844095 15900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:23.844462 15900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:23.845527 15900 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:34:23.847430 15978 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260808 02:34:23.853032 15978 ts_tablet_manager.cc:1852] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260808 02:34:23.854019 15978 ts_tablet_manager.cc:1905] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:34:23.861749 15978 ts_tablet_manager.cc:1918] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:34:23.861976 15978 log.cc:1196] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/c0b2571b12f142fd9ee243556f3f9516
I20260808 02:34:23.862497 15978 ts_tablet_manager.cc:1939] T c0b2571b12f142fd9ee243556f3f9516 P 12ef8ba2ffee4ebda4fde4fd0dd824c0: Deleting consensus metadata
I20260808 02:34:23.862937 15900 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260808 02:34:23.863098 15900 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.016s user 0.001s sys 0.000s
I20260808 02:34:23.863265 15900 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:34:23.863368 15900 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:23.899873 15900 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:44737
I20260808 02:34:23.899933 16136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:44737 every 8 connection(s)
I20260808 02:34:23.901298 15900 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:34:23.906306 16140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:23.904430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.193:55337)
0808 02:34:23.905183 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:23.905447 (+ 264us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":298,"threads_started":1}
I20260808 02:34:23.906853 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 15900
W20260808 02:34:23.907091 16138 heartbeater.cc:644] Failed to heartbeat to 127.24.116.254:40999 (0 consecutive failures): Network error: Failed to ping master at 127.24.116.254:40999: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
I20260808 02:34:23.907668 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:38881
--local_ip_for_outbound_sockets=127.24.116.194
--tserver_master_addrs=127.24.116.254:40999
--webserver_port=37025
--webserver_interface=127.24.116.194
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:34351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:34:23.908043 16140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:23.907687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.193:54587)
0808 02:34:23.907848 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:23.907935 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 02:34:23.909003 16140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:23.908627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.193:51149)
0808 02:34:23.908772 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:23.908872 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 02:34:23.909299 16138 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 02:34:24.255144 16141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:24.255435 16141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:24.255622 16141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:24.265353 16141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:24.265553 16141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:24.265749 16141 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:34:24.276907 16141 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:34351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:38881
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=37025
--tserver_master_addrs=127.24.116.254:40999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:24.278293 16141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:24.279613 16141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:24.293370 16155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:24.293404 16152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:24.293594 16151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:24.294256 16141 server_base.cc:1034] running on GCE node
I20260808 02:34:24.294930 16141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:24.295873 16141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:24.297111 16141 hybrid_clock.cc:648] HybridClock initialized: now 1786156464297059 us; error 66 us; skew 500 ppm
I20260808 02:34:24.297502 16141 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:24 dist-test-slave-45dx krb5kdc[14125](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156464, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:24.300675 16141 init.cc:377] Logged in from keytab as kudu/127.24.116.194@KRBTEST.COM (short username kudu)
I20260808 02:34:24.302145 16141 webserver.cc:460] Webserver started at http://127.24.116.194:37025/ using document root <none> and password file <none>
I20260808 02:34:24.302839 16141 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:24.302989 16141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:34:24.308230 16141 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260808 02:34:24.310945 16164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:24.312649 16141 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 02:34:24.312877 16141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "ff42a9e1dabf4317bf1873613119da2e"
format_stamp: "Formatted at 2026-08-08 02:34:18 on dist-test-slave-45dx"
server_key: "38c9a7a06d47e9e1e666fe50c3f64f97"
server_key_iv: "34096fb925512e2af2b50f72444df562"
server_key_version: "encryptionkey@0"
I20260808 02:34:24.313995 16141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:24.338461 16141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:24.342841 16141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:24.343138 16141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:24.344183 16141 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:34:24.345650 16141 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:34:24.345803 16141 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:24.345933 16141 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:34:24.346024 16141 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:24.381868 16141 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:38881
I20260808 02:34:24.382026 16333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:38881 every 8 connection(s)
I20260808 02:34:24.383435 16141 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:34:24.388837 16336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:24.386499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.194:40199)
0808 02:34:24.387500 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:24.387768 (+ 268us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":732,"thread_start_us":578,"threads_started":1}
I20260808 02:34:24.389571 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 16141
W20260808 02:34:24.389609 16334 heartbeater.cc:644] Failed to heartbeat to 127.24.116.254:40999 (0 consecutive failures): Network error: Failed to ping master at 127.24.116.254:40999: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
I20260808 02:34:24.390365 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:33309
--local_ip_for_outbound_sockets=127.24.116.195
--tserver_master_addrs=127.24.116.254:40999
--webserver_port=33665
--webserver_interface=127.24.116.195
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:34351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:34:24.390601 16336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:24.390217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.194:36671)
0808 02:34:24.390378 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:24.390449 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 02:34:24.391599 16336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:24.391197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.194:59023)
0808 02:34:24.391394 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:24.391475 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260808 02:34:24.391875 16334 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 02:34:24.749006 16337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:24.749289 16337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:24.749387 16337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:24.756857 16337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:24.756975 16337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:24.757089 16337 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:34:24.767284 16337 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:34351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:33309
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=33665
--tserver_master_addrs=127.24.116.254:40999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:24.768613 16337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:24.769955 16337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:24.783512 16348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:24.783537 16349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:24.783432 16352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:24.784154 16337 server_base.cc:1034] running on GCE node
I20260808 02:34:24.784852 16337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:24.785816 16337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:24.787060 16337 hybrid_clock.cc:648] HybridClock initialized: now 1786156464787010 us; error 44 us; skew 500 ppm
I20260808 02:34:24.787400 16337 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:24 dist-test-slave-45dx krb5kdc[14125](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156464, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:24.790678 16337 init.cc:377] Logged in from keytab as kudu/127.24.116.195@KRBTEST.COM (short username kudu)
I20260808 02:34:24.792254 16337 webserver.cc:460] Webserver started at http://127.24.116.195:33665/ using document root <none> and password file <none>
I20260808 02:34:24.793032 16337 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:24.793191 16337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:34:24.798878 16337 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20260808 02:34:24.801692 16363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:24.803010 16337 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:34:24.803228 16337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "b7ebd0d20bbc485ba0dd4eb23e98dd9e"
format_stamp: "Formatted at 2026-08-08 02:34:18 on dist-test-slave-45dx"
server_key: "f842be762b60d7f9e4cdfa354f96732d"
server_key_iv: "7868d89305f5898995ab48e465d8144f"
server_key_version: "encryptionkey@0"
I20260808 02:34:24.804203 16337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:24.820281 16337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:24.824694 16337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:24.824987 16337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:24.826027 16337 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:34:24.827384 16337 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:34:24.827512 16337 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:24.827644 16337 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:34:24.827739 16337 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:24.863402 16337 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:33309
I20260808 02:34:24.863545 16528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:33309 every 8 connection(s)
I20260808 02:34:24.864955 16337 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:34:24.869947 16531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:24.868061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.195:45493)
0808 02:34:24.868847 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:24.869064 (+ 217us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":332,"threads_started":1}
W20260808 02:34:24.870594 16529 heartbeater.cc:644] Failed to heartbeat to 127.24.116.254:40999 (0 consecutive failures): Network error: Failed to ping master at 127.24.116.254:40999: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
I20260808 02:34:24.871404 16531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:24.871072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.195:59961)
0808 02:34:24.871223 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:24.871294 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 02:34:24.872275 16531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:24.871974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.195:49159)
0808 02:34:24.872095 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:24.872167 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 02:34:24.872579 16529 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 02:34:24.873956 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 16337
I20260808 02:34:24.910537 16533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:24.909773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.193:35367)
0808 02:34:24.910210 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:24.910296 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":219,"threads_started":1}
I20260808 02:34:25.393172 16535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:25.392443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.194:43251)
0808 02:34:25.392864 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:25.392989 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":197,"threads_started":1}
I20260808 02:34:25.874014 16536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:25.873156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.195:38841)
0808 02:34:25.873646 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:25.873775 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":256,"threads_started":1}
I20260808 02:34:25.912369 16538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:25.911534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.193:38097)
0808 02:34:25.912000 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:25.912151 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":236,"threads_started":1}
I20260808 02:34:26.394793 16539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:26.394029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.194:59835)
0808 02:34:26.394534 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:26.394616 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":258,"threads_started":1}
I20260808 02:34:26.875749 16541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:26.875061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.195:36179)
0808 02:34:26.875501 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:26.875582 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":220,"threads_started":1}
I20260808 02:34:26.914137 16543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:26.913351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.193:33927)
0808 02:34:26.913858 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:26.913951 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":267,"threads_started":1}
I20260808 02:34:27.396811 16544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:27.395753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.194:54703)
0808 02:34:27.396486 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:27.396574 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":611,"thread_start_us":458,"threads_started":1}
I20260808 02:34:27.877568 16546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:27.876807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.195:37589)
0808 02:34:27.877280 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:27.877388 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":269,"threads_started":1}
I20260808 02:34:27.915746 16547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:27.915009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.193:57329)
0808 02:34:27.915496 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:27.915580 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":254,"threads_started":1}
I20260808 02:34:28.398633 16550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:28.397814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.194:47283)
0808 02:34:28.398345 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:28.398434 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":285,"threads_started":1}
I20260808 02:34:28.879278 16552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:28.878513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.195:52727)
0808 02:34:28.878983 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:28.879073 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":238,"threads_started":1}
I20260808 02:34:28.917527 16554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:28.916778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.193:33553)
0808 02:34:28.917248 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:28.917329 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":253,"threads_started":1}
I20260808 02:34:29.400399 16556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:29.399604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.194:53737)
0808 02:34:29.400065 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:29.400149 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":248,"threads_started":1}
I20260808 02:34:29.880996 16558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:29.880214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.195:52657)
0808 02:34:29.880737 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:29.880819 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":302,"threads_started":1}
I20260808 02:34:29.919312 16559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:29.918533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.193:54535)
0808 02:34:29.919058 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:29.919142 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":276,"threads_started":1}
I20260808 02:34:30.402104 16560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:30.401331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.194:44249)
0808 02:34:30.401847 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:30.401938 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":289,"threads_started":1}
I20260808 02:34:30.882783 16561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:30.881992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.195:42875)
0808 02:34:30.882505 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:30.882599 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":273,"threads_started":1}
I20260808 02:34:30.921335 16562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:30.920226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.193:60247)
0808 02:34:30.920862 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:30.921017 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":264,"threads_started":1}
I20260808 02:34:31.403967 16566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:31.403083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.194:58595)
0808 02:34:31.403614 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:31.403711 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":239,"threads_started":1}
I20260808 02:34:31.884804 16568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:31.883838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.195:34849)
0808 02:34:31.884449 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:31.884536 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":290,"threads_started":1}
I20260808 02:34:31.923022 16569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:31.922311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.193:57733)
0808 02:34:31.922745 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:31.922829 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":232,"threads_started":1}
I20260808 02:34:32.405994 16570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:32.404990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.194:56533)
0808 02:34:32.405627 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:32.405739 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":375,"threads_started":1}
I20260808 02:34:32.886566 16571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:32.885816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.195:58015)
0808 02:34:32.886282 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:32.886394 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":251,"threads_started":1}
I20260808 02:34:32.924774 16573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:32.923959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.193:46569)
0808 02:34:32.924496 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:32.924596 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":234,"threads_started":1}
I20260808 02:34:33.407719 16574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:33.406874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.194:41433)
0808 02:34:33.407442 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:33.407525 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":325,"threads_started":1}
I20260808 02:34:33.888466 16575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:33.887590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.195:37825)
0808 02:34:33.888097 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:33.888183 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":262,"threads_started":1}
I20260808 02:34:33.926462 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:33.925703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.193:39015)
0808 02:34:33.926158 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:33.926283 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":251,"threads_started":1}
I20260808 02:34:34.409500 16577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:34.408780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.194:53011)
0808 02:34:34.409241 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:34.409324 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":238,"threads_started":1}
I20260808 02:34:34.890162 16578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:34.889430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.195:43043)
0808 02:34:34.889904 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:34.889991 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":240,"threads_started":1}
I20260808 02:34:34.928138 16579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:34.927353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.193:41511)
0808 02:34:34.927841 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:34.927936 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":265,"threads_started":1}
I20260808 02:34:35.411239 16580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:35.410490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.194:57461)
0808 02:34:35.410960 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:35.411045 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":223,"threads_started":1}
I20260808 02:34:35.892184 16581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:35.891242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.195:41197)
0808 02:34:35.891853 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:35.891966 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":323,"threads_started":1}
I20260808 02:34:35.929788 16584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:35.929084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.193:41037)
0808 02:34:35.929542 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:35.929627 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":240,"threads_started":1}
I20260808 02:34:36.413183 16585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:36.412227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.194:46971)
0808 02:34:36.412836 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:36.412942 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":358,"threads_started":1}
I20260808 02:34:36.894066 16587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:36.893185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.195:41509)
0808 02:34:36.893789 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:36.893897 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":279,"threads_started":1}
I20260808 02:34:36.931479 16588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:36.930677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.193:52025)
0808 02:34:36.931171 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:36.931276 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":272,"threads_started":1}
I20260808 02:34:37.415104 16589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:37.414232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.194:40899)
0808 02:34:37.414799 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:37.414908 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":325,"threads_started":1}
I20260808 02:34:37.895912 16590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:37.895109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.195:55031)
0808 02:34:37.895594 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:37.895688 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":247,"threads_started":1}
I20260808 02:34:37.933429 16591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:37.932516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.193:54543)
0808 02:34:37.933107 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:37.933201 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":320,"threads_started":1}
I20260808 02:34:38.416776 16593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:38.415989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.194:36043)
0808 02:34:38.416494 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:38.416579 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":230,"threads_started":1}
I20260808 02:34:38.897771 16595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:38.896945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.195:44521)
0808 02:34:38.897471 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:38.897568 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":257,"threads_started":1}
I20260808 02:34:38.935700 16596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:38.934718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.193:48367)
0808 02:34:38.935334 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:38.935454 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":306,"threads_started":1}
I20260808 02:34:39.419124 16597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:39.418202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.194:34905)
0808 02:34:39.418803 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:39.418943 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":310,"threads_started":1}
I20260808 02:34:39.879288 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 15900
I20260808 02:34:39.899922 16601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:39.899058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40999 (local address 127.24.116.195:55349)
0808 02:34:39.899580 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:39.899696 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":308,"threads_started":1}
I20260808 02:34:39.905665 16599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:39.880720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53068 (local address 127.24.116.193:44737)
0808 02:34:39.881414 (+ 694us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:39.881441 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:39.881693 (+ 252us) server_negotiation.cc:407] Connection header received
0808 02:34:39.883823 (+ 2130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:39.883834 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:39.884270 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:39.884659 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:39.886088 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:39.887316 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:39.888667 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:39.889314 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:39.889469 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:39.898208 (+ 8739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:39.898218 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:39.898236 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:39.898289 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:39.902024 (+ 3735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:39.902857 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:39.902865 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:39.902875 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:39.903056 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:39.903499 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:39.903504 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:39.903506 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:39.904101 (+ 595us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:39.904468 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:39.904932 (+ 464us) server_negotiation.cc:299] Negotiation successful
0808 02:34:39.905364 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":346,"threads_started":1}
I20260808 02:34:39.907084 16130 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:39.997174 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 15900
I20260808 02:34:40.025894 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 16141
I20260808 02:34:40.043526 16605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:40.027027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49432 (local address 127.24.116.194:38881)
0808 02:34:40.027541 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:40.027556 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:40.027596 (+ 40us) server_negotiation.cc:407] Connection header received
0808 02:34:40.029207 (+ 1611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:40.029216 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:40.029633 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:40.029921 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:40.031259 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:40.032557 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:40.033803 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:40.034471 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:40.034603 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:40.037471 (+ 2868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:40.037479 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:40.037496 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:40.037541 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:40.040507 (+ 2966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:40.041193 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:40.041199 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:40.041206 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:40.041367 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:40.041696 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:40.041700 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:40.041702 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:40.042234 (+ 532us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:40.042464 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:40.042867 (+ 403us) server_negotiation.cc:299] Negotiation successful
0808 02:34:40.043218 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":238,"threads_started":1}
I20260808 02:34:40.045135 16325 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:40.131276 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 16141
I20260808 02:34:40.158034 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 16337
I20260808 02:34:40.176819 16607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:40.159106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39872 (local address 127.24.116.195:33309)
0808 02:34:40.159667 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:40.159681 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:40.159724 (+ 43us) server_negotiation.cc:407] Connection header received
0808 02:34:40.161493 (+ 1769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:40.161504 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:40.161955 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:40.162309 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:40.163840 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:40.165161 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:40.166549 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:40.167236 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:40.167438 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:40.170330 (+ 2892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:40.170337 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:40.170353 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:40.170398 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:40.173291 (+ 2893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:40.174012 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:40.174019 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:40.174025 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:40.174196 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:40.174605 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:40.174610 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:40.174613 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:40.175170 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:40.175505 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:40.175993 (+ 488us) server_negotiation.cc:299] Negotiation successful
0808 02:34:40.176487 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":248,"threads_started":1}
I20260808 02:34:40.178331 16524 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:40.265205 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 16337
2026-08-08T02:34:40Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (25101 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:34:40 dist-test-slave-45dx krb5kdc[16612](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:34:40 dist-test-slave-45dx krb5kdc[16612](info): set up 2 sockets
Aug 08 02:34:40 dist-test-slave-45dx krb5kdc[16612](info): commencing operation
krb5kdc: starting...
W20260808 02:34:41.617655 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.305s user 0.004s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:34:41 dist-test-slave-45dx krb5kdc[16612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:34:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:34:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:34:41.956501 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:35647
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:41277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:35647
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:34:42.340440 16638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:42.340747 16638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:42.340926 16638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:42.348404 16638 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 02:34:42.348508 16638 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 02:34:42.348587 16638 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 02:34:42.348695 16638 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:34:42.348786 16638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:42.348902 16638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:42.348975 16638 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:34:42.349056 16638 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:34:42.359334 16638 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:41277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:35647
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:35647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:42.360854 16638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:42.362270 16638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:42.374579 16643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:42.374593 16644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:42.374647 16648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:42.375459 16638 server_base.cc:1034] running on GCE node
I20260808 02:34:42.376286 16638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:42.377713 16638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:42.378937 16638 hybrid_clock.cc:648] HybridClock initialized: now 1786156482378860 us; error 42 us; skew 500 ppm
I20260808 02:34:42.379273 16638 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:42 dist-test-slave-45dx krb5kdc[16612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156482, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:42.382526 16638 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:34:42.384011 16638 webserver.cc:460] Webserver started at http://127.24.116.254:43591/ using document root <none> and password file <none>
I20260808 02:34:42.384802 16638 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:42.384948 16638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:34:42.385278 16638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:34:42.388255 16638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "052648b3edf8403bbc395426386bfed3"
format_stamp: "Formatted at 2026-08-08 02:34:42 on dist-test-slave-45dx"
server_key: "64892c016eb5b41e099a080950044fb2"
server_key_iv: "39c2688f48fe1dbf3bd8e2a4d25b1758"
server_key_version: "encryptionkey@0"
I20260808 02:34:42.389133 16638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "052648b3edf8403bbc395426386bfed3"
format_stamp: "Formatted at 2026-08-08 02:34:42 on dist-test-slave-45dx"
server_key: "64892c016eb5b41e099a080950044fb2"
server_key_iv: "39c2688f48fe1dbf3bd8e2a4d25b1758"
server_key_version: "encryptionkey@0"
I20260808 02:34:42.394299 16638 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 02:34:42.397962 16660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:42.399310 16638 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 02:34:42.399503 16638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "052648b3edf8403bbc395426386bfed3"
format_stamp: "Formatted at 2026-08-08 02:34:42 on dist-test-slave-45dx"
server_key: "64892c016eb5b41e099a080950044fb2"
server_key_iv: "39c2688f48fe1dbf3bd8e2a4d25b1758"
server_key_version: "encryptionkey@0"
I20260808 02:34:42.399726 16638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:42.424063 16638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:42.428752 16638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:42.429059 16638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:42.449472 16638 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:35647
I20260808 02:34:42.449491 16742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:35647 every 8 connection(s)
I20260808 02:34:42.450902 16638 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:34:42.454506 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 16638
I20260808 02:34:42.454744 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:34:42.454774 16743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:34:42.455425 25043 external_mini_cluster.cc:1428] Setting key 4ea3062b449f9e3423b022237a2e6598
I20260808 02:34:42.471406 16743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3: Bootstrap starting.
Aug 08 02:34:42 dist-test-slave-45dx krb5kdc[16612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:34:42.475353 16743 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3: Neither blocks nor log segments found. Creating new log.
I20260808 02:34:42.477036 16743 log.cc:824] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3: Log is configured to *not* fsync() on all Append() calls
I20260808 02:34:42.480574 16743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3: No bootstrap required, opened a new log
I20260808 02:34:42.483582 16747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:42.457564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44930 (local address 127.24.116.254:35647)
0808 02:34:42.458430 (+ 866us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:42.458441 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:42.458488 (+ 47us) server_negotiation.cc:407] Connection header received
0808 02:34:42.460732 (+ 2244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:42.460765 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:42.461266 (+ 501us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:42.461687 (+ 421us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:42.463979 (+ 2292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:42.465929 (+ 1950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:42.467844 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:42.468887 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:42.469053 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:42.474688 (+ 5635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:42.474700 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:42.474719 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:42.474776 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:42.478817 (+ 4041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:42.479615 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:42.479627 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:42.479635 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:42.479865 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:42.480242 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:42.480247 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:42.480249 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:42.480966 (+ 717us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:42.481314 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:42.481750 (+ 436us) server_negotiation.cc:299] Negotiation successful
0808 02:34:42.482198 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":638,"thread_start_us":416,"threads_started":1}
I20260808 02:34:42.489975 16743 raft_consensus.cc:348] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "052648b3edf8403bbc395426386bfed3" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 35647 } }
I20260808 02:34:42.490322 16743 raft_consensus.cc:374] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:34:42.490404 16743 raft_consensus.cc:729] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 052648b3edf8403bbc395426386bfed3, State: Initialized, Role: FOLLOWER
I20260808 02:34:42.490967 16743 consensus_queue.cc:260] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "052648b3edf8403bbc395426386bfed3" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 35647 } }
I20260808 02:34:42.491183 16743 raft_consensus.cc:388] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:34:42.491279 16743 raft_consensus.cc:482] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:34:42.491400 16743 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:34:42.493626 16743 raft_consensus.cc:504] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "052648b3edf8403bbc395426386bfed3" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 35647 } }
I20260808 02:34:42.494063 16743 leader_election.cc:302] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 052648b3edf8403bbc395426386bfed3; no voters:
I20260808 02:34:42.494634 16743 leader_election.cc:288] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:34:42.494793 16750 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:34:42.496606 16750 raft_consensus.cc:686] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 1 LEADER]: Becoming Leader. State: Replica: 052648b3edf8403bbc395426386bfed3, State: Running, Role: LEADER
I20260808 02:34:42.496846 16743 sys_catalog.cc:564] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:34:42.497221 16750 consensus_queue.cc:237] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "052648b3edf8403bbc395426386bfed3" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 35647 } }
I20260808 02:34:42.500183 16751 sys_catalog.cc:455] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "052648b3edf8403bbc395426386bfed3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "052648b3edf8403bbc395426386bfed3" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 35647 } } }
I20260808 02:34:42.500159 16752 sys_catalog.cc:455] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 052648b3edf8403bbc395426386bfed3. Latest consensus state: current_term: 1 leader_uuid: "052648b3edf8403bbc395426386bfed3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "052648b3edf8403bbc395426386bfed3" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 35647 } } }
I20260808 02:34:42.500640 16751 sys_catalog.cc:458] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [sys.catalog]: This master's current role is: LEADER
I20260808 02:34:42.500638 16752 sys_catalog.cc:458] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [sys.catalog]: This master's current role is: LEADER
I20260808 02:34:42.502462 16760 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:34:42.507280 16760 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:34:42.516081 16760 catalog_manager.cc:1347] Generated new cluster ID: a6dcd7769955443b8d3979cf84c996ee
I20260808 02:34:42.516198 16760 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:34:42.537240 16760 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:34:42.538596 16760 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:34:42.544901 16760 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3: Generated new TSK 0
I20260808 02:34:42.545979 16760 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.116.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
I20260808 02:34:42.624184 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:35647
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:41277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:34:42.978551 16788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:42.978835 16788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:42.978931 16788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:42.986259 16788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:42.986383 16788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:42.986498 16788 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:34:42.996119 16788 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:41277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:35647
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:42.997546 16788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:42.999122 16788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:43.013669 16794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:43.013589 16798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:43.013625 16795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:43.014528 16788 server_base.cc:1034] running on GCE node
I20260808 02:34:43.015161 16788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:43.016156 16788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:43.017390 16788 hybrid_clock.cc:648] HybridClock initialized: now 1786156483017305 us; error 78 us; skew 500 ppm
I20260808 02:34:43.017711 16788 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:43 dist-test-slave-45dx krb5kdc[16612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156483, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:43.020915 16788 init.cc:377] Logged in from keytab as kudu/127.24.116.193@KRBTEST.COM (short username kudu)
I20260808 02:34:43.022428 16788 webserver.cc:460] Webserver started at http://127.24.116.193:45057/ using document root <none> and password file <none>
I20260808 02:34:43.023110 16788 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:43.023262 16788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:34:43.023584 16788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:34:43.026639 16788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "0d03b79e7a1e43e6b54511367d5d258c"
format_stamp: "Formatted at 2026-08-08 02:34:43 on dist-test-slave-45dx"
server_key: "8a5568cf2b3ecc288aa328cf2e3e4f37"
server_key_iv: "55372bfc8c66f8cfd0240e53fdfafe11"
server_key_version: "encryptionkey@0"
I20260808 02:34:43.027426 16788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "0d03b79e7a1e43e6b54511367d5d258c"
format_stamp: "Formatted at 2026-08-08 02:34:43 on dist-test-slave-45dx"
server_key: "8a5568cf2b3ecc288aa328cf2e3e4f37"
server_key_iv: "55372bfc8c66f8cfd0240e53fdfafe11"
server_key_version: "encryptionkey@0"
I20260808 02:34:43.032689 16788 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 02:34:43.036254 16809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:43.037784 16788 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:34:43.037990 16788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "0d03b79e7a1e43e6b54511367d5d258c"
format_stamp: "Formatted at 2026-08-08 02:34:43 on dist-test-slave-45dx"
server_key: "8a5568cf2b3ecc288aa328cf2e3e4f37"
server_key_iv: "55372bfc8c66f8cfd0240e53fdfafe11"
server_key_version: "encryptionkey@0"
I20260808 02:34:43.038225 16788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:43.054841 16788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:43.059407 16788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:43.059736 16788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:43.060846 16788 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:34:43.062320 16788 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:34:43.062433 16788 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:43.062592 16788 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:34:43.062676 16788 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:43.098625 16788 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:45539
I20260808 02:34:43.098685 16985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:45539 every 8 connection(s)
I20260808 02:34:43.099998 16788 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:34:43.107345 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 16788
I20260808 02:34:43.107601 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:34:43.108569 25043 external_mini_cluster.cc:1428] Setting key a07f42e50114e602a08902e50414651d
Aug 08 02:34:43 dist-test-slave-45dx krb5kdc[16612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156483, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:34:43.122496 16989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:43.102675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:47061 (local address 127.24.116.254:35647)
0808 02:34:43.103225 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:43.103231 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:43.104277 (+ 1046us) server_negotiation.cc:407] Connection header received
0808 02:34:43.106134 (+ 1857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:43.106139 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:43.106209 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:43.106327 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:43.107916 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:43.109106 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:43.111238 (+ 2132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:43.111651 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:43.111755 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:43.116266 (+ 4511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:43.116271 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:43.116274 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:43.116353 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:43.119115 (+ 2762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:43.119938 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:43.119944 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:43.119954 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:43.120087 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:43.120627 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:43.120632 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:43.120637 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:43.120923 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:43.121091 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:43.121880 (+ 789us) server_negotiation.cc:299] Negotiation successful
0808 02:34:43.122119 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":261,"threads_started":1}
I20260808 02:34:43.123574 16990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:43.103218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.193:47061)
0808 02:34:43.104088 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:43.104155 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:43.105863 (+ 1708us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:43.106533 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:43.106541 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:43.107073 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:34:43.107716 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:43.107742 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:43.109346 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:43.109350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:43.111069 (+ 1719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:43.111085 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:43.111903 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:43.111912 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:43.112246 (+ 334us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:43.113072 (+ 826us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:34:43.113109 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:34:43.116012 (+ 2903us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:34:43.119287 (+ 3275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:43.119297 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:43.119318 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:43.119799 (+ 481us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:43.120206 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:43.120211 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:43.120215 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:43.120509 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:43.121063 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:34:43.121071 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:34:43.121457 (+ 386us) client_negotiation.cc:769] Sending connection context
0808 02:34:43.121754 (+ 297us) client_negotiation.cc:240] Negotiation successful
0808 02:34:43.122315 (+ 561us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":304,"threads_started":1}
I20260808 02:34:43.125377 16986 heartbeater.cc:347] Connected to a master server at 127.24.116.254:35647
I20260808 02:34:43.125742 16986 heartbeater.cc:464] Registering TS with master...
I20260808 02:34:43.126686 16986 heartbeater.cc:511] Master 127.24.116.254:35647 requested a full tablet report, sending...
I20260808 02:34:43.129266 16688 ts_manager.cc:194] Registered new tserver with Master: 0d03b79e7a1e43e6b54511367d5d258c (127.24.116.193:45539)
I20260808 02:34:43.131625 16688 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.193@KRBTEST.COM'} at 127.24.116.193:47061
WARNING: no policy specified for kudu/127.24.116.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
I20260808 02:34:43.184284 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:35647
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:41277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:34:43.544652 16993 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:43.544984 16993 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:43.545148 16993 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:43.553310 16993 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:43.553440 16993 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:43.553648 16993 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:34:43.563994 16993 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:41277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:35647
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:43.565440 16993 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:43.566817 16993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:34:43.580973 17001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:43.580981 17002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:43.581045 17006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:43.581792 16993 server_base.cc:1034] running on GCE node
I20260808 02:34:43.582393 16993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:43.583369 16993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:43.584568 16993 hybrid_clock.cc:648] HybridClock initialized: now 1786156483584531 us; error 34 us; skew 500 ppm
I20260808 02:34:43.584847 16993 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:43 dist-test-slave-45dx krb5kdc[16612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156483, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:43.588014 16993 init.cc:377] Logged in from keytab as kudu/127.24.116.194@KRBTEST.COM (short username kudu)
I20260808 02:34:43.589519 16993 webserver.cc:460] Webserver started at http://127.24.116.194:42849/ using document root <none> and password file <none>
I20260808 02:34:43.590233 16993 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:43.590385 16993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:34:43.590708 16993 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:34:43.593781 16993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "6aa38a6176104fc88173baa97e5ac8a5"
format_stamp: "Formatted at 2026-08-08 02:34:43 on dist-test-slave-45dx"
server_key: "3717ed2d102faefda7bb263e17c10e51"
server_key_iv: "6c001fc7784987335ba48322a8a00395"
server_key_version: "encryptionkey@0"
I20260808 02:34:43.594599 16993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "6aa38a6176104fc88173baa97e5ac8a5"
format_stamp: "Formatted at 2026-08-08 02:34:43 on dist-test-slave-45dx"
server_key: "3717ed2d102faefda7bb263e17c10e51"
server_key_iv: "6c001fc7784987335ba48322a8a00395"
server_key_version: "encryptionkey@0"
I20260808 02:34:43.600375 16993 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 02:34:43.604089 17018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:43.605719 16993 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 02:34:43.605911 16993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "6aa38a6176104fc88173baa97e5ac8a5"
format_stamp: "Formatted at 2026-08-08 02:34:43 on dist-test-slave-45dx"
server_key: "3717ed2d102faefda7bb263e17c10e51"
server_key_iv: "6c001fc7784987335ba48322a8a00395"
server_key_version: "encryptionkey@0"
I20260808 02:34:43.606149 16993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:43.623981 16993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:43.628660 16993 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:43.628978 16993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:43.629966 16993 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:34:43.631321 16993 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:34:43.631428 16993 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:43.631575 16993 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:34:43.631649 16993 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:43.665854 16993 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:37589
I20260808 02:34:43.665899 17196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:37589 every 8 connection(s)
I20260808 02:34:43.667207 16993 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:34:43.667865 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 16993
I20260808 02:34:43.668107 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:34:43.668790 25043 external_mini_cluster.cc:1428] Setting key 1d3dc7073a0584d78d910c143deb247b
Aug 08 02:34:43 dist-test-slave-45dx krb5kdc[16612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156483, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:34:43.690469 17199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:43.670046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:47737 (local address 127.24.116.254:35647)
0808 02:34:43.672684 (+ 2638us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:43.672690 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:43.672708 (+ 18us) server_negotiation.cc:407] Connection header received
0808 02:34:43.673874 (+ 1166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:43.673883 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:43.673975 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:43.674097 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:43.675544 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:43.676757 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:43.678287 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:43.679024 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:43.679178 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:43.683031 (+ 3853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:43.683039 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:43.683047 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:43.683098 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:43.686738 (+ 3640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:43.687698 (+ 960us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:43.687703 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:43.687705 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:43.687849 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:43.688374 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:43.688382 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:43.688388 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:43.688801 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:43.688965 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:43.689683 (+ 718us) server_negotiation.cc:299] Negotiation successful
0808 02:34:43.689952 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2506,"thread_start_us":2407,"threads_started":1}
I20260808 02:34:43.691120 17200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:43.670774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.194:47737)
0808 02:34:43.671644 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:43.671683 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:43.673599 (+ 1916us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:43.674291 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:43.674299 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:43.674824 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:34:43.675352 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:43.675378 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:43.676916 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:43.676920 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:43.678133 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:43.678145 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:43.679252 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:43.679257 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:43.679476 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:43.680203 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:34:43.680230 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:34:43.682762 (+ 2532us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:34:43.686898 (+ 4136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:43.686910 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:43.686931 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:43.687579 (+ 648us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:43.687964 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:43.687970 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:43.687976 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:43.688229 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:43.688944 (+ 715us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:34:43.688950 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:34:43.689286 (+ 336us) client_negotiation.cc:769] Sending connection context
0808 02:34:43.689529 (+ 243us) client_negotiation.cc:240] Negotiation successful
0808 02:34:43.689931 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":367,"threads_started":1}
I20260808 02:34:43.692698 17197 heartbeater.cc:347] Connected to a master server at 127.24.116.254:35647
I20260808 02:34:43.693040 17197 heartbeater.cc:464] Registering TS with master...
I20260808 02:34:43.693959 17197 heartbeater.cc:511] Master 127.24.116.254:35647 requested a full tablet report, sending...
I20260808 02:34:43.695744 16688 ts_manager.cc:194] Registered new tserver with Master: 6aa38a6176104fc88173baa97e5ac8a5 (127.24.116.194:37589)
I20260808 02:34:43.697144 16688 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.194@KRBTEST.COM'} at 127.24.116.194:47737
WARNING: no policy specified for kudu/127.24.116.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
I20260808 02:34:43.745887 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:35647
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:41277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:34:44.105729 17203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:34:44.106045 17203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:34:44.106209 17203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:34:44.113912 17203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:34:44.114029 17203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:34:44.114228 17203 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:34:44.124374 17203 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:41277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:35647
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:34:44.125811 17203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:34:44.127215 17203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 02:34:44.135854 16986 heartbeater.cc:503] Master 127.24.116.254:35647 was elected leader, sending a full tablet report...
W20260808 02:34:44.141953 17211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:44.141916 17216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:34:44.142004 17214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:34:44.143899 17203 server_base.cc:1034] running on GCE node
I20260808 02:34:44.144613 17203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:34:44.145718 17203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:34:44.146958 17203 hybrid_clock.cc:648] HybridClock initialized: now 1786156484146901 us; error 44 us; skew 500 ppm
I20260808 02:34:44.147301 17203 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:34:44 dist-test-slave-45dx krb5kdc[16612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156484, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:34:44.150698 17203 init.cc:377] Logged in from keytab as kudu/127.24.116.195@KRBTEST.COM (short username kudu)
I20260808 02:34:44.152231 17203 webserver.cc:460] Webserver started at http://127.24.116.195:40011/ using document root <none> and password file <none>
I20260808 02:34:44.153024 17203 fs_manager.cc:359] Metadata directory not provided
I20260808 02:34:44.153177 17203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:34:44.153504 17203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:34:44.156685 17203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "7bdb6f59f2c6414194c2c36c1886367e"
format_stamp: "Formatted at 2026-08-08 02:34:44 on dist-test-slave-45dx"
server_key: "b13a676e2de8ba7e76ed9a6b35aca1d3"
server_key_iv: "84089b71772e1b29e1d239a8684214b1"
server_key_version: "encryptionkey@0"
I20260808 02:34:44.157505 17203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "7bdb6f59f2c6414194c2c36c1886367e"
format_stamp: "Formatted at 2026-08-08 02:34:44 on dist-test-slave-45dx"
server_key: "b13a676e2de8ba7e76ed9a6b35aca1d3"
server_key_iv: "84089b71772e1b29e1d239a8684214b1"
server_key_version: "encryptionkey@0"
I20260808 02:34:44.162904 17203 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 02:34:44.166615 17225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:44.167934 17203 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 02:34:44.168128 17203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "7bdb6f59f2c6414194c2c36c1886367e"
format_stamp: "Formatted at 2026-08-08 02:34:44 on dist-test-slave-45dx"
server_key: "b13a676e2de8ba7e76ed9a6b35aca1d3"
server_key_iv: "84089b71772e1b29e1d239a8684214b1"
server_key_version: "encryptionkey@0"
I20260808 02:34:44.168403 17203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:34:44.180896 17203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:34:44.185225 17203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:34:44.185531 17203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:34:44.186584 17203 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:34:44.188086 17203 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:34:44.188187 17203 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:34:44.188365 17203 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:34:44.188459 17203 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260808 02:34:44.223515 17203 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:46237
I20260808 02:34:44.223578 17406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:46237 every 8 connection(s)
I20260808 02:34:44.224961 17203 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:34:44.227286 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 17203
I20260808 02:34:44.227500 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:34:44.228152 25043 external_mini_cluster.cc:1428] Setting key 9b104d4407c290545cc7b0411f868bf9
Aug 08 02:34:44 dist-test-slave-45dx krb5kdc[16612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156484, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:34:44.246173 17411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:44.227840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:43965 (local address 127.24.116.254:35647)
0808 02:34:44.228396 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:44.228402 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:44.232060 (+ 3658us) server_negotiation.cc:407] Connection header received
0808 02:34:44.232122 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:44.232125 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:44.232187 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:44.232267 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:44.233822 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.234602 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.236197 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.236670 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.236772 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:44.240188 (+ 3416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:44.240192 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:44.240195 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:44.240227 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:44.243174 (+ 2947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:44.244139 (+ 965us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:44.244143 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:44.244146 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:44.244265 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:44.244726 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:44.244729 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:44.244731 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:44.244993 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:44.245106 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:44.245735 (+ 629us) server_negotiation.cc:299] Negotiation successful
0808 02:34:44.245905 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":246,"threads_started":1}
I20260808 02:34:44.247076 17413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:44.228478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.195:43965)
0808 02:34:44.229508 (+ 1030us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:44.229549 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:44.231783 (+ 2234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:44.232555 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:44.232563 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:44.233093 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:34:44.233661 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:44.233678 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.234746 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.234750 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:44.236062 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:44.236074 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.236865 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.236904 (+ 39us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:44.237107 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:44.237752 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:34:44.237774 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:34:44.239995 (+ 2221us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:34:44.243365 (+ 3370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:44.243373 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:44.243389 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:44.243997 (+ 608us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:44.244439 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:34:44.244442 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:34:44.244444 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:34:44.244630 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:34:44.245109 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:34:44.245115 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:34:44.245404 (+ 289us) client_negotiation.cc:769] Sending connection context
0808 02:34:44.245634 (+ 230us) client_negotiation.cc:240] Negotiation successful
0808 02:34:44.245993 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":722,"thread_start_us":373,"threads_started":1}
I20260808 02:34:44.248343 17407 heartbeater.cc:347] Connected to a master server at 127.24.116.254:35647
I20260808 02:34:44.248624 17407 heartbeater.cc:464] Registering TS with master...
I20260808 02:34:44.249296 17407 heartbeater.cc:511] Master 127.24.116.254:35647 requested a full tablet report, sending...
I20260808 02:34:44.250644 16688 ts_manager.cc:194] Registered new tserver with Master: 7bdb6f59f2c6414194c2c36c1886367e (127.24.116.195:46237)
I20260808 02:34:44.251427 16688 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.195@KRBTEST.COM'} at 127.24.116.195:43965
I20260808 02:34:44.256186 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:34:44.276007 17411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:44.260832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44934 (local address 127.24.116.254:35647)
0808 02:34:44.261051 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:44.261059 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:44.261522 (+ 463us) server_negotiation.cc:407] Connection header received
0808 02:34:44.261740 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:44.261745 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:44.261833 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:44.261951 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:44.264291 (+ 2340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.265465 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.267341 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.267959 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.268098 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:44.270651 (+ 2553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:44.270656 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:44.270659 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:44.270691 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:44.273413 (+ 2722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:44.274040 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:44.274044 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:44.274047 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:44.274166 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:44.274561 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:44.274565 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:44.274566 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:44.274904 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:44.275097 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:44.275587 (+ 490us) server_negotiation.cc:299] Negotiation successful
0808 02:34:44.275758 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 02:34:44.280476 16688 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44934:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:34:44.287314 16688 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:34:44.324922 17431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:44.299623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59738 (local address 127.24.116.193:45539)
0808 02:34:44.315106 (+ 15483us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:44.315116 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:44.315147 (+ 31us) server_negotiation.cc:407] Connection header received
0808 02:34:44.315256 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:44.315263 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:44.315534 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:44.315753 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:34:44.316981 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.318656 (+ 1675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.321668 (+ 3012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.323294 (+ 1626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.323496 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:44.323666 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:44.324420 (+ 754us) server_negotiation.cc:299] Negotiation successful
0808 02:34:44.324595 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15305,"thread_start_us":16333,"threads_started":1}
I20260808 02:34:44.325012 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:44.299307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:45539 (local address 127.0.0.1:59738)
0808 02:34:44.314114 (+ 14807us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:44.314196 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:44.314476 (+ 280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:44.316253 (+ 1777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:44.316261 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:44.316294 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:34:44.316765 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:44.316779 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.318824 (+ 2045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.318829 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:44.321510 (+ 2681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:44.321521 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.323834 (+ 2313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.323844 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:44.324116 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:44.324173 (+ 57us) client_negotiation.cc:769] Sending connection context
0808 02:34:44.324286 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 02:34:44.324503 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14408,"mutex_wait_us":20,"thread_start_us":15421,"threads_started":1}
I20260808 02:34:44.326896 17435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:44.300232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33896 (local address 127.24.116.194:37589)
0808 02:34:44.316973 (+ 16741us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:44.316982 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:44.317728 (+ 746us) server_negotiation.cc:407] Connection header received
0808 02:34:44.317839 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:44.317846 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:44.318073 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:44.318252 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:34:44.320607 (+ 2355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.322090 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.324704 (+ 2614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.325804 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.325988 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:44.326147 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:44.326402 (+ 255us) server_negotiation.cc:299] Negotiation successful
0808 02:34:44.326562 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16565,"thread_start_us":16448,"threads_started":1}
I20260808 02:34:44.327944 17433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:44.299639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:37589 (local address 127.0.0.1:33896)
0808 02:34:44.317462 (+ 17823us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:44.317483 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:44.317605 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:44.319797 (+ 2192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:44.319802 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:44.319828 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:34:44.320402 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:44.320417 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.322245 (+ 1828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.322250 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:44.324519 (+ 2269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:44.324531 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.325997 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.326004 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:44.326182 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:44.326215 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 02:34:44.326300 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 02:34:44.327448 (+ 1148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17690,"mutex_wait_us":36,"thread_start_us":19960,"threads_started":1}
I20260808 02:34:44.327998 17432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:44.300076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:46237 (local address 127.0.0.1:47172)
0808 02:34:44.319905 (+ 19829us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:44.319920 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:44.320108 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:44.320769 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:44.320774 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:44.320800 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:34:44.321212 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:44.321223 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.323129 (+ 1906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.323135 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:44.324978 (+ 1843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:44.324994 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.327045 (+ 2051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.327051 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:44.327219 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:44.327250 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 02:34:44.327332 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 02:34:44.327448 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19674,"mutex_wait_us":1,"spinlock_wait_cycles":1280,"thread_start_us":17062,"threads_started":1}
I20260808 02:34:44.328660 17437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:44.300818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47172 (local address 127.24.116.195:46237)
0808 02:34:44.319151 (+ 18333us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:44.319163 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:44.320039 (+ 876us) server_negotiation.cc:407] Connection header received
0808 02:34:44.320345 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:44.320356 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:44.320563 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:44.320768 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:34:44.321393 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.322899 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.325182 (+ 2283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.326535 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.326725 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:44.326904 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:44.327933 (+ 1029us) server_negotiation.cc:299] Negotiation successful
0808 02:34:44.328111 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18108,"thread_start_us":18350,"threads_started":1}
I20260808 02:34:44.329699 16890 tablet_service.cc:1467] Processing CreateTablet for tablet 99e7ea6331e744c4a4a8c242ee004b74 (DEFAULT_TABLE table=test-table [id=2a8c03459c384db68b95b89b52ce592d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:34:44.331025 16890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99e7ea6331e744c4a4a8c242ee004b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:34:44.332069 17298 tablet_service.cc:1467] Processing CreateTablet for tablet 99e7ea6331e744c4a4a8c242ee004b74 (DEFAULT_TABLE table=test-table [id=2a8c03459c384db68b95b89b52ce592d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:34:44.332069 17094 tablet_service.cc:1467] Processing CreateTablet for tablet 99e7ea6331e744c4a4a8c242ee004b74 (DEFAULT_TABLE table=test-table [id=2a8c03459c384db68b95b89b52ce592d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:34:44.333469 17094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99e7ea6331e744c4a4a8c242ee004b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:34:44.333469 17298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99e7ea6331e744c4a4a8c242ee004b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:34:44.343624 17438 tablet_bootstrap.cc:492] T 99e7ea6331e744c4a4a8c242ee004b74 P 0d03b79e7a1e43e6b54511367d5d258c: Bootstrap starting.
I20260808 02:34:44.347333 17438 tablet_bootstrap.cc:654] T 99e7ea6331e744c4a4a8c242ee004b74 P 0d03b79e7a1e43e6b54511367d5d258c: Neither blocks nor log segments found. Creating new log.
I20260808 02:34:44.348256 17440 tablet_bootstrap.cc:492] T 99e7ea6331e744c4a4a8c242ee004b74 P 6aa38a6176104fc88173baa97e5ac8a5: Bootstrap starting.
I20260808 02:34:44.348801 17438 log.cc:824] T 99e7ea6331e744c4a4a8c242ee004b74 P 0d03b79e7a1e43e6b54511367d5d258c: Log is configured to *not* fsync() on all Append() calls
I20260808 02:34:44.349141 17441 tablet_bootstrap.cc:492] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e: Bootstrap starting.
I20260808 02:34:44.351701 17438 tablet_bootstrap.cc:492] T 99e7ea6331e744c4a4a8c242ee004b74 P 0d03b79e7a1e43e6b54511367d5d258c: No bootstrap required, opened a new log
I20260808 02:34:44.351989 17438 ts_tablet_manager.cc:1397] T 99e7ea6331e744c4a4a8c242ee004b74 P 0d03b79e7a1e43e6b54511367d5d258c: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260808 02:34:44.352900 17441 tablet_bootstrap.cc:654] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e: Neither blocks nor log segments found. Creating new log.
I20260808 02:34:44.353325 17440 tablet_bootstrap.cc:654] T 99e7ea6331e744c4a4a8c242ee004b74 P 6aa38a6176104fc88173baa97e5ac8a5: Neither blocks nor log segments found. Creating new log.
I20260808 02:34:44.354292 17441 log.cc:824] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e: Log is configured to *not* fsync() on all Append() calls
I20260808 02:34:44.354671 17440 log.cc:824] T 99e7ea6331e744c4a4a8c242ee004b74 P 6aa38a6176104fc88173baa97e5ac8a5: Log is configured to *not* fsync() on all Append() calls
I20260808 02:34:44.357810 17440 tablet_bootstrap.cc:492] T 99e7ea6331e744c4a4a8c242ee004b74 P 6aa38a6176104fc88173baa97e5ac8a5: No bootstrap required, opened a new log
I20260808 02:34:44.358098 17440 ts_tablet_manager.cc:1397] T 99e7ea6331e744c4a4a8c242ee004b74 P 6aa38a6176104fc88173baa97e5ac8a5: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260808 02:34:44.358108 17441 tablet_bootstrap.cc:492] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e: No bootstrap required, opened a new log
I20260808 02:34:44.358389 17441 ts_tablet_manager.cc:1397] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 02:34:44.362491 17438 raft_consensus.cc:348] T 99e7ea6331e744c4a4a8c242ee004b74 P 0d03b79e7a1e43e6b54511367d5d258c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } } peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } }
I20260808 02:34:44.362962 17438 raft_consensus.cc:374] T 99e7ea6331e744c4a4a8c242ee004b74 P 0d03b79e7a1e43e6b54511367d5d258c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:34:44.363065 17438 raft_consensus.cc:729] T 99e7ea6331e744c4a4a8c242ee004b74 P 0d03b79e7a1e43e6b54511367d5d258c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d03b79e7a1e43e6b54511367d5d258c, State: Initialized, Role: FOLLOWER
I20260808 02:34:44.363705 17438 consensus_queue.cc:260] T 99e7ea6331e744c4a4a8c242ee004b74 P 0d03b79e7a1e43e6b54511367d5d258c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } } peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } }
I20260808 02:34:44.366168 17440 raft_consensus.cc:348] T 99e7ea6331e744c4a4a8c242ee004b74 P 6aa38a6176104fc88173baa97e5ac8a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } } peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } }
I20260808 02:34:44.366550 17440 raft_consensus.cc:374] T 99e7ea6331e744c4a4a8c242ee004b74 P 6aa38a6176104fc88173baa97e5ac8a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:34:44.366704 17440 raft_consensus.cc:729] T 99e7ea6331e744c4a4a8c242ee004b74 P 6aa38a6176104fc88173baa97e5ac8a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aa38a6176104fc88173baa97e5ac8a5, State: Initialized, Role: FOLLOWER
I20260808 02:34:44.367522 17438 ts_tablet_manager.cc:1428] T 99e7ea6331e744c4a4a8c242ee004b74 P 0d03b79e7a1e43e6b54511367d5d258c: Time spent starting tablet: real 0.015s user 0.015s sys 0.001s
I20260808 02:34:44.367465 17440 consensus_queue.cc:260] T 99e7ea6331e744c4a4a8c242ee004b74 P 6aa38a6176104fc88173baa97e5ac8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } } peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } }
I20260808 02:34:44.368685 17197 heartbeater.cc:503] Master 127.24.116.254:35647 was elected leader, sending a full tablet report...
I20260808 02:34:44.369385 17440 ts_tablet_manager.cc:1428] T 99e7ea6331e744c4a4a8c242ee004b74 P 6aa38a6176104fc88173baa97e5ac8a5: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20260808 02:34:44.369129 17441 raft_consensus.cc:348] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } } peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } }
I20260808 02:34:44.369676 17441 raft_consensus.cc:374] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:34:44.369798 17441 raft_consensus.cc:729] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bdb6f59f2c6414194c2c36c1886367e, State: Initialized, Role: FOLLOWER
I20260808 02:34:44.370404 17441 consensus_queue.cc:260] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } } peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } }
I20260808 02:34:44.371809 17407 heartbeater.cc:503] Master 127.24.116.254:35647 was elected leader, sending a full tablet report...
I20260808 02:34:44.372514 17441 ts_tablet_manager.cc:1428] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e: Time spent starting tablet: real 0.014s user 0.016s sys 0.000s
W20260808 02:34:44.419476 17198 tablet.cc:2369] T 99e7ea6331e744c4a4a8c242ee004b74 P 6aa38a6176104fc88173baa97e5ac8a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:34:44.467109 17451 raft_consensus.cc:482] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:34:44.467515 17451 raft_consensus.cc:504] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } } peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } }
I20260808 02:34:44.469512 17451 leader_election.cc:288] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d03b79e7a1e43e6b54511367d5d258c (127.24.116.193:45539), 6aa38a6176104fc88173baa97e5ac8a5 (127.24.116.194:37589)
W20260808 02:34:44.476826 17409 tablet.cc:2369] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:34:44.477281 17413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:44.469877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:37589 (local address 127.24.116.195:60717)
0808 02:34:44.470145 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:44.470166 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:44.470293 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:44.470857 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:44.470862 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:44.470893 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:34:44.471112 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:44.471125 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.472419 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.472423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:44.474542 (+ 2119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:44.474561 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.476405 (+ 1844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.476415 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:44.476636 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:44.476682 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 02:34:44.476786 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 02:34:44.476945 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"mutex_wait_us":32}
I20260808 02:34:44.478010 17435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:44.470222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:60717 (local address 127.24.116.194:37589)
0808 02:34:44.470492 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:44.470502 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:44.470528 (+ 26us) server_negotiation.cc:407] Connection header received
0808 02:34:44.470615 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:44.470622 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:44.470700 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:44.470795 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:34:44.471252 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.472265 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.474756 (+ 2491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.476024 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.476194 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:44.476277 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:44.477583 (+ 1306us) server_negotiation.cc:299] Negotiation successful
0808 02:34:44.477732 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 02:34:44.478008 17431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:44.469835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:56885 (local address 127.24.116.193:45539)
0808 02:34:44.470078 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:44.470084 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:44.470980 (+ 896us) server_negotiation.cc:407] Connection header received
0808 02:34:44.471159 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:44.471165 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:44.471248 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:44.471351 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:34:44.471892 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.472775 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.475322 (+ 2547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.476733 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.476898 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:44.476990 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:44.477602 (+ 612us) server_negotiation.cc:299] Negotiation successful
0808 02:34:44.477744 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 02:34:44.478109 17452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:44.469970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:45539 (local address 127.24.116.195:56885)
0808 02:34:44.470858 (+ 888us) negotiation.cc:107] Waiting for socket to connect
0808 02:34:44.470884 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:34:44.471003 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:34:44.471368 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:34:44.471372 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:34:44.471394 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:34:44.471686 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:44.471694 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.472967 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.472972 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:44.475074 (+ 2102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:34:44.475090 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.477185 (+ 2095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.477192 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:34:44.477394 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:44.477436 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 02:34:44.477574 (+ 138us) client_negotiation.cc:240] Negotiation successful
0808 02:34:44.477704 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":746,"mutex_wait_us":140,"thread_start_us":406,"threads_started":1}
I20260808 02:34:44.479074 17126 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e7ea6331e744c4a4a8c242ee004b74" candidate_uuid: "7bdb6f59f2c6414194c2c36c1886367e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aa38a6176104fc88173baa97e5ac8a5" is_pre_election: true
I20260808 02:34:44.479084 16918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e7ea6331e744c4a4a8c242ee004b74" candidate_uuid: "7bdb6f59f2c6414194c2c36c1886367e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d03b79e7a1e43e6b54511367d5d258c" is_pre_election: true
I20260808 02:34:44.479619 16918 raft_consensus.cc:2454] T 99e7ea6331e744c4a4a8c242ee004b74 P 0d03b79e7a1e43e6b54511367d5d258c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bdb6f59f2c6414194c2c36c1886367e in term 0.
I20260808 02:34:44.479619 17126 raft_consensus.cc:2454] T 99e7ea6331e744c4a4a8c242ee004b74 P 6aa38a6176104fc88173baa97e5ac8a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bdb6f59f2c6414194c2c36c1886367e in term 0.
I20260808 02:34:44.480296 17234 leader_election.cc:302] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d03b79e7a1e43e6b54511367d5d258c, 7bdb6f59f2c6414194c2c36c1886367e; no voters:
I20260808 02:34:44.480784 17451 raft_consensus.cc:2781] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:34:44.480958 17451 raft_consensus.cc:482] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:34:44.481086 17451 raft_consensus.cc:3037] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:34:44.483347 17451 raft_consensus.cc:504] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } } peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } }
I20260808 02:34:44.484361 17451 leader_election.cc:288] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e [CANDIDATE]: Term 1 election: Requested vote from peers 0d03b79e7a1e43e6b54511367d5d258c (127.24.116.193:45539), 6aa38a6176104fc88173baa97e5ac8a5 (127.24.116.194:37589)
I20260808 02:34:44.484845 16918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e7ea6331e744c4a4a8c242ee004b74" candidate_uuid: "7bdb6f59f2c6414194c2c36c1886367e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d03b79e7a1e43e6b54511367d5d258c"
I20260808 02:34:44.484900 17126 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e7ea6331e744c4a4a8c242ee004b74" candidate_uuid: "7bdb6f59f2c6414194c2c36c1886367e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aa38a6176104fc88173baa97e5ac8a5"
I20260808 02:34:44.485093 17126 raft_consensus.cc:3037] T 99e7ea6331e744c4a4a8c242ee004b74 P 6aa38a6176104fc88173baa97e5ac8a5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:34:44.485091 16918 raft_consensus.cc:3037] T 99e7ea6331e744c4a4a8c242ee004b74 P 0d03b79e7a1e43e6b54511367d5d258c [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:34:44.487378 17126 raft_consensus.cc:2454] T 99e7ea6331e744c4a4a8c242ee004b74 P 6aa38a6176104fc88173baa97e5ac8a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bdb6f59f2c6414194c2c36c1886367e in term 1.
I20260808 02:34:44.487586 16918 raft_consensus.cc:2454] T 99e7ea6331e744c4a4a8c242ee004b74 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bdb6f59f2c6414194c2c36c1886367e in term 1.
I20260808 02:34:44.487869 17230 leader_election.cc:302] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aa38a6176104fc88173baa97e5ac8a5, 7bdb6f59f2c6414194c2c36c1886367e; no voters:
I20260808 02:34:44.488206 17451 raft_consensus.cc:2781] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:34:44.488765 17451 raft_consensus.cc:686] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e [term 1 LEADER]: Becoming Leader. State: Replica: 7bdb6f59f2c6414194c2c36c1886367e, State: Running, Role: LEADER
I20260808 02:34:44.489291 17451 consensus_queue.cc:237] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } } peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } }
I20260808 02:34:44.494195 16687 catalog_manager.cc:5495] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7bdb6f59f2c6414194c2c36c1886367e (127.24.116.195). New cstate: current_term: 1 leader_uuid: "7bdb6f59f2c6414194c2c36c1886367e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } health_report { overall_health: HEALTHY } } }
I20260808 02:34:44.517393 17437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:44.512091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47174 (local address 127.24.116.195:46237)
0808 02:34:44.512275 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:44.512279 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:44.512297 (+ 18us) server_negotiation.cc:407] Connection header received
0808 02:34:44.512561 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:44.512564 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:44.512642 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:44.512767 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:34:44.513126 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.513842 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.515300 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.515728 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.515819 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:44.516291 (+ 472us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:34:44.516835 (+ 544us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:34:44.516954 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:44.517116 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 02:34:44.517182 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 02:34:44.525776 16918 raft_consensus.cc:1261] T 99e7ea6331e744c4a4a8c242ee004b74 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 FOLLOWER]: Refusing update from remote peer 7bdb6f59f2c6414194c2c36c1886367e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:34:44.525830 17126 raft_consensus.cc:1261] T 99e7ea6331e744c4a4a8c242ee004b74 P 6aa38a6176104fc88173baa97e5ac8a5 [term 1 FOLLOWER]: Refusing update from remote peer 7bdb6f59f2c6414194c2c36c1886367e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:34:44.526767 17453 consensus_queue.cc:1035] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:34:44.527112 17451 consensus_queue.cc:1035] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:34:44.539045 17457 mvcc.cc:205] Tried to move back new op lower bound from 7316096960607748096 to 7316096960472035328. Current Snapshot: MvccSnapshot[applied={T|T < 7316096960607748096}]
I20260808 02:34:44.540257 17460 mvcc.cc:205] Tried to move back new op lower bound from 7316096960607748096 to 7316096960472035328. Current Snapshot: MvccSnapshot[applied={T|T < 7316096960607748096}]
I20260808 02:34:44.553599 16687 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44934:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:34:44.553915 16687 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44934:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:34:44.557838 16687 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3: Sending DeleteTablet for 3 replicas of tablet 99e7ea6331e744c4a4a8c242ee004b74
I20260808 02:34:44.559080 16890 tablet_service.cc:1514] Processing DeleteTablet for tablet 99e7ea6331e744c4a4a8c242ee004b74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:34:44 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:59738
I20260808 02:34:44.559149 17298 tablet_service.cc:1514] Processing DeleteTablet for tablet 99e7ea6331e744c4a4a8c242ee004b74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:34:44 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:47172
I20260808 02:34:44.559960 17094 tablet_service.cc:1514] Processing DeleteTablet for tablet 99e7ea6331e744c4a4a8c242ee004b74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:34:44 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:33896
I20260808 02:34:44.560106 17474 tablet_replica.cc:330] T 99e7ea6331e744c4a4a8c242ee004b74 P 0d03b79e7a1e43e6b54511367d5d258c: stopping tablet replica
I20260808 02:34:44.560626 17474 raft_consensus.cc:2229] T 99e7ea6331e744c4a4a8c242ee004b74 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:34:44.561200 17474 raft_consensus.cc:2258] T 99e7ea6331e744c4a4a8c242ee004b74 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:34:44.562053 17475 tablet_replica.cc:330] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e: stopping tablet replica
I20260808 02:34:44.562551 17475 raft_consensus.cc:2229] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:34:44.562933 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 16788
I20260808 02:34:44.563295 17475 raft_consensus.cc:2258] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:34:44.565616 17475 ts_tablet_manager.cc:1905] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:34:44.570986 17477 tablet_replica.cc:330] T 99e7ea6331e744c4a4a8c242ee004b74 P 6aa38a6176104fc88173baa97e5ac8a5: stopping tablet replica
I20260808 02:34:44.571728 17477 raft_consensus.cc:2229] T 99e7ea6331e744c4a4a8c242ee004b74 P 6aa38a6176104fc88173baa97e5ac8a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:34:44.572481 17477 raft_consensus.cc:2258] T 99e7ea6331e744c4a4a8c242ee004b74 P 6aa38a6176104fc88173baa97e5ac8a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:34:44.573745 17475 ts_tablet_manager.cc:1918] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:34:44.573959 17475 log.cc:1196] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/99e7ea6331e744c4a4a8c242ee004b74
I20260808 02:34:44.574623 17475 ts_tablet_manager.cc:1939] T 99e7ea6331e744c4a4a8c242ee004b74 P 7bdb6f59f2c6414194c2c36c1886367e: Deleting consensus metadata
I20260808 02:34:44.574725 17477 ts_tablet_manager.cc:1905] T 99e7ea6331e744c4a4a8c242ee004b74 P 6aa38a6176104fc88173baa97e5ac8a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:34:44.574723 17474 ts_tablet_manager.cc:1905] T 99e7ea6331e744c4a4a8c242ee004b74 P 0d03b79e7a1e43e6b54511367d5d258c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:34:44.576653 16663 catalog_manager.cc:4841] TS 7bdb6f59f2c6414194c2c36c1886367e (127.24.116.195:46237): tablet 99e7ea6331e744c4a4a8c242ee004b74 (table test-table [id=2a8c03459c384db68b95b89b52ce592d]) successfully deleted
I20260808 02:34:44.582052 17477 ts_tablet_manager.cc:1918] T 99e7ea6331e744c4a4a8c242ee004b74 P 6aa38a6176104fc88173baa97e5ac8a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:34:44.582309 17477 log.cc:1196] T 99e7ea6331e744c4a4a8c242ee004b74 P 6aa38a6176104fc88173baa97e5ac8a5: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/99e7ea6331e744c4a4a8c242ee004b74
I20260808 02:34:44.582984 17477 ts_tablet_manager.cc:1939] T 99e7ea6331e744c4a4a8c242ee004b74 P 6aa38a6176104fc88173baa97e5ac8a5: Deleting consensus metadata
I20260808 02:34:44.583559 17474 ts_tablet_manager.cc:1918] T 99e7ea6331e744c4a4a8c242ee004b74 P 0d03b79e7a1e43e6b54511367d5d258c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:34:44.583781 17474 log.cc:1196] T 99e7ea6331e744c4a4a8c242ee004b74 P 0d03b79e7a1e43e6b54511367d5d258c: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/99e7ea6331e744c4a4a8c242ee004b74
I20260808 02:34:44.584471 17474 ts_tablet_manager.cc:1939] T 99e7ea6331e744c4a4a8c242ee004b74 P 0d03b79e7a1e43e6b54511367d5d258c: Deleting consensus metadata
I20260808 02:34:44.585176 16662 catalog_manager.cc:4841] TS 6aa38a6176104fc88173baa97e5ac8a5 (127.24.116.194:37589): tablet 99e7ea6331e744c4a4a8c242ee004b74 (table test-table [id=2a8c03459c384db68b95b89b52ce592d]) successfully deleted
I20260808 02:34:44.586807 16664 catalog_manager.cc:4841] TS 0d03b79e7a1e43e6b54511367d5d258c (127.24.116.193:45539): tablet 99e7ea6331e744c4a4a8c242ee004b74 (table test-table [id=2a8c03459c384db68b95b89b52ce592d]) successfully deleted
Aug 08 02:34:44 dist-test-slave-45dx krb5kdc[16612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.193@KRBTEST.COM
I20260808 02:34:44.596117 17431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:44.564436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59750 (local address 127.24.116.193:45539)
0808 02:34:44.564682 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:44.564690 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:44.577636 (+ 12946us) server_negotiation.cc:407] Connection header received
0808 02:34:44.577942 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:44.577948 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:44.578032 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:44.578118 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:44.580343 (+ 2225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.581564 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.583770 (+ 2206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.584484 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.584612 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:44.590023 (+ 5411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:44.590035 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:44.590050 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:44.590089 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:44.593157 (+ 3068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:44.594052 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:44.594059 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:44.594061 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:44.594198 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:44.594644 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:44.594647 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:44.594649 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:44.594987 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:44.595208 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:44.595637 (+ 429us) server_negotiation.cc:299] Negotiation successful
0808 02:34:44.595801 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 02:34:44.596889 16978 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:44.687942 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 16788
I20260808 02:34:44.711974 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 16993
Aug 08 02:34:44 dist-test-slave-45dx krb5kdc[16612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.194@KRBTEST.COM
I20260808 02:34:44.728482 17435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:44.712938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33906 (local address 127.24.116.194:37589)
0808 02:34:44.713143 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:44.713149 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:44.713170 (+ 21us) server_negotiation.cc:407] Connection header received
0808 02:34:44.713359 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:44.713364 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:44.713450 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:44.713555 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:44.715005 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.715792 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.717392 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.717791 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.717930 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:44.722516 (+ 4586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:44.722532 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:44.722549 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:44.722588 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:44.725568 (+ 2980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:44.726263 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:44.726271 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:44.726273 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:44.726411 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:44.726788 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:44.726793 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:44.726796 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:44.727203 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:44.727522 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:44.727808 (+ 286us) server_negotiation.cc:299] Negotiation successful
0808 02:34:44.728058 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 02:34:44.729297 17187 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:44.846860 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 16993
I20260808 02:34:44.876710 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 17203
Aug 08 02:34:44 dist-test-slave-45dx krb5kdc[16612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.195@KRBTEST.COM
I20260808 02:34:44.895488 17437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:34:44.877554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47180 (local address 127.24.116.195:46237)
0808 02:34:44.877781 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 02:34:44.877787 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:34:44.877810 (+ 23us) server_negotiation.cc:407] Connection header received
0808 02:34:44.877943 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:34:44.877949 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:34:44.878033 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:34:44.878177 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:34:44.879484 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.880695 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.882068 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:34:44.882782 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:34:44.882929 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:34:44.887828 (+ 4899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:34:44.887852 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:34:44.887881 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:34:44.887935 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:34:44.892167 (+ 4232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:44.893110 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:44.893120 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:44.893124 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:44.893336 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:34:44.893726 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:34:44.893731 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:34:44.893734 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:34:44.894238 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:34:44.894608 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0808 02:34:44.894780 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 02:34:44.895032 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260808 02:34:44.896241 17397 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:45.022609 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 17203
I20260808 02:34:45.052009 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 16638
I20260808 02:34:45.053241 16738 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:34:45.164357 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 16638
I20260808 02:35:05.194336 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:35647
--webserver_interface=127.24.116.254
--webserver_port=43591
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:41277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:35647
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:35:05.549263 17485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:35:05.549633 17485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:35:05.549798 17485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:35:05.557060 17485 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 02:35:05.557201 17485 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 02:35:05.557293 17485 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 02:35:05.557394 17485 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:35:05.557494 17485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:35:05.557600 17485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:35:05.557683 17485 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:35:05.557766 17485 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:35:05.569083 17485 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:41277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:35647
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:35647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=43591
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:35:05.570369 17485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:35:05.571740 17485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:35:05.599054 17496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:05.599054 17495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:05.599596 17498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:35:05.600070 17485 server_base.cc:1034] running on GCE node
I20260808 02:35:05.601117 17485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:35:05.602787 17485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:35:05.604055 17485 hybrid_clock.cc:648] HybridClock initialized: now 1786156505603983 us; error 45 us; skew 500 ppm
I20260808 02:35:05.604548 17485 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:35:05 dist-test-slave-45dx krb5kdc[16612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156505, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:35:05.608261 17485 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:35:05.609951 17485 webserver.cc:460] Webserver started at http://127.24.116.254:43591/ using document root <none> and password file <none>
I20260808 02:35:05.610766 17485 fs_manager.cc:359] Metadata directory not provided
I20260808 02:35:05.610927 17485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:35:05.617345 17485 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 02:35:05.620687 17510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:05.622243 17485 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 02:35:05.622473 17485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "052648b3edf8403bbc395426386bfed3"
format_stamp: "Formatted at 2026-08-08 02:34:42 on dist-test-slave-45dx"
server_key: "64892c016eb5b41e099a080950044fb2"
server_key_iv: "39c2688f48fe1dbf3bd8e2a4d25b1758"
server_key_version: "encryptionkey@0"
I20260808 02:35:05.623548 17485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:35:05.638104 17485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:35:05.642411 17485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:35:05.642721 17485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:35:05.662570 17485 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:35647
I20260808 02:35:05.662607 17592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:35647 every 8 connection(s)
I20260808 02:35:05.664160 17485 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:35:05.667205 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 17485
I20260808 02:35:05.668145 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:45539
--local_ip_for_outbound_sockets=127.24.116.193
--tserver_master_addrs=127.24.116.254:35647
--webserver_port=45057
--webserver_interface=127.24.116.193
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:41277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:35:05.671710 17593 sys_catalog.cc:263] Verifying existing consensus state
I20260808 02:35:05.675340 17593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3: Bootstrap starting.
I20260808 02:35:05.696044 17593 log.cc:824] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3: Log is configured to *not* fsync() on all Append() calls
I20260808 02:35:05.708794 17593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 02:35:05.709381 17593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3: Bootstrap complete.
I20260808 02:35:05.718910 17593 raft_consensus.cc:348] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "052648b3edf8403bbc395426386bfed3" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 35647 } }
I20260808 02:35:05.719861 17593 raft_consensus.cc:729] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 052648b3edf8403bbc395426386bfed3, State: Initialized, Role: FOLLOWER
I20260808 02:35:05.720582 17593 consensus_queue.cc:260] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "052648b3edf8403bbc395426386bfed3" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 35647 } }
I20260808 02:35:05.720842 17593 raft_consensus.cc:388] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:35:05.720989 17593 raft_consensus.cc:482] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:35:05.721174 17593 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 1 FOLLOWER]: Advancing to term 2
I20260808 02:35:05.725155 17593 raft_consensus.cc:504] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "052648b3edf8403bbc395426386bfed3" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 35647 } }
I20260808 02:35:05.725719 17593 leader_election.cc:302] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 052648b3edf8403bbc395426386bfed3; no voters:
I20260808 02:35:05.726426 17593 leader_election.cc:288] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 02:35:05.726585 17597 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 02:35:05.728036 17597 raft_consensus.cc:686] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 2 LEADER]: Becoming Leader. State: Replica: 052648b3edf8403bbc395426386bfed3, State: Running, Role: LEADER
I20260808 02:35:05.728847 17597 consensus_queue.cc:237] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "052648b3edf8403bbc395426386bfed3" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 35647 } }
I20260808 02:35:05.729218 17593 sys_catalog.cc:564] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:35:05.731616 17598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "052648b3edf8403bbc395426386bfed3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "052648b3edf8403bbc395426386bfed3" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 35647 } } }
I20260808 02:35:05.732088 17598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [sys.catalog]: This master's current role is: LEADER
I20260808 02:35:05.736860 17600 sys_catalog.cc:455] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 052648b3edf8403bbc395426386bfed3. Latest consensus state: current_term: 2 leader_uuid: "052648b3edf8403bbc395426386bfed3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "052648b3edf8403bbc395426386bfed3" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 35647 } } }
I20260808 02:35:05.737890 17600 sys_catalog.cc:458] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [sys.catalog]: This master's current role is: LEADER
I20260808 02:35:05.739497 17610 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:35:05.747887 17610 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:35:05.749411 17610 catalog_manager.cc:1259] Loaded cluster ID: a6dcd7769955443b8d3979cf84c996ee
I20260808 02:35:05.749568 17610 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:35:05.753916 17610 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:35:05.755681 17610 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3: Loaded TSK: 0
I20260808 02:35:05.788447 17610 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3: Generated new TSK 1
I20260808 02:35:05.788936 17610 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 02:35:06.061475 17595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:35:06.061777 17595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:35:06.061932 17595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:35:06.069254 17595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:35:06.069362 17595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:35:06.069558 17595 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:35:06.079295 17595 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:41277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:45539
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=45057
--tserver_master_addrs=127.24.116.254:35647
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:35:06.080762 17595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:35:06.082149 17595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:35:06.098115 17641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:06.098089 17639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:06.098304 17638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:35:06.099412 17595 server_base.cc:1034] running on GCE node
I20260808 02:35:06.100252 17595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:35:06.101588 17595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:35:06.102856 17595 hybrid_clock.cc:648] HybridClock initialized: now 1786156506102782 us; error 57 us; skew 500 ppm
I20260808 02:35:06.103291 17595 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:35:06 dist-test-slave-45dx krb5kdc[16612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156506, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:35:06.107419 17595 init.cc:377] Logged in from keytab as kudu/127.24.116.193@KRBTEST.COM (short username kudu)
I20260808 02:35:06.109272 17595 webserver.cc:460] Webserver started at http://127.24.116.193:45057/ using document root <none> and password file <none>
I20260808 02:35:06.110178 17595 fs_manager.cc:359] Metadata directory not provided
I20260808 02:35:06.110354 17595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:35:06.117920 17595 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 02:35:06.121454 17651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:06.123181 17595 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:35:06.123377 17595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "0d03b79e7a1e43e6b54511367d5d258c"
format_stamp: "Formatted at 2026-08-08 02:34:43 on dist-test-slave-45dx"
server_key: "8a5568cf2b3ecc288aa328cf2e3e4f37"
server_key_iv: "55372bfc8c66f8cfd0240e53fdfafe11"
server_key_version: "encryptionkey@0"
I20260808 02:35:06.124784 17595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:35:06.143953 17595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:35:06.149590 17595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:35:06.149930 17595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:35:06.151163 17595 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:35:06.152989 17595 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:35:06.153098 17595 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:06.153198 17595 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:35:06.153270 17595 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:06.187222 17595 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:45539
I20260808 02:35:06.187310 17810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:45539 every 8 connection(s)
I20260808 02:35:06.188784 17595 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:35:06.191895 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 17595
I20260808 02:35:06.192917 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:37589
--local_ip_for_outbound_sockets=127.24.116.194
--tserver_master_addrs=127.24.116.254:35647
--webserver_port=42849
--webserver_interface=127.24.116.194
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:41277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 02:35:06 dist-test-slave-45dx krb5kdc[16612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156506, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:35:06.217381 17815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:06.192164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.193:38115)
0808 02:35:06.193092 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:06.193155 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:06.195095 (+ 1940us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:06.196647 (+ 1552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:06.196661 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:06.197479 (+ 818us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:35:06.198313 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:06.198342 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:06.200194 (+ 1852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:06.200203 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:06.202355 (+ 2152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:06.202374 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:06.203416 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:06.203426 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:06.203782 (+ 356us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:06.204655 (+ 873us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:35:06.204692 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:35:06.207438 (+ 2746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:35:06.212710 (+ 5272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:35:06.212719 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:35:06.212733 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:35:06.213235 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:35:06.213836 (+ 601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:35:06.213839 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:35:06.213842 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:35:06.214052 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:35:06.215117 (+ 1065us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:35:06.215124 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:35:06.215508 (+ 384us) client_negotiation.cc:769] Sending connection context
0808 02:35:06.215754 (+ 246us) client_negotiation.cc:240] Negotiation successful
0808 02:35:06.216235 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":353,"threads_started":1}
I20260808 02:35:06.217901 17814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:06.191769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:38115 (local address 127.24.116.254:35647)
0808 02:35:06.192506 (+ 737us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:06.192539 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:06.195430 (+ 2891us) server_negotiation.cc:407] Connection header received
0808 02:35:06.195740 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:06.195753 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:06.196093 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:06.196481 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:06.198571 (+ 2090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:06.200001 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:06.202523 (+ 2522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:06.203171 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:06.203315 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:06.207753 (+ 4438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:06.207768 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:06.207792 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:06.207846 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:06.212520 (+ 4674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:06.213420 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:06.213433 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:06.213444 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:06.213675 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:06.214201 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:06.214209 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:06.214214 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:06.214947 (+ 733us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:06.215175 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:06.216095 (+ 920us) server_negotiation.cc:299] Negotiation successful
0808 02:35:06.216603 (+ 508us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":502,"thread_start_us":346,"threads_started":1}
I20260808 02:35:06.220793 17812 heartbeater.cc:347] Connected to a master server at 127.24.116.254:35647
I20260808 02:35:06.221146 17812 heartbeater.cc:464] Registering TS with master...
I20260808 02:35:06.221944 17812 heartbeater.cc:511] Master 127.24.116.254:35647 requested a full tablet report, sending...
I20260808 02:35:06.224283 17537 ts_manager.cc:194] Registered new tserver with Master: 0d03b79e7a1e43e6b54511367d5d258c (127.24.116.193:45539)
I20260808 02:35:06.225828 17537 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.193@KRBTEST.COM'} at 127.24.116.193:38115
W20260808 02:35:06.554888 17820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:35:06.555228 17820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:35:06.555405 17820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:35:06.563709 17820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:35:06.563884 17820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:35:06.564100 17820 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:35:06.575090 17820 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:41277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:37589
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=42849
--tserver_master_addrs=127.24.116.254:35647
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:35:06.576555 17820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:35:06.577926 17820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:35:06.592026 17831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:06.592077 17832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:06.592141 17838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:35:06.593286 17820 server_base.cc:1034] running on GCE node
I20260808 02:35:06.593855 17820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:35:06.594748 17820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:35:06.595950 17820 hybrid_clock.cc:648] HybridClock initialized: now 1786156506595900 us; error 41 us; skew 500 ppm
I20260808 02:35:06.596288 17820 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:35:06 dist-test-slave-45dx krb5kdc[16612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156506, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:35:06.599480 17820 init.cc:377] Logged in from keytab as kudu/127.24.116.194@KRBTEST.COM (short username kudu)
I20260808 02:35:06.600951 17820 webserver.cc:460] Webserver started at http://127.24.116.194:42849/ using document root <none> and password file <none>
I20260808 02:35:06.601639 17820 fs_manager.cc:359] Metadata directory not provided
I20260808 02:35:06.601809 17820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:35:06.607070 17820 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 02:35:06.609774 17849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:06.611210 17820 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 02:35:06.611338 17820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "6aa38a6176104fc88173baa97e5ac8a5"
format_stamp: "Formatted at 2026-08-08 02:34:43 on dist-test-slave-45dx"
server_key: "3717ed2d102faefda7bb263e17c10e51"
server_key_iv: "6c001fc7784987335ba48322a8a00395"
server_key_version: "encryptionkey@0"
I20260808 02:35:06.612277 17820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:35:06.623610 17820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:35:06.628159 17820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:35:06.628480 17820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:35:06.629427 17820 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:35:06.630887 17820 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:35:06.631013 17820 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:06.631145 17820 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:35:06.631238 17820 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:06.665549 17820 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:37589
I20260808 02:35:06.665611 18033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:37589 every 8 connection(s)
I20260808 02:35:06.667419 17820 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:35:06.671970 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 17820
I20260808 02:35:06.672806 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:46237
--local_ip_for_outbound_sockets=127.24.116.195
--tserver_master_addrs=127.24.116.254:35647
--webserver_port=40011
--webserver_interface=127.24.116.195
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:41277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 02:35:06 dist-test-slave-45dx krb5kdc[16612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156506, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:35:06.689097 17814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:06.670162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:34461 (local address 127.24.116.254:35647)
0808 02:35:06.670380 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:06.670386 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:06.671758 (+ 1372us) server_negotiation.cc:407] Connection header received
0808 02:35:06.673921 (+ 2163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:06.673927 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:06.674042 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:06.674159 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:06.675680 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:06.676494 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:06.678059 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:06.678517 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:06.678651 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:06.682360 (+ 3709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:06.682365 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:06.682368 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:06.682401 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:06.685183 (+ 2782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:06.686210 (+ 1027us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:06.686215 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:06.686219 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:06.686428 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:06.686983 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:06.686988 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:06.686992 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:06.687378 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:06.687529 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:06.688483 (+ 954us) server_negotiation.cc:299] Negotiation successful
0808 02:35:06.688736 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 02:35:06.690471 18038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:06.670703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.194:34461)
0808 02:35:06.671592 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:06.671647 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:06.673643 (+ 1996us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:06.674405 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:06.674413 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:06.674951 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:35:06.675508 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:06.675525 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:06.676658 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:06.676662 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:06.677910 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:06.677922 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:06.678749 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:06.678757 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:06.679005 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:06.679797 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:35:06.679821 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:35:06.682114 (+ 2293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:35:06.685382 (+ 3268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:35:06.685391 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:35:06.685413 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:35:06.686057 (+ 644us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:35:06.686571 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:35:06.686578 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:35:06.686583 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:35:06.686842 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:35:06.687532 (+ 690us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:35:06.687542 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:35:06.688003 (+ 461us) client_negotiation.cc:769] Sending connection context
0808 02:35:06.688340 (+ 337us) client_negotiation.cc:240] Negotiation successful
0808 02:35:06.688928 (+ 588us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":608,"thread_start_us":410,"threads_started":1}
I20260808 02:35:06.691977 18034 heartbeater.cc:347] Connected to a master server at 127.24.116.254:35647
I20260808 02:35:06.692293 18034 heartbeater.cc:464] Registering TS with master...
I20260808 02:35:06.693075 18034 heartbeater.cc:511] Master 127.24.116.254:35647 requested a full tablet report, sending...
I20260808 02:35:06.694587 17537 ts_manager.cc:194] Registered new tserver with Master: 6aa38a6176104fc88173baa97e5ac8a5 (127.24.116.194:37589)
I20260808 02:35:06.695394 17537 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.194@KRBTEST.COM'} at 127.24.116.194:34461
W20260808 02:35:07.027810 18039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:35:07.028194 18039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:35:07.028398 18039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:35:07.036265 18039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:35:07.036435 18039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:35:07.036612 18039 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:35:07.046622 18039 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:41277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:46237
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=40011
--tserver_master_addrs=127.24.116.254:35647
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:35:07.048019 18039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:35:07.049410 18039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:35:07.063019 18048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:07.063316 18052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:07.063439 18046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:35:07.064175 18039 server_base.cc:1034] running on GCE node
I20260808 02:35:07.064927 18039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:35:07.065925 18039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:35:07.067162 18039 hybrid_clock.cc:648] HybridClock initialized: now 1786156507067099 us; error 58 us; skew 500 ppm
I20260808 02:35:07.067487 18039 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:35:07 dist-test-slave-45dx krb5kdc[16612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156507, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:35:07.077507 18039 init.cc:377] Logged in from keytab as kudu/127.24.116.195@KRBTEST.COM (short username kudu)
I20260808 02:35:07.079167 18039 webserver.cc:460] Webserver started at http://127.24.116.195:40011/ using document root <none> and password file <none>
I20260808 02:35:07.079872 18039 fs_manager.cc:359] Metadata directory not provided
I20260808 02:35:07.080001 18039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:35:07.085660 18039 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260808 02:35:07.090404 18062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:07.091866 18039 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 02:35:07.092031 18039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "7bdb6f59f2c6414194c2c36c1886367e"
format_stamp: "Formatted at 2026-08-08 02:34:44 on dist-test-slave-45dx"
server_key: "b13a676e2de8ba7e76ed9a6b35aca1d3"
server_key_iv: "84089b71772e1b29e1d239a8684214b1"
server_key_version: "encryptionkey@0"
I20260808 02:35:07.093050 18039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:35:07.111827 18039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:35:07.116330 18039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:35:07.116559 18039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:35:07.117558 18039 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:35:07.118891 18039 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:35:07.118984 18039 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:07.119064 18039 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:35:07.119129 18039 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:07.154203 18039 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:46237
I20260808 02:35:07.154295 18241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:46237 every 8 connection(s)
I20260808 02:35:07.155727 18039 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:35:07.158572 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 18039
Aug 08 02:35:07 dist-test-slave-45dx krb5kdc[16612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156507, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:35:07.175587 18249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.159641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39686 (local address 127.24.116.254:35647)
0808 02:35:07.161104 (+ 1463us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:07.161112 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:07.161130 (+ 18us) server_negotiation.cc:407] Connection header received
0808 02:35:07.161190 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:07.161194 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:07.161251 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:07.161369 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:07.163109 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.163951 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.165336 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.165766 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.165920 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:07.169026 (+ 3106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:07.169037 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:07.169040 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:07.169070 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:07.172343 (+ 3273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:07.173315 (+ 972us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:07.173319 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:07.173321 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:07.173442 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:07.173931 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:07.173934 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:07.173936 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:07.174218 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:07.174496 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:07.174828 (+ 332us) server_negotiation.cc:299] Negotiation successful
0808 02:35:07.175072 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1341,"thread_start_us":1215,"threads_started":1}
I20260808 02:35:07.177739 17814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.158472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:41203 (local address 127.24.116.254:35647)
0808 02:35:07.158686 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:07.158692 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:07.160162 (+ 1470us) server_negotiation.cc:407] Connection header received
0808 02:35:07.162344 (+ 2182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:07.162350 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:07.162427 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:07.162537 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:07.164090 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.164907 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.166417 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.166828 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.166952 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:07.170580 (+ 3628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:07.170586 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:07.170590 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:07.170640 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:07.174198 (+ 3558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:07.175016 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:07.175024 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:07.175031 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:07.175164 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:07.175635 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:07.175641 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:07.175645 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:07.176010 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:07.176178 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:07.177176 (+ 998us) server_negotiation.cc:299] Negotiation successful
0808 02:35:07.177364 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 02:35:07.179062 18246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.158971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.195:41203)
0808 02:35:07.159944 (+ 973us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:07.160014 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:07.162086 (+ 2072us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:07.162731 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:07.162739 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:07.163266 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:35:07.163923 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:07.163941 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.165071 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.165075 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:07.166275 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:07.166287 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.167065 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.167072 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:07.167310 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:07.167968 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:35:07.167990 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:35:07.170387 (+ 2397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:35:07.174352 (+ 3965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:35:07.174362 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:35:07.174381 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:35:07.174887 (+ 506us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:35:07.175287 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:35:07.175292 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:35:07.175296 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:35:07.175511 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:35:07.176152 (+ 641us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:35:07.176162 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:35:07.176683 (+ 521us) client_negotiation.cc:769] Sending connection context
0808 02:35:07.177071 (+ 388us) client_negotiation.cc:240] Negotiation successful
0808 02:35:07.177623 (+ 552us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"thread_start_us":397,"threads_started":1}
I20260808 02:35:07.180538 18243 heartbeater.cc:347] Connected to a master server at 127.24.116.254:35647
I20260808 02:35:07.180860 18243 heartbeater.cc:464] Registering TS with master...
I20260808 02:35:07.181586 18243 heartbeater.cc:511] Master 127.24.116.254:35647 requested a full tablet report, sending...
I20260808 02:35:07.182993 17537 ts_manager.cc:194] Registered new tserver with Master: 7bdb6f59f2c6414194c2c36c1886367e (127.24.116.195:46237)
I20260808 02:35:07.183776 17537 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.195@KRBTEST.COM'} at 127.24.116.195:41203
I20260808 02:35:07.190963 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:35:07.197937 17814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.192060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39692 (local address 127.24.116.254:35647)
0808 02:35:07.192267 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:07.192273 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:07.192780 (+ 507us) server_negotiation.cc:407] Connection header received
0808 02:35:07.192947 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:07.192951 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:07.193086 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:07.193207 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:35:07.193625 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.194410 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.196057 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.196597 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.196690 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:07.197137 (+ 447us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:35:07.197363 (+ 226us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 02:35:07.197735 (+ 372us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39692: token expired
Metrics: {"server-negotiator.queue_time_us":74}
W20260808 02:35:07.198053 17814 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39692: token expired
W20260808 02:35:07.198639 17419 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.24.116.254:35647)
I20260808 02:35:07.212226 17814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.199116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39702 (local address 127.24.116.254:35647)
0808 02:35:07.199275 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:07.199281 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:07.199336 (+ 55us) server_negotiation.cc:407] Connection header received
0808 02:35:07.199508 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:07.199513 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:07.199596 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:07.199705 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:07.201231 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.201955 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.203283 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.203681 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.203823 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:07.206544 (+ 2721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:07.206555 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:07.206558 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:07.206588 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:07.209366 (+ 2778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:07.210115 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:07.210120 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:07.210124 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:07.210254 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:07.210655 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:07.210660 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:07.210664 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:07.211003 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:07.211278 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:07.211610 (+ 332us) server_negotiation.cc:299] Negotiation successful
0808 02:35:07.211864 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 02:35:07.215710 17537 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39702:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:35:07.223135 17537 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:35:07.229198 17812 heartbeater.cc:503] Master 127.24.116.254:35647 was elected leader, sending a full tablet report...
I20260808 02:35:07.247175 18264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.235717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48746 (local address 127.24.116.195:46237)
0808 02:35:07.236435 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:07.236444 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:07.237722 (+ 1278us) server_negotiation.cc:407] Connection header received
0808 02:35:07.238024 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:07.238035 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:07.238299 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:07.238540 (+ 241us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:35:07.239326 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.241076 (+ 1750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.244819 (+ 3743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.245801 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.246060 (+ 259us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:07.246261 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:07.246638 (+ 377us) server_negotiation.cc:299] Negotiation successful
0808 02:35:07.246829 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":940,"threads_started":1}
I20260808 02:35:07.247530 18265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.235762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:45539 (local address 127.0.0.1:42882)
0808 02:35:07.238344 (+ 2582us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:07.238362 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:07.238495 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:07.239649 (+ 1154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:07.239654 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:07.239681 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:35:07.240004 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:07.240018 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.241932 (+ 1914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.241937 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:07.244573 (+ 2636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:07.244591 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.246538 (+ 1947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.246547 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:07.246711 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:07.246743 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 02:35:07.246827 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 02:35:07.247050 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2465,"mutex_wait_us":106,"thread_start_us":2338,"threads_started":1}
I20260808 02:35:07.248404 18266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.236423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42882 (local address 127.24.116.193:45539)
0808 02:35:07.237080 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:07.237092 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:07.238623 (+ 1531us) server_negotiation.cc:407] Connection header received
0808 02:35:07.238955 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:07.238966 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:07.239191 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:07.239372 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:35:07.240189 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.241780 (+ 1591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.244767 (+ 2987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.246280 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.246491 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:07.246647 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:07.247833 (+ 1186us) server_negotiation.cc:299] Negotiation successful
0808 02:35:07.248040 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":326,"threads_started":1}
I20260808 02:35:07.248214 18261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.235358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:46237 (local address 127.0.0.1:48746)
0808 02:35:07.237541 (+ 2183us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:07.237577 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:07.237765 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:07.238552 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:07.238562 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:07.238591 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:35:07.239067 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:07.239082 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.241232 (+ 2150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.241240 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:07.244637 (+ 3397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:07.244651 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.246077 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.246083 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:07.246311 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:07.246384 (+ 73us) client_negotiation.cc:769] Sending connection context
0808 02:35:07.247690 (+ 1306us) client_negotiation.cc:240] Negotiation successful
0808 02:35:07.247832 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1950,"mutex_wait_us":265,"thread_start_us":1798,"threads_started":1}
I20260808 02:35:07.249719 18267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.238614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:37589 (local address 127.0.0.1:59262)
0808 02:35:07.241810 (+ 3196us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:07.241840 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:07.241955 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:07.242763 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:07.242769 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:07.242795 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:35:07.243330 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:07.243343 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.244687 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.244695 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:07.247058 (+ 2363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:07.247080 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.248823 (+ 1743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.248830 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:07.249042 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:07.249081 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 02:35:07.249173 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 02:35:07.249332 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3030,"mutex_wait_us":28,"thread_start_us":2797,"threads_started":1}
I20260808 02:35:07.250438 18268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.239200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59262 (local address 127.24.116.194:37589)
0808 02:35:07.240283 (+ 1083us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:07.240295 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:07.241965 (+ 1670us) server_negotiation.cc:407] Connection header received
0808 02:35:07.242106 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:07.242112 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:07.242306 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:07.242500 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:35:07.243527 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.244560 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.247272 (+ 2712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.248576 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.248738 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:07.248856 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:07.249963 (+ 1107us) server_negotiation.cc:299] Negotiation successful
0808 02:35:07.250147 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":912,"thread_start_us":816,"threads_started":1}
I20260808 02:35:07.253010 18137 tablet_service.cc:1467] Processing CreateTablet for tablet 267b61bcbe694a2083e9d081a4df3460 (DEFAULT_TABLE table=test-table [id=054906d3bcc44fa3bd5eb2db16c938b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:35:07.253010 17723 tablet_service.cc:1467] Processing CreateTablet for tablet 267b61bcbe694a2083e9d081a4df3460 (DEFAULT_TABLE table=test-table [id=054906d3bcc44fa3bd5eb2db16c938b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:35:07.254575 18137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 267b61bcbe694a2083e9d081a4df3460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:35:07.254590 17723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 267b61bcbe694a2083e9d081a4df3460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:35:07.255740 17936 tablet_service.cc:1467] Processing CreateTablet for tablet 267b61bcbe694a2083e9d081a4df3460 (DEFAULT_TABLE table=test-table [id=054906d3bcc44fa3bd5eb2db16c938b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:35:07.257042 17936 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 267b61bcbe694a2083e9d081a4df3460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:35:07.269044 18270 tablet_bootstrap.cc:492] T 267b61bcbe694a2083e9d081a4df3460 P 6aa38a6176104fc88173baa97e5ac8a5: Bootstrap starting.
I20260808 02:35:07.271051 18273 tablet_bootstrap.cc:492] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c: Bootstrap starting.
I20260808 02:35:07.273502 18270 tablet_bootstrap.cc:654] T 267b61bcbe694a2083e9d081a4df3460 P 6aa38a6176104fc88173baa97e5ac8a5: Neither blocks nor log segments found. Creating new log.
I20260808 02:35:07.274441 18274 tablet_bootstrap.cc:492] T 267b61bcbe694a2083e9d081a4df3460 P 7bdb6f59f2c6414194c2c36c1886367e: Bootstrap starting.
I20260808 02:35:07.274653 18273 tablet_bootstrap.cc:654] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c: Neither blocks nor log segments found. Creating new log.
I20260808 02:35:07.274878 18270 log.cc:824] T 267b61bcbe694a2083e9d081a4df3460 P 6aa38a6176104fc88173baa97e5ac8a5: Log is configured to *not* fsync() on all Append() calls
I20260808 02:35:07.275924 18273 log.cc:824] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c: Log is configured to *not* fsync() on all Append() calls
I20260808 02:35:07.278031 18274 tablet_bootstrap.cc:654] T 267b61bcbe694a2083e9d081a4df3460 P 7bdb6f59f2c6414194c2c36c1886367e: Neither blocks nor log segments found. Creating new log.
I20260808 02:35:07.278239 18270 tablet_bootstrap.cc:492] T 267b61bcbe694a2083e9d081a4df3460 P 6aa38a6176104fc88173baa97e5ac8a5: No bootstrap required, opened a new log
I20260808 02:35:07.278589 18270 ts_tablet_manager.cc:1397] T 267b61bcbe694a2083e9d081a4df3460 P 6aa38a6176104fc88173baa97e5ac8a5: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.008s
I20260808 02:35:07.279174 18273 tablet_bootstrap.cc:492] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c: No bootstrap required, opened a new log
I20260808 02:35:07.279304 18274 log.cc:824] T 267b61bcbe694a2083e9d081a4df3460 P 7bdb6f59f2c6414194c2c36c1886367e: Log is configured to *not* fsync() on all Append() calls
I20260808 02:35:07.279515 18273 ts_tablet_manager.cc:1397] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260808 02:35:07.281774 18274 tablet_bootstrap.cc:492] T 267b61bcbe694a2083e9d081a4df3460 P 7bdb6f59f2c6414194c2c36c1886367e: No bootstrap required, opened a new log
I20260808 02:35:07.282032 18274 ts_tablet_manager.cc:1397] T 267b61bcbe694a2083e9d081a4df3460 P 7bdb6f59f2c6414194c2c36c1886367e: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260808 02:35:07.288808 18274 raft_consensus.cc:348] T 267b61bcbe694a2083e9d081a4df3460 P 7bdb6f59f2c6414194c2c36c1886367e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } } peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } }
I20260808 02:35:07.289294 18274 raft_consensus.cc:374] T 267b61bcbe694a2083e9d081a4df3460 P 7bdb6f59f2c6414194c2c36c1886367e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:35:07.289429 18274 raft_consensus.cc:729] T 267b61bcbe694a2083e9d081a4df3460 P 7bdb6f59f2c6414194c2c36c1886367e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bdb6f59f2c6414194c2c36c1886367e, State: Initialized, Role: FOLLOWER
I20260808 02:35:07.289690 18270 raft_consensus.cc:348] T 267b61bcbe694a2083e9d081a4df3460 P 6aa38a6176104fc88173baa97e5ac8a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } } peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } }
I20260808 02:35:07.290174 18270 raft_consensus.cc:374] T 267b61bcbe694a2083e9d081a4df3460 P 6aa38a6176104fc88173baa97e5ac8a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:35:07.290310 18270 raft_consensus.cc:729] T 267b61bcbe694a2083e9d081a4df3460 P 6aa38a6176104fc88173baa97e5ac8a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aa38a6176104fc88173baa97e5ac8a5, State: Initialized, Role: FOLLOWER
I20260808 02:35:07.290326 18274 consensus_queue.cc:260] T 267b61bcbe694a2083e9d081a4df3460 P 7bdb6f59f2c6414194c2c36c1886367e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } } peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } }
I20260808 02:35:07.290277 18273 raft_consensus.cc:348] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } } peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } }
I20260808 02:35:07.290720 18273 raft_consensus.cc:374] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:35:07.290853 18273 raft_consensus.cc:729] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d03b79e7a1e43e6b54511367d5d258c, State: Initialized, Role: FOLLOWER
I20260808 02:35:07.290943 18270 consensus_queue.cc:260] T 267b61bcbe694a2083e9d081a4df3460 P 6aa38a6176104fc88173baa97e5ac8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } } peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } }
I20260808 02:35:07.291582 18243 heartbeater.cc:503] Master 127.24.116.254:35647 was elected leader, sending a full tablet report...
I20260808 02:35:07.291582 18273 consensus_queue.cc:260] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } } peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } }
I20260808 02:35:07.292949 18274 ts_tablet_manager.cc:1428] T 267b61bcbe694a2083e9d081a4df3460 P 7bdb6f59f2c6414194c2c36c1886367e: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260808 02:35:07.293973 18034 heartbeater.cc:503] Master 127.24.116.254:35647 was elected leader, sending a full tablet report...
I20260808 02:35:07.294631 18270 ts_tablet_manager.cc:1428] T 267b61bcbe694a2083e9d081a4df3460 P 6aa38a6176104fc88173baa97e5ac8a5: Time spent starting tablet: real 0.016s user 0.011s sys 0.003s
I20260808 02:35:07.296535 18273 ts_tablet_manager.cc:1428] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c: Time spent starting tablet: real 0.017s user 0.017s sys 0.000s
I20260808 02:35:07.376998 18284 raft_consensus.cc:482] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:35:07.377326 18284 raft_consensus.cc:504] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } } peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } }
I20260808 02:35:07.379069 18284 leader_election.cc:288] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bdb6f59f2c6414194c2c36c1886367e (127.24.116.195:46237), 6aa38a6176104fc88173baa97e5ac8a5 (127.24.116.194:37589)
I20260808 02:35:07.389036 18264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.379693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:44813 (local address 127.24.116.195:46237)
0808 02:35:07.379957 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:07.379966 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:07.380532 (+ 566us) server_negotiation.cc:407] Connection header received
0808 02:35:07.380758 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:07.380763 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:07.380846 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:07.380966 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:35:07.382023 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.383146 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.386442 (+ 3296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.387743 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.387953 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:07.388025 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:07.388612 (+ 587us) server_negotiation.cc:299] Negotiation successful
0808 02:35:07.388754 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 02:35:07.389036 18268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.379699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:60383 (local address 127.24.116.194:37589)
0808 02:35:07.380043 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:07.380049 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:07.380623 (+ 574us) server_negotiation.cc:407] Connection header received
0808 02:35:07.380757 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:07.380763 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:07.380848 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:07.380963 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:35:07.382023 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.383146 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.386442 (+ 3296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.387782 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.387942 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:07.388025 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:07.388612 (+ 587us) server_negotiation.cc:299] Negotiation successful
0808 02:35:07.388755 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172}
I20260808 02:35:07.389309 18289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.379591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:37589 (local address 127.24.116.193:60383)
0808 02:35:07.380532 (+ 941us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:07.380548 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:07.380649 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:07.381033 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:07.381039 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:07.381083 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:35:07.381846 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:07.381862 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.383340 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.383347 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:07.386248 (+ 2901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:07.386266 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.388082 (+ 1816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.388087 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:07.388381 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:07.388461 (+ 80us) client_negotiation.cc:769] Sending connection context
0808 02:35:07.388570 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 02:35:07.388755 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":819,"mutex_wait_us":337,"spinlock_wait_cycles":768,"thread_start_us":519,"threads_started":1}
I20260808 02:35:07.389340 18288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.379360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:46237 (local address 127.24.116.193:44813)
0808 02:35:07.380392 (+ 1032us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:07.380424 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:07.380600 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:07.381033 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:07.381039 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:07.381090 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:35:07.381846 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:07.381862 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.383341 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.383347 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:07.386257 (+ 2910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:07.386266 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.388070 (+ 1804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.388077 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:07.388385 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:07.388465 (+ 80us) client_negotiation.cc:769] Sending connection context
0808 02:35:07.388570 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 02:35:07.388755 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":827,"mutex_wait_us":389,"spinlock_wait_cycles":12288,"thread_start_us":581,"threads_started":1}
I20260808 02:35:07.390733 18169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "267b61bcbe694a2083e9d081a4df3460" candidate_uuid: "0d03b79e7a1e43e6b54511367d5d258c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bdb6f59f2c6414194c2c36c1886367e" is_pre_election: true
I20260808 02:35:07.390733 17963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "267b61bcbe694a2083e9d081a4df3460" candidate_uuid: "0d03b79e7a1e43e6b54511367d5d258c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aa38a6176104fc88173baa97e5ac8a5" is_pre_election: true
I20260808 02:35:07.391351 17963 raft_consensus.cc:2454] T 267b61bcbe694a2083e9d081a4df3460 P 6aa38a6176104fc88173baa97e5ac8a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d03b79e7a1e43e6b54511367d5d258c in term 0.
I20260808 02:35:07.391360 18169 raft_consensus.cc:2454] T 267b61bcbe694a2083e9d081a4df3460 P 7bdb6f59f2c6414194c2c36c1886367e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d03b79e7a1e43e6b54511367d5d258c in term 0.
I20260808 02:35:07.392127 17653 leader_election.cc:302] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d03b79e7a1e43e6b54511367d5d258c, 6aa38a6176104fc88173baa97e5ac8a5; no voters:
I20260808 02:35:07.392894 18284 raft_consensus.cc:2781] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:35:07.393007 18284 raft_consensus.cc:482] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:35:07.393066 18284 raft_consensus.cc:3037] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:35:07.395825 18284 raft_consensus.cc:504] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } } peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } }
I20260808 02:35:07.396673 18284 leader_election.cc:288] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [CANDIDATE]: Term 1 election: Requested vote from peers 7bdb6f59f2c6414194c2c36c1886367e (127.24.116.195:46237), 6aa38a6176104fc88173baa97e5ac8a5 (127.24.116.194:37589)
I20260808 02:35:07.397257 17963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "267b61bcbe694a2083e9d081a4df3460" candidate_uuid: "0d03b79e7a1e43e6b54511367d5d258c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aa38a6176104fc88173baa97e5ac8a5"
I20260808 02:35:07.397504 17963 raft_consensus.cc:3037] T 267b61bcbe694a2083e9d081a4df3460 P 6aa38a6176104fc88173baa97e5ac8a5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:35:07.397169 18169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "267b61bcbe694a2083e9d081a4df3460" candidate_uuid: "0d03b79e7a1e43e6b54511367d5d258c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bdb6f59f2c6414194c2c36c1886367e"
I20260808 02:35:07.400030 18169 raft_consensus.cc:3037] T 267b61bcbe694a2083e9d081a4df3460 P 7bdb6f59f2c6414194c2c36c1886367e [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:35:07.401285 17963 raft_consensus.cc:2454] T 267b61bcbe694a2083e9d081a4df3460 P 6aa38a6176104fc88173baa97e5ac8a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d03b79e7a1e43e6b54511367d5d258c in term 1.
I20260808 02:35:07.401939 17653 leader_election.cc:302] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d03b79e7a1e43e6b54511367d5d258c, 6aa38a6176104fc88173baa97e5ac8a5; no voters:
I20260808 02:35:07.402308 18284 raft_consensus.cc:2781] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:35:07.402937 18284 raft_consensus.cc:686] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 LEADER]: Becoming Leader. State: Replica: 0d03b79e7a1e43e6b54511367d5d258c, State: Running, Role: LEADER
I20260808 02:35:07.403631 18169 raft_consensus.cc:2454] T 267b61bcbe694a2083e9d081a4df3460 P 7bdb6f59f2c6414194c2c36c1886367e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d03b79e7a1e43e6b54511367d5d258c in term 1.
I20260808 02:35:07.403609 18284 consensus_queue.cc:237] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } } peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } }
W20260808 02:35:07.408654 18245 tablet.cc:2369] T 267b61bcbe694a2083e9d081a4df3460 P 7bdb6f59f2c6414194c2c36c1886367e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:35:07.409668 17531 catalog_manager.cc:5495] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d03b79e7a1e43e6b54511367d5d258c (127.24.116.193). New cstate: current_term: 1 leader_uuid: "0d03b79e7a1e43e6b54511367d5d258c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } health_report { overall_health: UNKNOWN } } }
W20260808 02:35:07.419624 18036 tablet.cc:2369] T 267b61bcbe694a2083e9d081a4df3460 P 6aa38a6176104fc88173baa97e5ac8a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:35:07.441262 17813 tablet.cc:2369] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:35:07.444082 18266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.438080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42888 (local address 127.24.116.193:45539)
0808 02:35:07.438310 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:07.438318 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:07.438381 (+ 63us) server_negotiation.cc:407] Connection header received
0808 02:35:07.438577 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:07.438580 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:07.438672 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:07.438799 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:35:07.439117 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.439826 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.441427 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.442202 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.442314 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:07.442822 (+ 508us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:35:07.443368 (+ 546us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:35:07.443481 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:07.443672 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 02:35:07.443752 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 02:35:07.452500 17963 raft_consensus.cc:1261] T 267b61bcbe694a2083e9d081a4df3460 P 6aa38a6176104fc88173baa97e5ac8a5 [term 1 FOLLOWER]: Refusing update from remote peer 0d03b79e7a1e43e6b54511367d5d258c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:35:07.452498 18169 raft_consensus.cc:1261] T 267b61bcbe694a2083e9d081a4df3460 P 7bdb6f59f2c6414194c2c36c1886367e [term 1 FOLLOWER]: Refusing update from remote peer 0d03b79e7a1e43e6b54511367d5d258c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:35:07.453552 18284 consensus_queue.cc:1035] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:35:07.453852 18291 consensus_queue.cc:1035] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:35:07.465829 18295 mvcc.cc:205] Tried to move back new op lower bound from 7316097054515302400 to 7316097054330224640. Current Snapshot: MvccSnapshot[applied={T|T < 7316097054515302400}]
I20260808 02:35:07.480854 17536 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39702:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:35:07.481196 17536 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39702:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:35:07.485312 17536 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3: Sending DeleteTablet for 3 replicas of tablet 267b61bcbe694a2083e9d081a4df3460
I20260808 02:35:07.486750 17936 tablet_service.cc:1514] Processing DeleteTablet for tablet 267b61bcbe694a2083e9d081a4df3460 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:35:07 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:59262
I20260808 02:35:07.486749 18137 tablet_service.cc:1514] Processing DeleteTablet for tablet 267b61bcbe694a2083e9d081a4df3460 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:35:07 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:48746
I20260808 02:35:07.486848 17723 tablet_service.cc:1514] Processing DeleteTablet for tablet 267b61bcbe694a2083e9d081a4df3460 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:35:07 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:42882
I20260808 02:35:07.488572 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 17595
I20260808 02:35:07.497191 18308 tablet_replica.cc:330] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c: stopping tablet replica
I20260808 02:35:07.497915 18308 raft_consensus.cc:2229] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:35:07.498023 18307 tablet_replica.cc:330] T 267b61bcbe694a2083e9d081a4df3460 P 6aa38a6176104fc88173baa97e5ac8a5: stopping tablet replica
I20260808 02:35:07.498539 18307 raft_consensus.cc:2229] T 267b61bcbe694a2083e9d081a4df3460 P 6aa38a6176104fc88173baa97e5ac8a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:35:07.499187 18307 raft_consensus.cc:2258] T 267b61bcbe694a2083e9d081a4df3460 P 6aa38a6176104fc88173baa97e5ac8a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:35:07.499163 18308 raft_consensus.cc:2258] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:35:07.500115 18306 tablet_replica.cc:330] T 267b61bcbe694a2083e9d081a4df3460 P 7bdb6f59f2c6414194c2c36c1886367e: stopping tablet replica
I20260808 02:35:07.500656 18306 raft_consensus.cc:2229] T 267b61bcbe694a2083e9d081a4df3460 P 7bdb6f59f2c6414194c2c36c1886367e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:35:07.501924 18307 ts_tablet_manager.cc:1905] T 267b61bcbe694a2083e9d081a4df3460 P 6aa38a6176104fc88173baa97e5ac8a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:35:07.503306 18306 raft_consensus.cc:2258] T 267b61bcbe694a2083e9d081a4df3460 P 7bdb6f59f2c6414194c2c36c1886367e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:35:07.508502 18266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.489516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42890 (local address 127.24.116.193:45539)
0808 02:35:07.489750 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:07.489760 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:07.489788 (+ 28us) server_negotiation.cc:407] Connection header received
0808 02:35:07.489986 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:07.489995 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:07.490100 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:07.490237 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:07.492221 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.493946 (+ 1725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.495961 (+ 2015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.497056 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.497217 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:07.501178 (+ 3961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:07.501195 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:07.501208 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:07.501255 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:07.504738 (+ 3483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:07.506130 (+ 1392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:07.506146 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:07.506148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:07.506310 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:07.506772 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:07.506778 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:07.506781 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:07.507136 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:07.507474 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:07.507827 (+ 353us) server_negotiation.cc:299] Negotiation successful
0808 02:35:07.508091 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 02:35:07.509341 17804 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:35:07.510383 18307 ts_tablet_manager.cc:1918] T 267b61bcbe694a2083e9d081a4df3460 P 6aa38a6176104fc88173baa97e5ac8a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:35:07.510640 18307 log.cc:1196] T 267b61bcbe694a2083e9d081a4df3460 P 6aa38a6176104fc88173baa97e5ac8a5: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/267b61bcbe694a2083e9d081a4df3460
I20260808 02:35:07.511699 18307 ts_tablet_manager.cc:1939] T 267b61bcbe694a2083e9d081a4df3460 P 6aa38a6176104fc88173baa97e5ac8a5: Deleting consensus metadata
I20260808 02:35:07.511847 18306 ts_tablet_manager.cc:1905] T 267b61bcbe694a2083e9d081a4df3460 P 7bdb6f59f2c6414194c2c36c1886367e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:35:07.514430 17512 catalog_manager.cc:4841] TS 6aa38a6176104fc88173baa97e5ac8a5 (127.24.116.194:37589): tablet 267b61bcbe694a2083e9d081a4df3460 (table test-table [id=054906d3bcc44fa3bd5eb2db16c938b9]) successfully deleted
I20260808 02:35:07.519524 18306 ts_tablet_manager.cc:1918] T 267b61bcbe694a2083e9d081a4df3460 P 7bdb6f59f2c6414194c2c36c1886367e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:35:07.519727 18306 log.cc:1196] T 267b61bcbe694a2083e9d081a4df3460 P 7bdb6f59f2c6414194c2c36c1886367e: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/267b61bcbe694a2083e9d081a4df3460
I20260808 02:35:07.520323 18306 ts_tablet_manager.cc:1939] T 267b61bcbe694a2083e9d081a4df3460 P 7bdb6f59f2c6414194c2c36c1886367e: Deleting consensus metadata
I20260808 02:35:07.522535 17515 catalog_manager.cc:4841] TS 7bdb6f59f2c6414194c2c36c1886367e (127.24.116.195:46237): tablet 267b61bcbe694a2083e9d081a4df3460 (table test-table [id=054906d3bcc44fa3bd5eb2db16c938b9]) successfully deleted
I20260808 02:35:07.509605 18308 ts_tablet_manager.cc:1905] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:35:07.612912 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 17595
W20260808 02:35:07.639638 17516 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.116.193:45539 (error 108)
I20260808 02:35:07.640046 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 17820
I20260808 02:35:07.641673 18267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.641193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:45539 (local address 127.0.0.1:42906)
0808 02:35:07.641363 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:07.641458 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.193:45539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 02:35:07.641940 17516 catalog_manager.cc:4584] TS 0d03b79e7a1e43e6b54511367d5d258c (127.24.116.193:45539): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 267b61bcbe694a2083e9d081a4df3460: Network error: Client connection negotiation failed: client connection to 127.24.116.193:45539: connect: Connection refused (error 111)
I20260808 02:35:07.655174 18268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.640960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59274 (local address 127.24.116.194:37589)
0808 02:35:07.641258 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:07.641265 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:07.641555 (+ 290us) server_negotiation.cc:407] Connection header received
0808 02:35:07.641757 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:07.641763 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:07.641864 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:07.641981 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:07.643425 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.644209 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.645739 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.646174 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.646275 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:07.649083 (+ 2808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:07.649099 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:07.649115 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:07.649150 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:07.652052 (+ 2902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:07.653196 (+ 1144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:07.653204 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:07.653206 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:07.653402 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:07.653781 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:07.653785 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:07.653787 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:07.654188 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:07.654446 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:07.654712 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 02:35:07.654907 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260808 02:35:07.655908 18026 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:35:07.695652 18267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.695150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:45539 (local address 127.0.0.1:42912)
0808 02:35:07.695375 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:07.695496 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.193:45539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260808 02:35:07.696916 18267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.696472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:45539 (local address 127.0.0.1:42928)
0808 02:35:07.696612 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:07.696741 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.193:45539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 02:35:07.748344 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 17820
I20260808 02:35:07.757826 18267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.757172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:45539 (local address 127.0.0.1:42940)
0808 02:35:07.757444 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:07.757548 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.193:45539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126}
I20260808 02:35:07.759002 18267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.758572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:45539 (local address 127.0.0.1:42950)
0808 02:35:07.758731 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:07.758851 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.193:45539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 02:35:07.775430 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 18039
I20260808 02:35:07.789086 18264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.776245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48754 (local address 127.24.116.195:46237)
0808 02:35:07.776451 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:07.776456 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:07.776476 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:35:07.776644 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:07.776649 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:07.776717 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:07.776806 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:07.778210 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.778964 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.780287 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:07.780727 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:07.780829 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:07.783553 (+ 2724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:07.783568 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:07.783585 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:07.783631 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:07.786458 (+ 2827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:07.787217 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:07.787224 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:07.787226 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:07.787384 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:07.787736 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:07.787740 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:07.787742 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:07.788083 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:07.788390 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:07.788647 (+ 257us) server_negotiation.cc:299] Negotiation successful
0808 02:35:07.788822 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 02:35:07.789906 18235 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:35:07.839766 18267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.839230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:45539 (local address 127.0.0.1:42952)
0808 02:35:07.839476 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:07.839573 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.193:45539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260808 02:35:07.841007 18267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:07.840549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:45539 (local address 127.0.0.1:42968)
0808 02:35:07.840771 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:07.840851 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.193:45539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260808 02:35:07.884810 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 18039
I20260808 02:35:07.909446 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 17485
I20260808 02:35:07.910822 17582 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:35:08.028201 18267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:08.027492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:45539 (local address 127.0.0.1:42970)
0808 02:35:08.027708 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:08.027860 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.193:45539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260808 02:35:08.028515 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 17485
I20260808 02:35:28.059197 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:35647
--webserver_interface=127.24.116.254
--webserver_port=43591
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:41277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:35647
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:35:28.416673 18317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:35:28.417048 18317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:35:28.417213 18317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:35:28.424606 18317 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 02:35:28.424744 18317 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 02:35:28.424839 18317 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 02:35:28.424933 18317 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:35:28.425045 18317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:35:28.425146 18317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:35:28.425235 18317 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:35:28.425316 18317 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:35:28.435269 18317 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:41277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:35647
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:35647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=43591
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:35:28.436724 18317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:35:28.438139 18317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:35:28.450647 18335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:28.450649 18333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:28.451116 18328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:35:28.451861 18317 server_base.cc:1034] running on GCE node
I20260808 02:35:28.452772 18317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:35:28.454252 18317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:35:28.455502 18317 hybrid_clock.cc:648] HybridClock initialized: now 1786156528455443 us; error 35 us; skew 500 ppm
I20260808 02:35:28.455832 18317 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:35:28 dist-test-slave-45dx krb5kdc[16612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156528, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:35:28.466495 18317 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:35:28.468250 18317 webserver.cc:460] Webserver started at http://127.24.116.254:43591/ using document root <none> and password file <none>
I20260808 02:35:28.469053 18317 fs_manager.cc:359] Metadata directory not provided
I20260808 02:35:28.469149 18317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:35:28.474961 18317 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.001s
I20260808 02:35:28.477947 18344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:28.479300 18317 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 02:35:28.479449 18317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "052648b3edf8403bbc395426386bfed3"
format_stamp: "Formatted at 2026-08-08 02:34:42 on dist-test-slave-45dx"
server_key: "64892c016eb5b41e099a080950044fb2"
server_key_iv: "39c2688f48fe1dbf3bd8e2a4d25b1758"
server_key_version: "encryptionkey@0"
I20260808 02:35:28.480468 18317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:35:28.494257 18317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:35:28.498175 18317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:35:28.498411 18317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:35:28.518643 18317 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:35647
I20260808 02:35:28.518700 18421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:35647 every 8 connection(s)
I20260808 02:35:28.520196 18317 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:35:28.522387 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 18317
I20260808 02:35:28.523504 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:45539
--local_ip_for_outbound_sockets=127.24.116.193
--tserver_master_addrs=127.24.116.254:35647
--webserver_port=45057
--webserver_interface=127.24.116.193
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:41277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:35:28.530112 18422 sys_catalog.cc:263] Verifying existing consensus state
I20260808 02:35:28.535303 18422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3: Bootstrap starting.
I20260808 02:35:28.556231 18422 log.cc:824] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3: Log is configured to *not* fsync() on all Append() calls
I20260808 02:35:28.573015 18422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 02:35:28.573624 18422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3: Bootstrap complete.
I20260808 02:35:28.583039 18422 raft_consensus.cc:348] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "052648b3edf8403bbc395426386bfed3" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 35647 } }
I20260808 02:35:28.584067 18422 raft_consensus.cc:729] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 052648b3edf8403bbc395426386bfed3, State: Initialized, Role: FOLLOWER
I20260808 02:35:28.584776 18422 consensus_queue.cc:260] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "052648b3edf8403bbc395426386bfed3" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 35647 } }
I20260808 02:35:28.585027 18422 raft_consensus.cc:388] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:35:28.585160 18422 raft_consensus.cc:482] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:35:28.585381 18422 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 2 FOLLOWER]: Advancing to term 3
I20260808 02:35:28.589373 18422 raft_consensus.cc:504] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "052648b3edf8403bbc395426386bfed3" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 35647 } }
I20260808 02:35:28.589854 18422 leader_election.cc:302] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 052648b3edf8403bbc395426386bfed3; no voters:
I20260808 02:35:28.590560 18422 leader_election.cc:288] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 02:35:28.590710 18427 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 02:35:28.591827 18427 raft_consensus.cc:686] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [term 3 LEADER]: Becoming Leader. State: Replica: 052648b3edf8403bbc395426386bfed3, State: Running, Role: LEADER
I20260808 02:35:28.592530 18427 consensus_queue.cc:237] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "052648b3edf8403bbc395426386bfed3" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 35647 } }
I20260808 02:35:28.593045 18422 sys_catalog.cc:564] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:35:28.595508 18429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "052648b3edf8403bbc395426386bfed3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "052648b3edf8403bbc395426386bfed3" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 35647 } } }
I20260808 02:35:28.595942 18429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [sys.catalog]: This master's current role is: LEADER
I20260808 02:35:28.596562 18433 sys_catalog.cc:455] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 052648b3edf8403bbc395426386bfed3. Latest consensus state: current_term: 3 leader_uuid: "052648b3edf8403bbc395426386bfed3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "052648b3edf8403bbc395426386bfed3" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 35647 } } }
I20260808 02:35:28.596837 18433 sys_catalog.cc:458] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3 [sys.catalog]: This master's current role is: LEADER
I20260808 02:35:28.598410 18445 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:35:28.606642 18445 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:35:28.608165 18445 catalog_manager.cc:1259] Loaded cluster ID: a6dcd7769955443b8d3979cf84c996ee
I20260808 02:35:28.608340 18445 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:35:28.612739 18445 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:35:28.614456 18445 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3: Loaded TSK: 0
I20260808 02:35:28.614676 18445 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 052648b3edf8403bbc395426386bfed3: Loaded TSK: 1
F20260808 02:35:28.615833 18445 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fb3675669ad google::LogMessage::Fail() at ??:0
@ 0x7fb36756988a google::LogMessage::SendToLog() at ??:0
@ 0x7fb3675664de google::LogMessage::Flush() at ??:0
@ 0x7fb367567a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fb36b2ca7d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fb36b2b973e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fb37cf991c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fb37cf98783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fb37d0242a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7fb37d0240c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7fb37d06e5e9 std::function<>::operator()() at ??:0
@ 0x7fb37cf9ccdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fb37cf9ac36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fb37d022610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fb37d022439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fb36a1b2345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fb36a1b591c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fb36a1b5799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fb36a190eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fb36d46a6db start_thread at ??:0
@ 0x7fb36640061f clone at ??:0
W20260808 02:35:28.943152 18424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:35:28.943495 18424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:35:28.943684 18424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:35:28.951308 18424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:35:28.951478 18424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:35:28.951673 18424 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:35:28.962275 18424 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:41277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:45539
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=45057
--tserver_master_addrs=127.24.116.254:35647
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:35:28.963685 18424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:35:28.965124 18424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:35:28.979000 18504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:28.978935 18507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:28.979067 18510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:35:28.980057 18424 server_base.cc:1034] running on GCE node
I20260808 02:35:28.980706 18424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:35:28.981630 18424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:35:28.982903 18424 hybrid_clock.cc:648] HybridClock initialized: now 1786156528982857 us; error 37 us; skew 500 ppm
I20260808 02:35:28.983249 18424 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:35:28 dist-test-slave-45dx krb5kdc[16612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156528, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:35:28.986598 18424 init.cc:377] Logged in from keytab as kudu/127.24.116.193@KRBTEST.COM (short username kudu)
I20260808 02:35:28.988189 18424 webserver.cc:460] Webserver started at http://127.24.116.193:45057/ using document root <none> and password file <none>
I20260808 02:35:28.988955 18424 fs_manager.cc:359] Metadata directory not provided
I20260808 02:35:28.989068 18424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:35:28.994693 18424 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 02:35:28.998108 18519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:28.999478 18424 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 02:35:28.999652 18424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "0d03b79e7a1e43e6b54511367d5d258c"
format_stamp: "Formatted at 2026-08-08 02:34:43 on dist-test-slave-45dx"
server_key: "8a5568cf2b3ecc288aa328cf2e3e4f37"
server_key_iv: "55372bfc8c66f8cfd0240e53fdfafe11"
server_key_version: "encryptionkey@0"
I20260808 02:35:29.000792 18424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:35:29.013890 18424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:35:29.018005 18424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:35:29.018325 18424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:35:29.019359 18424 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:35:29.021278 18529 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260808 02:35:29.027196 18424 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 02:35:29.027349 18424 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.001s
I20260808 02:35:29.027513 18424 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 02:35:29.030773 18424 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 02:35:29.030869 18424 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.000s sys 0.001s
I20260808 02:35:29.031263 18529 tablet_bootstrap.cc:492] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c: Bootstrap starting.
I20260808 02:35:29.040130 18529 log.cc:824] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c: Log is configured to *not* fsync() on all Append() calls
I20260808 02:35:29.057597 18529 tablet_bootstrap.cc:492] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 02:35:29.058573 18529 tablet_bootstrap.cc:492] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c: Bootstrap complete.
I20260808 02:35:29.059324 18529 ts_tablet_manager.cc:1397] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c: Time spent bootstrapping tablet: real 0.028s user 0.027s sys 0.000s
I20260808 02:35:29.070108 18529 raft_consensus.cc:348] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } } peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } }
I20260808 02:35:29.071868 18529 raft_consensus.cc:729] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d03b79e7a1e43e6b54511367d5d258c, State: Initialized, Role: FOLLOWER
I20260808 02:35:29.072737 18529 consensus_queue.cc:260] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } } peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } }
I20260808 02:35:29.074641 18529 ts_tablet_manager.cc:1428] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c: Time spent starting tablet: real 0.015s user 0.006s sys 0.008s
I20260808 02:35:29.077311 18424 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:45539
I20260808 02:35:29.077406 18719 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:45539 every 8 connection(s)
I20260808 02:35:29.078586 18424 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:35:29.083387 18724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:29.081503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.193:40949)
0808 02:35:29.082322 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:29.082550 (+ 228us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":342,"threads_started":1}
W20260808 02:35:29.084028 18720 heartbeater.cc:644] Failed to heartbeat to 127.24.116.254:35647 (0 consecutive failures): Network error: Failed to ping master at 127.24.116.254:35647: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
I20260808 02:35:29.084914 18724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:29.084579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.193:40771)
0808 02:35:29.084733 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:29.084806 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 02:35:29.085788 18724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:29.085450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.193:35753)
0808 02:35:29.085599 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:29.085676 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 02:35:29.086040 18720 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 02:35:29.088719 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 18424
I20260808 02:35:29.089363 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:37589
--local_ip_for_outbound_sockets=127.24.116.194
--tserver_master_addrs=127.24.116.254:35647
--webserver_port=42849
--webserver_interface=127.24.116.194
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:41277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:35:29.443188 18725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:35:29.443475 18725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:35:29.443648 18725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:35:29.450978 18725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:35:29.451098 18725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:35:29.451300 18725 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:35:29.461305 18725 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:41277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:37589
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=42849
--tserver_master_addrs=127.24.116.254:35647
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:35:29.462623 18725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:35:29.463927 18725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:35:29.476660 18732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:29.478832 18733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:29.479176 18741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:35:29.479590 18725 server_base.cc:1034] running on GCE node
I20260808 02:35:29.480232 18725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:35:29.481230 18725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:35:29.482437 18725 hybrid_clock.cc:648] HybridClock initialized: now 1786156529482402 us; error 32 us; skew 500 ppm
I20260808 02:35:29.482717 18725 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:35:29 dist-test-slave-45dx krb5kdc[16612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156529, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:35:29.485843 18725 init.cc:377] Logged in from keytab as kudu/127.24.116.194@KRBTEST.COM (short username kudu)
I20260808 02:35:29.487317 18725 webserver.cc:460] Webserver started at http://127.24.116.194:42849/ using document root <none> and password file <none>
I20260808 02:35:29.488044 18725 fs_manager.cc:359] Metadata directory not provided
I20260808 02:35:29.488196 18725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:35:29.493671 18725 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260808 02:35:29.496536 18754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:29.497895 18725 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 02:35:29.498091 18725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "6aa38a6176104fc88173baa97e5ac8a5"
format_stamp: "Formatted at 2026-08-08 02:34:43 on dist-test-slave-45dx"
server_key: "3717ed2d102faefda7bb263e17c10e51"
server_key_iv: "6c001fc7784987335ba48322a8a00395"
server_key_version: "encryptionkey@0"
I20260808 02:35:29.499104 18725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:35:29.535138 18725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:35:29.539430 18725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:35:29.539729 18725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:35:29.540830 18725 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:35:29.542251 18725 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:35:29.542382 18725 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:29.542538 18725 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:35:29.542629 18725 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:29.577054 18725 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:37589
I20260808 02:35:29.577143 18966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:37589 every 8 connection(s)
I20260808 02:35:29.578590 18725 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:35:29.582947 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 18725
I20260808 02:35:29.583772 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:46237
--local_ip_for_outbound_sockets=127.24.116.195
--tserver_master_addrs=127.24.116.254:35647
--webserver_port=40011
--webserver_interface=127.24.116.195
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:41277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:35:29.584195 18972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:29.581771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.194:42087)
0808 02:35:29.582688 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:29.582998 (+ 310us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":283,"threads_started":1}
W20260808 02:35:29.585024 18968 heartbeater.cc:644] Failed to heartbeat to 127.24.116.254:35647 (0 consecutive failures): Network error: Failed to ping master at 127.24.116.254:35647: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
I20260808 02:35:29.585994 18972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:29.585547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.194:45675)
0808 02:35:29.585740 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:29.585836 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 02:35:29.587147 18972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:29.586717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.194:57435)
0808 02:35:29.586890 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:29.586993 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 02:35:29.587436 18968 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 02:35:29.932461 18975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:35:29.932781 18975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:35:29.932964 18975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:35:29.940512 18975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:35:29.940634 18975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:35:29.940853 18975 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:35:29.950975 18975 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:41277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:46237
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=40011
--tserver_master_addrs=127.24.116.254:35647
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:35:29.952455 18975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:35:29.953820 18975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:35:29.967684 18991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:29.967592 18985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:29.967625 18984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:35:29.968590 18975 server_base.cc:1034] running on GCE node
I20260808 02:35:29.969352 18975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:35:29.970360 18975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:35:29.971606 18975 hybrid_clock.cc:648] HybridClock initialized: now 1786156529971565 us; error 61 us; skew 500 ppm
I20260808 02:35:29.971947 18975 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:35:29 dist-test-slave-45dx krb5kdc[16612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156529, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:35:29.975363 18975 init.cc:377] Logged in from keytab as kudu/127.24.116.195@KRBTEST.COM (short username kudu)
I20260808 02:35:29.976986 18975 webserver.cc:460] Webserver started at http://127.24.116.195:40011/ using document root <none> and password file <none>
I20260808 02:35:29.977648 18975 fs_manager.cc:359] Metadata directory not provided
I20260808 02:35:29.977756 18975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:35:29.983174 18975 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 02:35:29.986011 19003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:29.987375 18975 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 02:35:29.987519 18975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "7bdb6f59f2c6414194c2c36c1886367e"
format_stamp: "Formatted at 2026-08-08 02:34:44 on dist-test-slave-45dx"
server_key: "b13a676e2de8ba7e76ed9a6b35aca1d3"
server_key_iv: "84089b71772e1b29e1d239a8684214b1"
server_key_version: "encryptionkey@0"
I20260808 02:35:29.988528 18975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:35:30.007540 18975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:35:30.012267 18975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:35:30.012760 18975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:35:30.013875 18975 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:35:30.015332 18975 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:35:30.015465 18975 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:30.015605 18975 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:35:30.015705 18975 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:30.051656 18975 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:46237
I20260808 02:35:30.051743 19193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:46237 every 8 connection(s)
I20260808 02:35:30.053239 18975 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:35:30.057102 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 18975
I20260808 02:35:30.058554 19198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:30.056216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.195:41219)
0808 02:35:30.057035 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:30.057357 (+ 322us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":297,"threads_started":1}
W20260808 02:35:30.059322 19194 heartbeater.cc:644] Failed to heartbeat to 127.24.116.254:35647 (0 consecutive failures): Network error: Failed to ping master at 127.24.116.254:35647: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
I20260808 02:35:30.060176 19198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:30.059826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.195:50217)
0808 02:35:30.059995 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:30.060067 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260808 02:35:30.060973 19198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:30.060672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.195:49639)
0808 02:35:30.060794 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:30.060868 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 02:35:30.061198 19194 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 02:35:30.087352 19201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:30.086579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.193:39261)
0808 02:35:30.087048 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:30.087139 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":219,"threads_started":1}
I20260808 02:35:30.588809 19202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:30.587985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.194:55445)
0808 02:35:30.588486 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:30.588577 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":220,"threads_started":1}
I20260808 02:35:30.700896 19203 raft_consensus.cc:482] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:35:30.701265 19203 raft_consensus.cc:504] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } } peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } }
I20260808 02:35:30.703011 19203 leader_election.cc:288] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7bdb6f59f2c6414194c2c36c1886367e (127.24.116.195:46237), 6aa38a6176104fc88173baa97e5ac8a5 (127.24.116.194:37589)
Aug 08 02:35:30 dist-test-slave-45dx krb5kdc[16612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156528, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for kudu/127.24.116.195@KRBTEST.COM
Aug 08 02:35:30 dist-test-slave-45dx krb5kdc[16612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156528, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for kudu/127.24.116.194@KRBTEST.COM
I20260808 02:35:30.736433 19208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:30.703323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:37589 (local address 127.24.116.193:43847)
0808 02:35:30.715826 (+ 12503us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:30.715861 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:30.716225 (+ 364us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:30.718876 (+ 2651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:30.718881 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:30.719820 (+ 939us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:35:30.720697 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:30.720720 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:30.722579 (+ 1859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:30.722583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:30.724058 (+ 1475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:30.724070 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:30.725165 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:30.725174 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:30.725418 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:30.726277 (+ 859us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:35:30.726310 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:35:30.729201 (+ 2891us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:35:30.733272 (+ 4071us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:35:30.733277 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:35:30.733281 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:35:30.733761 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:35:30.734278 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:35:30.734282 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:35:30.734284 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:35:30.734435 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:35:30.735293 (+ 858us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:35:30.735297 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:35:30.735467 (+ 170us) client_negotiation.cc:769] Sending connection context
0808 02:35:30.735595 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 02:35:30.735924 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12318,"mutex_wait_us":158,"spinlock_wait_cycles":107008,"thread_start_us":12070,"threads_started":1}
I20260808 02:35:30.736583 19209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:30.703712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:47197 (local address 127.24.116.195:46237)
0808 02:35:30.715238 (+ 11526us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:30.715258 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:30.715775 (+ 517us) server_negotiation.cc:407] Connection header received
0808 02:35:30.717971 (+ 2196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:30.717981 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:30.718361 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:30.718618 (+ 257us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:30.720946 (+ 2328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:30.722416 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:30.724199 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:30.724889 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:30.725103 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:30.729246 (+ 4143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:30.729254 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:30.729267 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:30.729302 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:30.732337 (+ 3035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:30.733253 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:30.733261 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:30.733267 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:30.733432 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:30.733932 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:30.733937 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:30.733940 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:30.734658 (+ 718us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:30.734863 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:30.735670 (+ 807us) server_negotiation.cc:299] Negotiation successful
0808 02:35:30.736113 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11304,"thread_start_us":11150,"threads_started":1}
I20260808 02:35:30.736708 19212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:30.703767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:43847 (local address 127.24.116.194:37589)
0808 02:35:30.716486 (+ 12719us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:30.716500 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:30.716548 (+ 48us) server_negotiation.cc:407] Connection header received
0808 02:35:30.718193 (+ 1645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:30.718202 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:30.718516 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:30.718879 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:30.720907 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:30.722380 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:30.724217 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:30.724893 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:30.725108 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:30.729473 (+ 4365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:30.729480 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:30.729492 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:30.729532 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:30.732981 (+ 3449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:30.733933 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:30.733941 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:30.733963 (+ 22us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:30.734159 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:30.734563 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:30.734569 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:30.734572 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:30.735163 (+ 591us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:30.735310 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:30.735868 (+ 558us) server_negotiation.cc:299] Negotiation successful
0808 02:35:30.736274 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12501,"thread_start_us":12323,"threads_started":1}
I20260808 02:35:30.736469 19206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:30.703323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:46237 (local address 127.24.116.193:47197)
0808 02:35:30.715467 (+ 12144us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:30.715529 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:30.716201 (+ 672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:30.718824 (+ 2623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:30.718835 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:30.719821 (+ 986us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:35:30.720697 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:30.720739 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:30.722594 (+ 1855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:30.722599 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:30.724053 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:30.724065 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:30.725112 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:30.725118 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:30.725418 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:30.726341 (+ 923us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:35:30.726368 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:35:30.728940 (+ 2572us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:35:30.732496 (+ 3556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:35:30.732505 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:35:30.732518 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:35:30.733081 (+ 563us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:35:30.733556 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:35:30.733561 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:35:30.733565 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:35:30.733808 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:35:30.734801 (+ 993us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:35:30.734807 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:35:30.735075 (+ 268us) client_negotiation.cc:769] Sending connection context
0808 02:35:30.735397 (+ 322us) client_negotiation.cc:240] Negotiation successful
0808 02:35:30.736041 (+ 644us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11904,"mutex_wait_us":312,"spinlock_wait_cycles":5120,"thread_start_us":12485,"threads_started":1}
W20260808 02:35:30.739923 18522 leader_election.cc:341] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7bdb6f59f2c6414194c2c36c1886367e (127.24.116.195:46237): Not found: Tablet not found: 267b61bcbe694a2083e9d081a4df3460
W20260808 02:35:30.740199 18521 leader_election.cc:341] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6aa38a6176104fc88173baa97e5ac8a5 (127.24.116.194:37589): Not found: Tablet not found: 267b61bcbe694a2083e9d081a4df3460
I20260808 02:35:30.740437 18521 leader_election.cc:302] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d03b79e7a1e43e6b54511367d5d258c; no voters: 6aa38a6176104fc88173baa97e5ac8a5, 7bdb6f59f2c6414194c2c36c1886367e
I20260808 02:35:30.740888 19203 raft_consensus.cc:2726] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 02:35:31.062592 19214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:31.061717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.195:38955)
0808 02:35:31.062210 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:31.062357 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":238,"threads_started":1}
I20260808 02:35:31.088866 19206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:31.088438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.193:59749)
0808 02:35:31.088611 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:31.088720 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 02:35:31.590516 19215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:31.589868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.194:56253)
0808 02:35:31.590280 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:31.590361 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":218,"threads_started":1}
I20260808 02:35:32.064169 19219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:32.063484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.195:58865)
0808 02:35:32.063921 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:32.064012 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":245,"threads_started":1}
I20260808 02:35:32.097159 19220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:32.089869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.193:37645)
0808 02:35:32.096787 (+ 6918us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:32.096920 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6788,"thread_start_us":6647,"threads_started":1}
I20260808 02:35:32.295684 19223 raft_consensus.cc:482] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:35:32.295933 19223 raft_consensus.cc:504] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } } peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } }
I20260808 02:35:32.296804 19223 leader_election.cc:288] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7bdb6f59f2c6414194c2c36c1886367e (127.24.116.195:46237), 6aa38a6176104fc88173baa97e5ac8a5 (127.24.116.194:37589)
W20260808 02:35:32.297829 18522 leader_election.cc:341] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7bdb6f59f2c6414194c2c36c1886367e (127.24.116.195:46237): Not found: Tablet not found: 267b61bcbe694a2083e9d081a4df3460
W20260808 02:35:32.298048 18521 leader_election.cc:341] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6aa38a6176104fc88173baa97e5ac8a5 (127.24.116.194:37589): Not found: Tablet not found: 267b61bcbe694a2083e9d081a4df3460
I20260808 02:35:32.298156 18521 leader_election.cc:302] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d03b79e7a1e43e6b54511367d5d258c; no voters: 6aa38a6176104fc88173baa97e5ac8a5, 7bdb6f59f2c6414194c2c36c1886367e
I20260808 02:35:32.298400 19223 raft_consensus.cc:2726] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 02:35:32.592484 19224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:32.591585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.194:55357)
0808 02:35:32.592102 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:32.592188 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":298,"threads_started":1}
I20260808 02:35:33.065936 19225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:33.065136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.195:53473)
0808 02:35:33.065637 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:33.065730 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":249,"threads_started":1}
I20260808 02:35:33.099097 19226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:33.098286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.193:45723)
0808 02:35:33.098825 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:33.098911 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":316,"threads_started":1}
I20260808 02:35:33.594296 19231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:33.593464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.194:47575)
0808 02:35:33.594010 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:33.594104 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":291,"threads_started":1}
I20260808 02:35:34.067695 19232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:34.066964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.195:43955)
0808 02:35:34.067413 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:34.067502 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":219,"threads_started":1}
I20260808 02:35:34.100942 19234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:34.100109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.193:38523)
0808 02:35:34.100630 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:34.100723 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":271,"threads_started":1}
I20260808 02:35:34.169171 19236 raft_consensus.cc:482] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:35:34.169361 19236 raft_consensus.cc:504] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } } peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } }
I20260808 02:35:34.170024 19236 leader_election.cc:288] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7bdb6f59f2c6414194c2c36c1886367e (127.24.116.195:46237), 6aa38a6176104fc88173baa97e5ac8a5 (127.24.116.194:37589)
W20260808 02:35:34.170981 18522 leader_election.cc:341] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7bdb6f59f2c6414194c2c36c1886367e (127.24.116.195:46237): Not found: Tablet not found: 267b61bcbe694a2083e9d081a4df3460
W20260808 02:35:34.171217 18521 leader_election.cc:341] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6aa38a6176104fc88173baa97e5ac8a5 (127.24.116.194:37589): Not found: Tablet not found: 267b61bcbe694a2083e9d081a4df3460
I20260808 02:35:34.171367 18521 leader_election.cc:302] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d03b79e7a1e43e6b54511367d5d258c; no voters: 6aa38a6176104fc88173baa97e5ac8a5, 7bdb6f59f2c6414194c2c36c1886367e
I20260808 02:35:34.171643 19236 raft_consensus.cc:2726] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 02:35:34.596105 19239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:34.595328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.194:35365)
0808 02:35:34.595849 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:34.595937 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":283,"threads_started":1}
I20260808 02:35:35.069844 19240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:35.068867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.195:40859)
0808 02:35:35.069448 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:35.069562 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":283,"threads_started":1}
I20260808 02:35:35.102912 19245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:35.102005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.193:40365)
0808 02:35:35.102523 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:35.102662 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":242,"threads_started":1}
I20260808 02:35:35.597783 19246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:35.597037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.194:44003)
0808 02:35:35.597515 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:35.597597 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":240,"threads_started":1}
I20260808 02:35:36.071599 19247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:36.070811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.195:53341)
0808 02:35:36.071312 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:36.071411 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":265,"threads_started":1}
I20260808 02:35:36.104944 19248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:36.104053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.193:60849)
0808 02:35:36.104636 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:36.104736 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":317,"threads_started":1}
I20260808 02:35:36.599813 19250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:36.598806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.194:51573)
0808 02:35:36.599418 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:36.599515 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":262,"threads_started":1}
I20260808 02:35:37.073624 19251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:37.072842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.195:40999)
0808 02:35:37.073343 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:37.073424 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":235,"threads_started":1}
I20260808 02:35:37.106746 19252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:37.105971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.193:39829)
0808 02:35:37.106489 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:37.106572 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":282,"threads_started":1}
I20260808 02:35:37.601526 19254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:37.600810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.194:44081)
0808 02:35:37.601248 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:37.601342 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":235,"threads_started":1}
I20260808 02:35:38.075485 19255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:38.074662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.195:47257)
0808 02:35:38.075191 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:38.075285 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":301,"threads_started":1}
I20260808 02:35:38.108628 19256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:38.107769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.193:34741)
0808 02:35:38.108278 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:38.108434 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":256,"threads_started":1}
I20260808 02:35:38.603240 19257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:38.602476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.194:52293)
0808 02:35:38.602993 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:38.603083 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":257,"threads_started":1}
I20260808 02:35:38.761935 19259 raft_consensus.cc:482] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:35:38.762140 19259 raft_consensus.cc:504] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } } peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } }
I20260808 02:35:38.762758 19259 leader_election.cc:288] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7bdb6f59f2c6414194c2c36c1886367e (127.24.116.195:46237), 6aa38a6176104fc88173baa97e5ac8a5 (127.24.116.194:37589)
W20260808 02:35:38.763967 18521 leader_election.cc:341] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6aa38a6176104fc88173baa97e5ac8a5 (127.24.116.194:37589): Not found: Tablet not found: 267b61bcbe694a2083e9d081a4df3460
W20260808 02:35:38.764176 18522 leader_election.cc:341] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7bdb6f59f2c6414194c2c36c1886367e (127.24.116.195:46237): Not found: Tablet not found: 267b61bcbe694a2083e9d081a4df3460
I20260808 02:35:38.764408 18522 leader_election.cc:302] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d03b79e7a1e43e6b54511367d5d258c; no voters: 6aa38a6176104fc88173baa97e5ac8a5, 7bdb6f59f2c6414194c2c36c1886367e
I20260808 02:35:38.764693 19259 raft_consensus.cc:2726] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 02:35:39.077581 19262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:39.076580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.195:45107)
0808 02:35:39.077319 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:39.077405 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":362,"threads_started":1}
I20260808 02:35:39.110697 19264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:39.109670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.193:55225)
0808 02:35:39.110363 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:39.110480 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":294,"threads_started":1}
I20260808 02:35:39.605384 19265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:39.604436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.194:47861)
0808 02:35:39.605021 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:39.605161 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":323,"threads_started":1}
I20260808 02:35:40.079326 19269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:40.078538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.195:44593)
0808 02:35:40.079032 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:40.079125 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":270,"threads_started":1}
I20260808 02:35:40.112556 19270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:40.111673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.193:33653)
0808 02:35:40.112200 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:40.112300 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":311,"threads_started":1}
I20260808 02:35:40.607088 19271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:40.606338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.194:36437)
0808 02:35:40.606794 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:40.606920 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":234,"threads_started":1}
I20260808 02:35:41.081205 19272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:41.080453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.195:57957)
0808 02:35:41.080934 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:41.081044 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":239,"threads_started":1}
I20260808 02:35:41.114295 19274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:41.113501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.193:41079)
0808 02:35:41.113996 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:41.114094 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":254,"threads_started":1}
I20260808 02:35:41.608969 19275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:41.608116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.194:36851)
0808 02:35:41.608662 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:41.608762 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":309,"threads_started":1}
I20260808 02:35:42.082917 19276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:42.082197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.195:52685)
0808 02:35:42.082663 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:42.082749 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":253,"threads_started":1}
I20260808 02:35:42.116074 19277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:42.115220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.193:36529)
0808 02:35:42.115724 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:42.115862 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":262,"threads_started":1}
I20260808 02:35:42.610714 19278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:42.609968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.194:55157)
0808 02:35:42.610434 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:42.610527 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":234,"threads_started":1}
I20260808 02:35:43.084887 19279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:43.083949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.195:59651)
0808 02:35:43.084533 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:43.084663 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":255,"threads_started":1}
I20260808 02:35:43.118041 19280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:43.117189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.193:58989)
0808 02:35:43.117684 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:43.117833 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":266,"threads_started":1}
I20260808 02:35:43.612768 19281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:43.611745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.194:43895)
0808 02:35:43.612382 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:43.612497 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":328,"threads_started":1}
I20260808 02:35:44.086565 19283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:44.085834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.195:38915)
0808 02:35:44.086270 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:44.086361 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":223,"threads_started":1}
I20260808 02:35:44.120129 19284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:44.119351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.193:46495)
0808 02:35:44.119817 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:44.119919 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":225,"threads_started":1}
I20260808 02:35:44.614692 19285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:44.613914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.194:41247)
0808 02:35:44.614413 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:44.614512 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":244,"threads_started":1}
I20260808 02:35:44.727890 19288 raft_consensus.cc:482] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:35:44.728157 19288 raft_consensus.cc:504] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bdb6f59f2c6414194c2c36c1886367e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 46237 } } peers { permanent_uuid: "0d03b79e7a1e43e6b54511367d5d258c" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 45539 } } peers { permanent_uuid: "6aa38a6176104fc88173baa97e5ac8a5" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 37589 } }
I20260808 02:35:44.729013 19288 leader_election.cc:288] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7bdb6f59f2c6414194c2c36c1886367e (127.24.116.195:46237), 6aa38a6176104fc88173baa97e5ac8a5 (127.24.116.194:37589)
W20260808 02:35:44.730185 18521 leader_election.cc:341] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6aa38a6176104fc88173baa97e5ac8a5 (127.24.116.194:37589): Not found: Tablet not found: 267b61bcbe694a2083e9d081a4df3460
W20260808 02:35:44.730419 18522 leader_election.cc:341] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7bdb6f59f2c6414194c2c36c1886367e (127.24.116.195:46237): Not found: Tablet not found: 267b61bcbe694a2083e9d081a4df3460
I20260808 02:35:44.730553 18522 leader_election.cc:302] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d03b79e7a1e43e6b54511367d5d258c; no voters: 6aa38a6176104fc88173baa97e5ac8a5, 7bdb6f59f2c6414194c2c36c1886367e
I20260808 02:35:44.730819 19288 raft_consensus.cc:2726] T 267b61bcbe694a2083e9d081a4df3460 P 0d03b79e7a1e43e6b54511367d5d258c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 02:35:45.061869 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 18424
I20260808 02:35:45.079185 19289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:45.063153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57204 (local address 127.24.116.193:45539)
0808 02:35:45.063901 (+ 748us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:45.063914 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:45.063952 (+ 38us) server_negotiation.cc:407] Connection header received
0808 02:35:45.064046 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:45.064057 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:45.064432 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:45.064592 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:45.066487 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:45.067535 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:45.069009 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:45.069599 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:45.069698 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:45.072905 (+ 3207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:45.072918 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:45.072933 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:45.072968 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:45.075928 (+ 2960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:45.076758 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:45.076775 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:45.076778 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:45.076933 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:45.077355 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:45.077359 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:45.077361 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:45.077734 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:45.078093 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:45.078398 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 02:35:45.078690 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527,"thread_start_us":327,"threads_started":1}
I20260808 02:35:45.080731 18713 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:35:45.088775 19294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:45.087848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:35647 (local address 127.24.116.195:60401)
0808 02:35:45.088468 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:45.088610 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.254:35647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":303,"threads_started":1}
I20260808 02:35:45.172902 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 18424
I20260808 02:35:45.203363 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 18725
I20260808 02:35:45.218523 19297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:45.204254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54062 (local address 127.24.116.194:37589)
0808 02:35:45.204849 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:45.204853 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:45.204871 (+ 18us) server_negotiation.cc:407] Connection header received
0808 02:35:45.204933 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:45.204936 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:45.204999 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:45.205092 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:45.206625 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:45.207518 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:45.209273 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:45.209746 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:45.209885 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:45.212784 (+ 2899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:45.212791 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:45.212794 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:45.212842 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:45.215783 (+ 2941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:45.216640 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:45.216645 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:45.216647 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:45.216803 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:45.217218 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:45.217221 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:45.217223 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:45.217509 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:45.217760 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:45.218015 (+ 255us) server_negotiation.cc:299] Negotiation successful
0808 02:35:45.218200 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":320,"threads_started":1}
I20260808 02:35:45.219390 18961 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:35:45.306981 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 18725
I20260808 02:35:45.336736 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 18975
I20260808 02:35:45.351238 19300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:45.337646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60776 (local address 127.24.116.195:46237)
0808 02:35:45.338308 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:45.338312 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:45.338331 (+ 19us) server_negotiation.cc:407] Connection header received
0808 02:35:45.338389 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:45.338392 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:45.338462 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:45.338555 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:45.340092 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:45.341104 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:45.342375 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:45.342835 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:45.342941 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:45.345637 (+ 2696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:45.345642 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:45.345646 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:45.345678 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:45.348689 (+ 3011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:45.349383 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:45.349387 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:45.349390 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:45.349566 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:45.349961 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:45.349964 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:45.349967 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:45.350238 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:45.350460 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:45.350704 (+ 244us) server_negotiation.cc:299] Negotiation successful
0808 02:35:45.350940 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":373,"threads_started":1}
I20260808 02:35:45.352077 19185 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:35:45.438452 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 18975
2026-08-08T02:35:45Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (65181 ms)
[----------] 30 tests from SecurityITest (313356 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:35:45 dist-test-slave-45dx krb5kdc[19306](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:35:45 dist-test-slave-45dx krb5kdc[19306](info): set up 2 sockets
Aug 08 02:35:45 dist-test-slave-45dx krb5kdc[19306](info): commencing operation
krb5kdc: starting...
W20260808 02:35:46.812168 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.318s user 0.004s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:35:47 dist-test-slave-45dx krb5kdc[19306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156547, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:35:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:35:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:35:47.154470 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:37755
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:38373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:37755
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:35:47.524627 19328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:35:47.524994 19328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:35:47.525158 19328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:35:47.532740 19328 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:35:47.532897 19328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:35:47.533003 19328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:35:47.533108 19328 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:35:47.533188 19328 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:35:47.543490 19328 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:38373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:37755
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:37755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:35:47.544988 19328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:35:47.546353 19328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:35:47.558977 19340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:47.558996 19341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:47.559814 19344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:35:47.559813 19328 server_base.cc:1034] running on GCE node
I20260808 02:35:47.560824 19328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:35:47.562314 19328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:35:47.563529 19328 hybrid_clock.cc:648] HybridClock initialized: now 1786156547563484 us; error 28 us; skew 500 ppm
I20260808 02:35:47.563908 19328 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:35:47 dist-test-slave-45dx krb5kdc[19306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156547, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:35:47.571615 19328 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:35:47.573679 19328 webserver.cc:460] Webserver started at http://127.24.116.254:35687/ using document root <none> and password file <none>
I20260808 02:35:47.574558 19328 fs_manager.cc:359] Metadata directory not provided
I20260808 02:35:47.574679 19328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:35:47.574978 19328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:35:47.578357 19328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "a61791df6c8f4318a4291ed9e89e94e8"
format_stamp: "Formatted at 2026-08-08 02:35:47 on dist-test-slave-45dx"
server_key: "b01ad135fa0cd62ed8faf81668b8f0bb"
server_key_iv: "e2d063fb7dbc5fafc728bb9ba6ea2888"
server_key_version: "encryptionkey@0"
I20260808 02:35:47.579109 19328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "a61791df6c8f4318a4291ed9e89e94e8"
format_stamp: "Formatted at 2026-08-08 02:35:47 on dist-test-slave-45dx"
server_key: "b01ad135fa0cd62ed8faf81668b8f0bb"
server_key_iv: "e2d063fb7dbc5fafc728bb9ba6ea2888"
server_key_version: "encryptionkey@0"
I20260808 02:35:47.584707 19328 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260808 02:35:47.588488 19362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:47.589915 19328 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:35:47.590107 19328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "a61791df6c8f4318a4291ed9e89e94e8"
format_stamp: "Formatted at 2026-08-08 02:35:47 on dist-test-slave-45dx"
server_key: "b01ad135fa0cd62ed8faf81668b8f0bb"
server_key_iv: "e2d063fb7dbc5fafc728bb9ba6ea2888"
server_key_version: "encryptionkey@0"
I20260808 02:35:47.590320 19328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:35:47.616478 19328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:35:47.621112 19328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:35:47.621486 19328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:35:47.641532 19328 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:37755
I20260808 02:35:47.641571 19444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:37755 every 8 connection(s)
I20260808 02:35:47.643036 19328 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:35:47.646955 19446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:35:47.649245 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 19328
I20260808 02:35:47.649482 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:35:47.650138 25043 external_mini_cluster.cc:1428] Setting key 9a30fb1fd026fc04f2d0d23c4292da91
I20260808 02:35:47.659361 19446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a61791df6c8f4318a4291ed9e89e94e8: Bootstrap starting.
I20260808 02:35:47.663409 19446 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a61791df6c8f4318a4291ed9e89e94e8: Neither blocks nor log segments found. Creating new log.
I20260808 02:35:47.664902 19446 log.cc:824] T 00000000000000000000000000000000 P a61791df6c8f4318a4291ed9e89e94e8: Log is configured to *not* fsync() on all Append() calls
Aug 08 02:35:47 dist-test-slave-45dx krb5kdc[19306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156547, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:35:47.668607 19446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a61791df6c8f4318a4291ed9e89e94e8: No bootstrap required, opened a new log
I20260808 02:35:47.675647 19451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:47.652204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45120 (local address 127.24.116.254:37755)
0808 02:35:47.653092 (+ 888us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:47.653103 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:47.653144 (+ 41us) server_negotiation.cc:407] Connection header received
0808 02:35:47.654851 (+ 1707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:47.654874 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:47.655256 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:47.655595 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:47.657627 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:47.658961 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:47.660925 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:47.661593 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:47.661719 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:47.667358 (+ 5639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:47.667366 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:47.667382 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:47.667425 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:47.670887 (+ 3462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:47.671945 (+ 1058us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:47.671953 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:47.671960 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:47.672139 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:47.672647 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:47.672650 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:47.672652 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:47.673249 (+ 597us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:47.673496 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:47.674054 (+ 558us) server_negotiation.cc:299] Negotiation successful
0808 02:35:47.674478 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":676,"thread_start_us":391,"threads_started":1}
I20260808 02:35:47.678581 19446 raft_consensus.cc:348] T 00000000000000000000000000000000 P a61791df6c8f4318a4291ed9e89e94e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a61791df6c8f4318a4291ed9e89e94e8" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 37755 } }
I20260808 02:35:47.679140 19446 raft_consensus.cc:374] T 00000000000000000000000000000000 P a61791df6c8f4318a4291ed9e89e94e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:35:47.679260 19446 raft_consensus.cc:729] T 00000000000000000000000000000000 P a61791df6c8f4318a4291ed9e89e94e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a61791df6c8f4318a4291ed9e89e94e8, State: Initialized, Role: FOLLOWER
I20260808 02:35:47.679823 19446 consensus_queue.cc:260] T 00000000000000000000000000000000 P a61791df6c8f4318a4291ed9e89e94e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a61791df6c8f4318a4291ed9e89e94e8" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 37755 } }
I20260808 02:35:47.680054 19446 raft_consensus.cc:388] T 00000000000000000000000000000000 P a61791df6c8f4318a4291ed9e89e94e8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:35:47.680152 19446 raft_consensus.cc:482] T 00000000000000000000000000000000 P a61791df6c8f4318a4291ed9e89e94e8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:35:47.680276 19446 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a61791df6c8f4318a4291ed9e89e94e8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:35:47.683099 19446 raft_consensus.cc:504] T 00000000000000000000000000000000 P a61791df6c8f4318a4291ed9e89e94e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a61791df6c8f4318a4291ed9e89e94e8" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 37755 } }
I20260808 02:35:47.683589 19446 leader_election.cc:302] T 00000000000000000000000000000000 P a61791df6c8f4318a4291ed9e89e94e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a61791df6c8f4318a4291ed9e89e94e8; no voters:
I20260808 02:35:47.684237 19446 leader_election.cc:288] T 00000000000000000000000000000000 P a61791df6c8f4318a4291ed9e89e94e8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:35:47.684455 19454 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a61791df6c8f4318a4291ed9e89e94e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:35:47.686578 19446 sys_catalog.cc:564] T 00000000000000000000000000000000 P a61791df6c8f4318a4291ed9e89e94e8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:35:47.687012 19454 raft_consensus.cc:686] T 00000000000000000000000000000000 P a61791df6c8f4318a4291ed9e89e94e8 [term 1 LEADER]: Becoming Leader. State: Replica: a61791df6c8f4318a4291ed9e89e94e8, State: Running, Role: LEADER
I20260808 02:35:47.687589 19454 consensus_queue.cc:237] T 00000000000000000000000000000000 P a61791df6c8f4318a4291ed9e89e94e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a61791df6c8f4318a4291ed9e89e94e8" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 37755 } }
I20260808 02:35:47.691095 19455 sys_catalog.cc:455] T 00000000000000000000000000000000 P a61791df6c8f4318a4291ed9e89e94e8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a61791df6c8f4318a4291ed9e89e94e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a61791df6c8f4318a4291ed9e89e94e8" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 37755 } } }
I20260808 02:35:47.691371 19456 sys_catalog.cc:455] T 00000000000000000000000000000000 P a61791df6c8f4318a4291ed9e89e94e8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a61791df6c8f4318a4291ed9e89e94e8. Latest consensus state: current_term: 1 leader_uuid: "a61791df6c8f4318a4291ed9e89e94e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a61791df6c8f4318a4291ed9e89e94e8" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 37755 } } }
I20260808 02:35:47.691656 19456 sys_catalog.cc:458] T 00000000000000000000000000000000 P a61791df6c8f4318a4291ed9e89e94e8 [sys.catalog]: This master's current role is: LEADER
I20260808 02:35:47.691558 19455 sys_catalog.cc:458] T 00000000000000000000000000000000 P a61791df6c8f4318a4291ed9e89e94e8 [sys.catalog]: This master's current role is: LEADER
I20260808 02:35:47.695250 19464 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:35:47.700596 19464 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:35:47.710048 19464 catalog_manager.cc:1347] Generated new cluster ID: 482a907a0f814243ae9875a94a3c9043
I20260808 02:35:47.710239 19464 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:35:47.719286 19464 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:35:47.721292 19464 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:35:47.735906 19464 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a61791df6c8f4318a4291ed9e89e94e8: Generated new TSK 0
I20260808 02:35:47.736840 19464 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.116.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
I20260808 02:35:47.817027 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:37755
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:38373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:35:48.186501 19480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:35:48.186919 19480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:35:48.187124 19480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:35:48.195343 19480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:35:48.195525 19480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:35:48.195711 19480 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:35:48.206211 19480 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:38373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:37755
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:35:48.207630 19480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:35:48.209101 19480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:35:48.223057 19488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:48.223181 19494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:48.223407 19497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:35:48.224247 19480 server_base.cc:1034] running on GCE node
I20260808 02:35:48.224953 19480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:35:48.225955 19480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:35:48.227176 19480 hybrid_clock.cc:648] HybridClock initialized: now 1786156548227127 us; error 40 us; skew 500 ppm
I20260808 02:35:48.227504 19480 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:35:48 dist-test-slave-45dx krb5kdc[19306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156548, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:35:48.230844 19480 init.cc:377] Logged in from keytab as kudu/127.24.116.193@KRBTEST.COM (short username kudu)
I20260808 02:35:48.232553 19480 webserver.cc:460] Webserver started at http://127.24.116.193:37571/ using document root <none> and password file <none>
I20260808 02:35:48.233322 19480 fs_manager.cc:359] Metadata directory not provided
I20260808 02:35:48.233433 19480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:35:48.233747 19480 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:35:48.237172 19480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "7da4a6f4b9ce43879b0b02b8ae642b2d"
format_stamp: "Formatted at 2026-08-08 02:35:48 on dist-test-slave-45dx"
server_key: "47bd56a93b2fe78b9f27fa9a95236c33"
server_key_iv: "ff877636b2f169ec0cd5790c857e0980"
server_key_version: "encryptionkey@0"
I20260808 02:35:48.238080 19480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "7da4a6f4b9ce43879b0b02b8ae642b2d"
format_stamp: "Formatted at 2026-08-08 02:35:48 on dist-test-slave-45dx"
server_key: "47bd56a93b2fe78b9f27fa9a95236c33"
server_key_iv: "ff877636b2f169ec0cd5790c857e0980"
server_key_version: "encryptionkey@0"
I20260808 02:35:48.243855 19480 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 02:35:48.247735 19510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:48.249363 19480 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 02:35:48.249516 19480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "7da4a6f4b9ce43879b0b02b8ae642b2d"
format_stamp: "Formatted at 2026-08-08 02:35:48 on dist-test-slave-45dx"
server_key: "47bd56a93b2fe78b9f27fa9a95236c33"
server_key_iv: "ff877636b2f169ec0cd5790c857e0980"
server_key_version: "encryptionkey@0"
I20260808 02:35:48.249701 19480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:35:48.275071 19480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:35:48.279508 19480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:35:48.279767 19480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:35:48.280867 19480 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:35:48.282294 19480 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:35:48.282373 19480 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:48.282461 19480 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:35:48.282507 19480 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:48.318068 19480 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:43303
I20260808 02:35:48.318230 19686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:43303 every 8 connection(s)
I20260808 02:35:48.319518 19480 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:35:48.323014 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 19480
I20260808 02:35:48.323287 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:35:48.324370 25043 external_mini_cluster.cc:1428] Setting key 6d977c831105cda1b50dd0b0bf094619
Aug 08 02:35:48 dist-test-slave-45dx krb5kdc[19306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156548, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:35:48.346529 19692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:48.322403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:60067 (local address 127.24.116.254:37755)
0808 02:35:48.322990 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:48.322997 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:48.324231 (+ 1234us) server_negotiation.cc:407] Connection header received
0808 02:35:48.327231 (+ 3000us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:48.327235 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:48.327304 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:48.327410 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:48.330004 (+ 2594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:48.330732 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:48.333621 (+ 2889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:48.334067 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:48.334177 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:48.339570 (+ 5393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:48.339575 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:48.339579 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:48.339615 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:48.342469 (+ 2854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:48.343578 (+ 1109us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:48.343587 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:48.343591 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:48.343763 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:48.344258 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:48.344265 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:48.344270 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:48.344705 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:48.344911 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:48.345738 (+ 827us) server_negotiation.cc:299] Negotiation successful
0808 02:35:48.346027 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":283,"threads_started":1}
I20260808 02:35:48.347229 19695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:48.322940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:37755 (local address 127.24.116.193:60067)
0808 02:35:48.324003 (+ 1063us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:48.324067 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:48.326858 (+ 2791us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:48.327741 (+ 883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:48.327755 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:48.328750 (+ 995us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:35:48.329757 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:48.329802 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:48.330912 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:48.330921 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:48.333421 (+ 2500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:48.333444 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:48.334350 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:48.334362 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:48.334761 (+ 399us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:48.335700 (+ 939us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:35:48.335741 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:35:48.339267 (+ 3526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:35:48.342642 (+ 3375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:35:48.342656 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:35:48.342680 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:35:48.343421 (+ 741us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:35:48.343903 (+ 482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:35:48.343907 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:35:48.343909 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:35:48.344123 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:35:48.344903 (+ 780us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:35:48.344911 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:35:48.345274 (+ 363us) client_negotiation.cc:769] Sending connection context
0808 02:35:48.345564 (+ 290us) client_negotiation.cc:240] Negotiation successful
0808 02:35:48.346008 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"thread_start_us":369,"threads_started":1}
I20260808 02:35:48.348913 19690 heartbeater.cc:347] Connected to a master server at 127.24.116.254:37755
I20260808 02:35:48.349272 19690 heartbeater.cc:464] Registering TS with master...
I20260808 02:35:48.350039 19690 heartbeater.cc:511] Master 127.24.116.254:37755 requested a full tablet report, sending...
I20260808 02:35:48.352385 19391 ts_manager.cc:194] Registered new tserver with Master: 7da4a6f4b9ce43879b0b02b8ae642b2d (127.24.116.193:43303)
I20260808 02:35:48.354240 19391 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.193@KRBTEST.COM'} at 127.24.116.193:60067
WARNING: no policy specified for kudu/127.24.116.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
I20260808 02:35:48.402256 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:37755
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:38373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:35:48.757664 19699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:35:48.757944 19699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:35:48.758040 19699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:35:48.765396 19699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:35:48.765515 19699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:35:48.765630 19699 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:35:48.775821 19699 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:38373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:37755
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:35:48.777276 19699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:35:48.778565 19699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:35:48.792171 19710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:48.792183 19707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:48.792064 19708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:35:48.793048 19699 server_base.cc:1034] running on GCE node
I20260808 02:35:48.793699 19699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:35:48.794746 19699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:35:48.795985 19699 hybrid_clock.cc:648] HybridClock initialized: now 1786156548795944 us; error 34 us; skew 500 ppm
I20260808 02:35:48.796391 19699 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:35:48 dist-test-slave-45dx krb5kdc[19306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156548, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:35:48.799621 19699 init.cc:377] Logged in from keytab as kudu/127.24.116.194@KRBTEST.COM (short username kudu)
I20260808 02:35:48.801189 19699 webserver.cc:460] Webserver started at http://127.24.116.194:37465/ using document root <none> and password file <none>
I20260808 02:35:48.801860 19699 fs_manager.cc:359] Metadata directory not provided
I20260808 02:35:48.801965 19699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:35:48.802246 19699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:35:48.805248 19699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "6ee01a7a442b406389a1a8ccf350f936"
format_stamp: "Formatted at 2026-08-08 02:35:48 on dist-test-slave-45dx"
server_key: "f099f8088f72bf783aa126bede449175"
server_key_iv: "ba5583c3b63f0bd7a62cc425d12178de"
server_key_version: "encryptionkey@0"
I20260808 02:35:48.805969 19699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "6ee01a7a442b406389a1a8ccf350f936"
format_stamp: "Formatted at 2026-08-08 02:35:48 on dist-test-slave-45dx"
server_key: "f099f8088f72bf783aa126bede449175"
server_key_iv: "ba5583c3b63f0bd7a62cc425d12178de"
server_key_version: "encryptionkey@0"
I20260808 02:35:48.811383 19699 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 02:35:48.814893 19722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:48.816201 19699 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 02:35:48.816434 19699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "6ee01a7a442b406389a1a8ccf350f936"
format_stamp: "Formatted at 2026-08-08 02:35:48 on dist-test-slave-45dx"
server_key: "f099f8088f72bf783aa126bede449175"
server_key_iv: "ba5583c3b63f0bd7a62cc425d12178de"
server_key_version: "encryptionkey@0"
I20260808 02:35:48.816650 19699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:35:48.832764 19699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:35:48.836911 19699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:35:48.837212 19699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:35:48.838326 19699 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:35:48.839716 19699 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:35:48.839792 19699 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:48.840001 19699 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:35:48.840055 19699 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:48.876091 19699 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:38109
I20260808 02:35:48.876137 19905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:38109 every 8 connection(s)
I20260808 02:35:48.877599 19699 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:35:48.878934 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 19699
I20260808 02:35:48.879164 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:35:48.879819 25043 external_mini_cluster.cc:1428] Setting key dab3d222a5589552108b0c94f46ebb5f
Aug 08 02:35:48 dist-test-slave-45dx krb5kdc[19306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156548, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:35:48.902966 19908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:48.880604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:59207 (local address 127.24.116.254:37755)
0808 02:35:48.881167 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:48.881172 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:48.882144 (+ 972us) server_negotiation.cc:407] Connection header received
0808 02:35:48.885070 (+ 2926us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:48.885075 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:48.885140 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:48.885226 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:48.887465 (+ 2239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:48.888383 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:48.890878 (+ 2495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:48.891310 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:48.891425 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:48.896282 (+ 4857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:48.896291 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:48.896298 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:48.896371 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:48.899373 (+ 3002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:48.900152 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:48.900160 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:48.900166 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:48.900381 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:48.900826 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:48.900834 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:48.900841 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:48.901258 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:48.901417 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:48.902167 (+ 750us) server_negotiation.cc:299] Negotiation successful
0808 02:35:48.902450 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":1134,"threads_started":1}
I20260808 02:35:48.903581 19909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:48.881150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:37755 (local address 127.24.116.194:59207)
0808 02:35:48.881997 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:48.882036 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:48.884737 (+ 2701us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:48.885518 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:48.885531 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:48.886335 (+ 804us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:35:48.887215 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:48.887243 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:48.888551 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:48.888559 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:48.890712 (+ 2153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:48.890730 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:48.891576 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:48.891585 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:48.891916 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:48.892778 (+ 862us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:35:48.892813 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:35:48.896013 (+ 3200us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:35:48.899525 (+ 3512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:35:48.899533 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:35:48.899547 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:35:48.900005 (+ 458us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:35:48.900502 (+ 497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:35:48.900506 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:35:48.900508 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:35:48.900708 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:35:48.901401 (+ 693us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:35:48.901408 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:35:48.901760 (+ 352us) client_negotiation.cc:769] Sending connection context
0808 02:35:48.902002 (+ 242us) client_negotiation.cc:240] Negotiation successful
0808 02:35:48.902416 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":303,"threads_started":1}
I20260808 02:35:48.905213 19906 heartbeater.cc:347] Connected to a master server at 127.24.116.254:37755
I20260808 02:35:48.905575 19906 heartbeater.cc:464] Registering TS with master...
I20260808 02:35:48.906527 19906 heartbeater.cc:511] Master 127.24.116.254:37755 requested a full tablet report, sending...
I20260808 02:35:48.908386 19391 ts_manager.cc:194] Registered new tserver with Master: 6ee01a7a442b406389a1a8ccf350f936 (127.24.116.194:38109)
I20260808 02:35:48.909233 19391 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.194@KRBTEST.COM'} at 127.24.116.194:59207
WARNING: no policy specified for kudu/127.24.116.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
I20260808 02:35:48.957561 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:37755
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:38373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:35:49.312676 19913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:35:49.313059 19913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:35:49.313246 19913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:35:49.320643 19913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:35:49.320803 19913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:35:49.321002 19913 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:35:49.330986 19913 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:38373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:37755
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:35:49.332196 19913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:35:49.333575 19913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:35:49.347998 19931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:49.348098 19926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:49.348085 19923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:35:49.349179 19913 server_base.cc:1034] running on GCE node
I20260808 02:35:49.349900 19913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:35:49.350955 19913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:35:49.352170 19913 hybrid_clock.cc:648] HybridClock initialized: now 1786156549352101 us; error 58 us; skew 500 ppm
I20260808 02:35:49.352566 19913 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:35:49 dist-test-slave-45dx krb5kdc[19306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156549, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:35:49.355947 19913 init.cc:377] Logged in from keytab as kudu/127.24.116.195@KRBTEST.COM (short username kudu)
I20260808 02:35:49.357302 19690 heartbeater.cc:503] Master 127.24.116.254:37755 was elected leader, sending a full tablet report...
I20260808 02:35:49.357756 19913 webserver.cc:460] Webserver started at http://127.24.116.195:39331/ using document root <none> and password file <none>
I20260808 02:35:49.358543 19913 fs_manager.cc:359] Metadata directory not provided
I20260808 02:35:49.358706 19913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:35:49.359076 19913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:35:49.362365 19913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "3ddd24796e84484f882ae67fe4bfb57e"
format_stamp: "Formatted at 2026-08-08 02:35:49 on dist-test-slave-45dx"
server_key: "0ef6614b6a8ee05853b288f834348c87"
server_key_iv: "66be87a6c1879de83c19cbcead7e0db6"
server_key_version: "encryptionkey@0"
I20260808 02:35:49.363169 19913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "3ddd24796e84484f882ae67fe4bfb57e"
format_stamp: "Formatted at 2026-08-08 02:35:49 on dist-test-slave-45dx"
server_key: "0ef6614b6a8ee05853b288f834348c87"
server_key_iv: "66be87a6c1879de83c19cbcead7e0db6"
server_key_version: "encryptionkey@0"
I20260808 02:35:49.368800 19913 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 02:35:49.372830 19940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:49.374222 19913 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 02:35:49.374414 19913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "3ddd24796e84484f882ae67fe4bfb57e"
format_stamp: "Formatted at 2026-08-08 02:35:49 on dist-test-slave-45dx"
server_key: "0ef6614b6a8ee05853b288f834348c87"
server_key_iv: "66be87a6c1879de83c19cbcead7e0db6"
server_key_version: "encryptionkey@0"
I20260808 02:35:49.374634 19913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:35:49.388408 19913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:35:49.393183 19913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:35:49.393501 19913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:35:49.394680 19913 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:35:49.396176 19913 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:35:49.396286 19913 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:49.396502 19913 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:35:49.396584 19913 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:49.432660 19913 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:40991
I20260808 02:35:49.432749 20126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:40991 every 8 connection(s)
I20260808 02:35:49.434079 19913 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:35:49.441143 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 19913
I20260808 02:35:49.441366 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:35:49.442016 25043 external_mini_cluster.cc:1428] Setting key 24dc4b6140a4ca727998a2d21e1ea6ad
Aug 08 02:35:49 dist-test-slave-45dx krb5kdc[19306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156549, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:35:49.456707 20131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:49.436773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:48045 (local address 127.24.116.254:37755)
0808 02:35:49.437281 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:49.437287 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:49.438170 (+ 883us) server_negotiation.cc:407] Connection header received
0808 02:35:49.440137 (+ 1967us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:49.440144 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:49.440261 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:49.440433 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:49.442688 (+ 2255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.444117 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.446275 (+ 2158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.446676 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.446779 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:49.450414 (+ 3635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:49.450418 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:49.450422 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:49.450455 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:49.453448 (+ 2993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:49.454306 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:49.454313 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:49.454318 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:49.454447 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:49.454910 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:49.454915 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:49.454918 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:49.455188 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:49.455358 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:49.456046 (+ 688us) server_negotiation.cc:299] Negotiation successful
0808 02:35:49.456266 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":266,"threads_started":1}
I20260808 02:35:49.457711 20132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:49.437199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:37755 (local address 127.24.116.195:48045)
0808 02:35:49.437973 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:49.438030 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:49.439827 (+ 1797us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:49.440711 (+ 884us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:49.440723 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:49.441560 (+ 837us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:35:49.442419 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:49.442447 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.444371 (+ 1924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.444376 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:49.446130 (+ 1754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:49.446143 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.446894 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.446899 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:49.447102 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:49.447853 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:35:49.447876 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:35:49.450195 (+ 2319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:35:49.453606 (+ 3411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:35:49.453616 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:35:49.453634 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:35:49.454164 (+ 530us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:35:49.454563 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:35:49.454569 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:35:49.454573 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:35:49.454774 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:35:49.455329 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:35:49.455337 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:35:49.455682 (+ 345us) client_negotiation.cc:769] Sending connection context
0808 02:35:49.455950 (+ 268us) client_negotiation.cc:240] Negotiation successful
0808 02:35:49.456519 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":313,"threads_started":1}
I20260808 02:35:49.459283 20129 heartbeater.cc:347] Connected to a master server at 127.24.116.254:37755
I20260808 02:35:49.459650 20129 heartbeater.cc:464] Registering TS with master...
I20260808 02:35:49.460490 20129 heartbeater.cc:511] Master 127.24.116.254:37755 requested a full tablet report, sending...
I20260808 02:35:49.462091 19391 ts_manager.cc:194] Registered new tserver with Master: 3ddd24796e84484f882ae67fe4bfb57e (127.24.116.195:40991)
I20260808 02:35:49.462934 19391 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.195@KRBTEST.COM'} at 127.24.116.195:48045
I20260808 02:35:49.470978 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:35:49.489598 20131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:49.475908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45130 (local address 127.24.116.254:37755)
0808 02:35:49.476086 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:49.476091 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:49.476617 (+ 526us) server_negotiation.cc:407] Connection header received
0808 02:35:49.476765 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:49.476769 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:49.476842 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:49.476927 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:49.478442 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.479414 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.480916 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.481307 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.481410 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:49.483895 (+ 2485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:49.483899 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:49.483902 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:49.483932 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:49.486683 (+ 2751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:49.487406 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:49.487410 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:49.487412 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:49.487594 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:49.488017 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:49.488021 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:49.488023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:49.488486 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:49.488698 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:49.489075 (+ 377us) server_negotiation.cc:299] Negotiation successful
0808 02:35:49.489261 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 02:35:49.494196 19391 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45130:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:35:49.502480 19391 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:35:49.526604 20153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:49.516236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53478 (local address 127.24.116.193:43303)
0808 02:35:49.517727 (+ 1491us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:49.517739 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:49.517779 (+ 40us) server_negotiation.cc:407] Connection header received
0808 02:35:49.517899 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:49.517909 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:49.518168 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:49.518406 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:35:49.519304 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.521074 (+ 1770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.523462 (+ 2388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.525016 (+ 1554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.525215 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:49.525388 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:49.526101 (+ 713us) server_negotiation.cc:299] Negotiation successful
0808 02:35:49.526265 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1285,"thread_start_us":1107,"threads_started":1}
I20260808 02:35:49.526608 20151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:49.515844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:43303 (local address 127.0.0.1:53478)
0808 02:35:49.517039 (+ 1195us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:49.517106 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:49.517320 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:49.518565 (+ 1245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:49.518573 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:49.518605 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:35:49.519063 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:49.519081 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.521252 (+ 2171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.521258 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:49.523207 (+ 1949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:49.523220 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.525568 (+ 2348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.525574 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:49.525816 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:49.525882 (+ 66us) client_negotiation.cc:769] Sending connection context
0808 02:35:49.526022 (+ 140us) client_negotiation.cc:240] Negotiation successful
0808 02:35:49.526210 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":841,"thread_start_us":636,"threads_started":1}
I20260808 02:35:49.526880 20154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:49.516581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42710 (local address 127.24.116.194:38109)
0808 02:35:49.518494 (+ 1913us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:49.518502 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:49.518527 (+ 25us) server_negotiation.cc:407] Connection header received
0808 02:35:49.518625 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:49.518633 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:49.518854 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:49.519076 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:35:49.519969 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.521489 (+ 1520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.524140 (+ 2651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.525503 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.525699 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:49.525878 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:49.526341 (+ 463us) server_negotiation.cc:299] Negotiation successful
0808 02:35:49.526522 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1773,"thread_start_us":1661,"threads_started":1}
I20260808 02:35:49.527156 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:49.516146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:38109 (local address 127.0.0.1:42710)
0808 02:35:49.518006 (+ 1860us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:49.518025 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:49.518142 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:49.519327 (+ 1185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:49.519331 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:49.519358 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:35:49.519765 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:49.519778 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.522096 (+ 2318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.522101 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:49.523975 (+ 1874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:49.523988 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.525750 (+ 1762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.525756 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:49.525940 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:49.525964 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 02:35:49.526084 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 02:35:49.526225 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1739,"thread_start_us":1594,"threads_started":1}
I20260808 02:35:49.528250 20160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:49.518463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:40991 (local address 127.0.0.1:49836)
0808 02:35:49.519117 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:49.519140 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:49.519261 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:49.520619 (+ 1358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:49.520624 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:49.520654 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:35:49.521143 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:49.521155 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.523361 (+ 2206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.523369 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:49.525591 (+ 2222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:49.525604 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.527451 (+ 1847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.527457 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:49.527624 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:49.527664 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 02:35:49.527783 (+ 119us) client_negotiation.cc:240] Negotiation successful
0808 02:35:49.527914 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":904,"threads_started":1}
I20260808 02:35:49.528398 20161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:49.519070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49836 (local address 127.24.116.195:40991)
0808 02:35:49.520005 (+ 935us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:49.520019 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:49.520044 (+ 25us) server_negotiation.cc:407] Connection header received
0808 02:35:49.520117 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:49.520121 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:49.520390 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:49.521374 (+ 984us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:35:49.521679 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.523206 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.525802 (+ 2596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.527245 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.527447 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:49.527609 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:49.527839 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 02:35:49.528005 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":772,"thread_start_us":617,"threads_started":1}
I20260808 02:35:49.531476 20025 tablet_service.cc:1467] Processing CreateTablet for tablet e6652dce28894dc0b1c10dace8169b86 (DEFAULT_TABLE table=test-table [id=3266a1809a6e40d7926b81892b0f8e25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:35:49.531417 19802 tablet_service.cc:1467] Processing CreateTablet for tablet e6652dce28894dc0b1c10dace8169b86 (DEFAULT_TABLE table=test-table [id=3266a1809a6e40d7926b81892b0f8e25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:35:49.531412 19589 tablet_service.cc:1467] Processing CreateTablet for tablet e6652dce28894dc0b1c10dace8169b86 (DEFAULT_TABLE table=test-table [id=3266a1809a6e40d7926b81892b0f8e25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:35:49.532845 20025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6652dce28894dc0b1c10dace8169b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:35:49.532886 19802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6652dce28894dc0b1c10dace8169b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:35:49.532893 19589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6652dce28894dc0b1c10dace8169b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:35:49.544925 20162 tablet_bootstrap.cc:492] T e6652dce28894dc0b1c10dace8169b86 P 3ddd24796e84484f882ae67fe4bfb57e: Bootstrap starting.
I20260808 02:35:49.548789 20162 tablet_bootstrap.cc:654] T e6652dce28894dc0b1c10dace8169b86 P 3ddd24796e84484f882ae67fe4bfb57e: Neither blocks nor log segments found. Creating new log.
I20260808 02:35:49.549052 20166 tablet_bootstrap.cc:492] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d: Bootstrap starting.
I20260808 02:35:49.550292 20162 log.cc:824] T e6652dce28894dc0b1c10dace8169b86 P 3ddd24796e84484f882ae67fe4bfb57e: Log is configured to *not* fsync() on all Append() calls
I20260808 02:35:49.550834 20164 tablet_bootstrap.cc:492] T e6652dce28894dc0b1c10dace8169b86 P 6ee01a7a442b406389a1a8ccf350f936: Bootstrap starting.
I20260808 02:35:49.553237 20166 tablet_bootstrap.cc:654] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d: Neither blocks nor log segments found. Creating new log.
I20260808 02:35:49.554289 20164 tablet_bootstrap.cc:654] T e6652dce28894dc0b1c10dace8169b86 P 6ee01a7a442b406389a1a8ccf350f936: Neither blocks nor log segments found. Creating new log.
I20260808 02:35:49.554531 20166 log.cc:824] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d: Log is configured to *not* fsync() on all Append() calls
I20260808 02:35:49.555271 20162 tablet_bootstrap.cc:492] T e6652dce28894dc0b1c10dace8169b86 P 3ddd24796e84484f882ae67fe4bfb57e: No bootstrap required, opened a new log
I20260808 02:35:49.555516 20164 log.cc:824] T e6652dce28894dc0b1c10dace8169b86 P 6ee01a7a442b406389a1a8ccf350f936: Log is configured to *not* fsync() on all Append() calls
I20260808 02:35:49.555581 20162 ts_tablet_manager.cc:1397] T e6652dce28894dc0b1c10dace8169b86 P 3ddd24796e84484f882ae67fe4bfb57e: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.009s
I20260808 02:35:49.562826 20164 tablet_bootstrap.cc:492] T e6652dce28894dc0b1c10dace8169b86 P 6ee01a7a442b406389a1a8ccf350f936: No bootstrap required, opened a new log
I20260808 02:35:49.563051 20166 tablet_bootstrap.cc:492] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d: No bootstrap required, opened a new log
I20260808 02:35:49.563161 20164 ts_tablet_manager.cc:1397] T e6652dce28894dc0b1c10dace8169b86 P 6ee01a7a442b406389a1a8ccf350f936: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.004s
I20260808 02:35:49.563316 20166 ts_tablet_manager.cc:1397] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.009s
I20260808 02:35:49.567625 20162 raft_consensus.cc:348] T e6652dce28894dc0b1c10dace8169b86 P 3ddd24796e84484f882ae67fe4bfb57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7da4a6f4b9ce43879b0b02b8ae642b2d" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43303 } } peers { permanent_uuid: "6ee01a7a442b406389a1a8ccf350f936" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38109 } } peers { permanent_uuid: "3ddd24796e84484f882ae67fe4bfb57e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 40991 } }
I20260808 02:35:49.568225 20162 raft_consensus.cc:374] T e6652dce28894dc0b1c10dace8169b86 P 3ddd24796e84484f882ae67fe4bfb57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:35:49.568367 20162 raft_consensus.cc:729] T e6652dce28894dc0b1c10dace8169b86 P 3ddd24796e84484f882ae67fe4bfb57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ddd24796e84484f882ae67fe4bfb57e, State: Initialized, Role: FOLLOWER
I20260808 02:35:49.569031 20162 consensus_queue.cc:260] T e6652dce28894dc0b1c10dace8169b86 P 3ddd24796e84484f882ae67fe4bfb57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7da4a6f4b9ce43879b0b02b8ae642b2d" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43303 } } peers { permanent_uuid: "6ee01a7a442b406389a1a8ccf350f936" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38109 } } peers { permanent_uuid: "3ddd24796e84484f882ae67fe4bfb57e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 40991 } }
I20260808 02:35:49.571188 20164 raft_consensus.cc:348] T e6652dce28894dc0b1c10dace8169b86 P 6ee01a7a442b406389a1a8ccf350f936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7da4a6f4b9ce43879b0b02b8ae642b2d" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43303 } } peers { permanent_uuid: "6ee01a7a442b406389a1a8ccf350f936" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38109 } } peers { permanent_uuid: "3ddd24796e84484f882ae67fe4bfb57e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 40991 } }
I20260808 02:35:49.571579 20164 raft_consensus.cc:374] T e6652dce28894dc0b1c10dace8169b86 P 6ee01a7a442b406389a1a8ccf350f936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:35:49.571744 20164 raft_consensus.cc:729] T e6652dce28894dc0b1c10dace8169b86 P 6ee01a7a442b406389a1a8ccf350f936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ee01a7a442b406389a1a8ccf350f936, State: Initialized, Role: FOLLOWER
I20260808 02:35:49.572497 20129 heartbeater.cc:503] Master 127.24.116.254:37755 was elected leader, sending a full tablet report...
I20260808 02:35:49.572484 20164 consensus_queue.cc:260] T e6652dce28894dc0b1c10dace8169b86 P 6ee01a7a442b406389a1a8ccf350f936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7da4a6f4b9ce43879b0b02b8ae642b2d" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43303 } } peers { permanent_uuid: "6ee01a7a442b406389a1a8ccf350f936" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38109 } } peers { permanent_uuid: "3ddd24796e84484f882ae67fe4bfb57e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 40991 } }
I20260808 02:35:49.574795 20162 ts_tablet_manager.cc:1428] T e6652dce28894dc0b1c10dace8169b86 P 3ddd24796e84484f882ae67fe4bfb57e: Time spent starting tablet: real 0.019s user 0.008s sys 0.009s
I20260808 02:35:49.574627 20166 raft_consensus.cc:348] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7da4a6f4b9ce43879b0b02b8ae642b2d" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43303 } } peers { permanent_uuid: "6ee01a7a442b406389a1a8ccf350f936" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38109 } } peers { permanent_uuid: "3ddd24796e84484f882ae67fe4bfb57e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 40991 } }
I20260808 02:35:49.575136 20166 raft_consensus.cc:374] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:35:49.575305 20166 raft_consensus.cc:729] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7da4a6f4b9ce43879b0b02b8ae642b2d, State: Initialized, Role: FOLLOWER
I20260808 02:35:49.575779 19906 heartbeater.cc:503] Master 127.24.116.254:37755 was elected leader, sending a full tablet report...
I20260808 02:35:49.576538 20164 ts_tablet_manager.cc:1428] T e6652dce28894dc0b1c10dace8169b86 P 6ee01a7a442b406389a1a8ccf350f936: Time spent starting tablet: real 0.013s user 0.010s sys 0.005s
I20260808 02:35:49.577294 20166 consensus_queue.cc:260] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7da4a6f4b9ce43879b0b02b8ae642b2d" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43303 } } peers { permanent_uuid: "6ee01a7a442b406389a1a8ccf350f936" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38109 } } peers { permanent_uuid: "3ddd24796e84484f882ae67fe4bfb57e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 40991 } }
I20260808 02:35:49.579723 20166 ts_tablet_manager.cc:1428] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d: Time spent starting tablet: real 0.016s user 0.013s sys 0.003s
W20260808 02:35:49.629755 19907 tablet.cc:2369] T e6652dce28894dc0b1c10dace8169b86 P 6ee01a7a442b406389a1a8ccf350f936: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:35:49.685876 20130 tablet.cc:2369] T e6652dce28894dc0b1c10dace8169b86 P 3ddd24796e84484f882ae67fe4bfb57e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:35:49.707898 20175 raft_consensus.cc:482] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:35:49.708338 20175 raft_consensus.cc:504] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7da4a6f4b9ce43879b0b02b8ae642b2d" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43303 } } peers { permanent_uuid: "6ee01a7a442b406389a1a8ccf350f936" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38109 } } peers { permanent_uuid: "3ddd24796e84484f882ae67fe4bfb57e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 40991 } }
I20260808 02:35:49.710405 20175 leader_election.cc:288] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ee01a7a442b406389a1a8ccf350f936 (127.24.116.194:38109), 3ddd24796e84484f882ae67fe4bfb57e (127.24.116.195:40991)
I20260808 02:35:49.717768 20154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:49.710822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:39573 (local address 127.24.116.194:38109)
0808 02:35:49.711099 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:49.711106 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:49.711526 (+ 420us) server_negotiation.cc:407] Connection header received
0808 02:35:49.711736 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:49.711743 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:49.711850 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:49.711954 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:35:49.712683 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.713731 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.715719 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.716715 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.716845 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:49.716901 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:49.717320 (+ 419us) server_negotiation.cc:299] Negotiation successful
0808 02:35:49.717490 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 02:35:49.717785 20176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:49.710661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:38109 (local address 127.24.116.193:39573)
0808 02:35:49.711382 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:49.711403 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:49.711570 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:49.712041 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:49.712044 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:49.712072 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:35:49.712523 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:49.712538 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.713872 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.713877 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:49.715544 (+ 1667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:49.715557 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.716950 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.716958 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:49.717139 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:49.717182 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 02:35:49.717297 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 02:35:49.717453 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":384,"threads_started":1}
I20260808 02:35:49.718359 20177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:49.711428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:40991 (local address 127.24.116.193:39115)
0808 02:35:49.712203 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:49.712218 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:49.712397 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:49.712778 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:49.712785 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:49.712812 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:35:49.713208 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:49.713221 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.714477 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.714481 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:49.716057 (+ 1576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:49.716071 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.717516 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.717522 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:49.717714 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:49.717746 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 02:35:49.717856 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 02:35:49.718025 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"thread_start_us":384,"threads_started":1}
I20260808 02:35:49.718360 20161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:49.711666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:39115 (local address 127.24.116.195:40991)
0808 02:35:49.711924 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:49.711930 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:49.712342 (+ 412us) server_negotiation.cc:407] Connection header received
0808 02:35:49.712545 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:49.712551 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:49.712642 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:49.712726 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:35:49.713369 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.714321 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.716230 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.717286 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.717444 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:49.717512 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:49.717910 (+ 398us) server_negotiation.cc:299] Negotiation successful
0808 02:35:49.718056 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260808 02:35:49.719105 19834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6652dce28894dc0b1c10dace8169b86" candidate_uuid: "7da4a6f4b9ce43879b0b02b8ae642b2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee01a7a442b406389a1a8ccf350f936" is_pre_election: true
I20260808 02:35:49.719269 20053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6652dce28894dc0b1c10dace8169b86" candidate_uuid: "7da4a6f4b9ce43879b0b02b8ae642b2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ddd24796e84484f882ae67fe4bfb57e" is_pre_election: true
I20260808 02:35:49.719750 19834 raft_consensus.cc:2454] T e6652dce28894dc0b1c10dace8169b86 P 6ee01a7a442b406389a1a8ccf350f936 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7da4a6f4b9ce43879b0b02b8ae642b2d in term 0.
I20260808 02:35:49.719846 20053 raft_consensus.cc:2454] T e6652dce28894dc0b1c10dace8169b86 P 3ddd24796e84484f882ae67fe4bfb57e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7da4a6f4b9ce43879b0b02b8ae642b2d in term 0.
I20260808 02:35:49.720568 19517 leader_election.cc:302] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ee01a7a442b406389a1a8ccf350f936, 7da4a6f4b9ce43879b0b02b8ae642b2d; no voters:
I20260808 02:35:49.721001 20175 raft_consensus.cc:2781] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:35:49.721155 20175 raft_consensus.cc:482] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:35:49.721288 20175 raft_consensus.cc:3037] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:35:49.723639 20175 raft_consensus.cc:504] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7da4a6f4b9ce43879b0b02b8ae642b2d" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43303 } } peers { permanent_uuid: "6ee01a7a442b406389a1a8ccf350f936" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38109 } } peers { permanent_uuid: "3ddd24796e84484f882ae67fe4bfb57e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 40991 } }
I20260808 02:35:49.724229 20175 leader_election.cc:288] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d [CANDIDATE]: Term 1 election: Requested vote from peers 6ee01a7a442b406389a1a8ccf350f936 (127.24.116.194:38109), 3ddd24796e84484f882ae67fe4bfb57e (127.24.116.195:40991)
I20260808 02:35:49.724993 19834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6652dce28894dc0b1c10dace8169b86" candidate_uuid: "7da4a6f4b9ce43879b0b02b8ae642b2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee01a7a442b406389a1a8ccf350f936"
I20260808 02:35:49.725174 20053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6652dce28894dc0b1c10dace8169b86" candidate_uuid: "7da4a6f4b9ce43879b0b02b8ae642b2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ddd24796e84484f882ae67fe4bfb57e"
I20260808 02:35:49.725270 19834 raft_consensus.cc:3037] T e6652dce28894dc0b1c10dace8169b86 P 6ee01a7a442b406389a1a8ccf350f936 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:35:49.725437 20053 raft_consensus.cc:3037] T e6652dce28894dc0b1c10dace8169b86 P 3ddd24796e84484f882ae67fe4bfb57e [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:35:49.728615 20053 raft_consensus.cc:2454] T e6652dce28894dc0b1c10dace8169b86 P 3ddd24796e84484f882ae67fe4bfb57e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7da4a6f4b9ce43879b0b02b8ae642b2d in term 1.
I20260808 02:35:49.728822 19834 raft_consensus.cc:2454] T e6652dce28894dc0b1c10dace8169b86 P 6ee01a7a442b406389a1a8ccf350f936 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7da4a6f4b9ce43879b0b02b8ae642b2d in term 1.
I20260808 02:35:49.729321 19517 leader_election.cc:302] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ddd24796e84484f882ae67fe4bfb57e, 7da4a6f4b9ce43879b0b02b8ae642b2d; no voters:
I20260808 02:35:49.729707 20175 raft_consensus.cc:2781] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:35:49.730333 20175 raft_consensus.cc:686] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d [term 1 LEADER]: Becoming Leader. State: Replica: 7da4a6f4b9ce43879b0b02b8ae642b2d, State: Running, Role: LEADER
I20260808 02:35:49.730928 20175 consensus_queue.cc:237] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7da4a6f4b9ce43879b0b02b8ae642b2d" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43303 } } peers { permanent_uuid: "6ee01a7a442b406389a1a8ccf350f936" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38109 } } peers { permanent_uuid: "3ddd24796e84484f882ae67fe4bfb57e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 40991 } }
I20260808 02:35:49.736753 19390 catalog_manager.cc:5495] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7da4a6f4b9ce43879b0b02b8ae642b2d (127.24.116.193). New cstate: current_term: 1 leader_uuid: "7da4a6f4b9ce43879b0b02b8ae642b2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7da4a6f4b9ce43879b0b02b8ae642b2d" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 43303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ee01a7a442b406389a1a8ccf350f936" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ddd24796e84484f882ae67fe4bfb57e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 40991 } health_report { overall_health: UNKNOWN } } }
I20260808 02:35:49.769279 20153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:49.763522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53488 (local address 127.24.116.193:43303)
0808 02:35:49.763758 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:49.763765 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:49.763835 (+ 70us) server_negotiation.cc:407] Connection header received
0808 02:35:49.764117 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:49.764121 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:49.764226 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:49.764434 (+ 208us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:35:49.764830 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.765552 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.767025 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.767428 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.767564 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:49.768097 (+ 533us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:35:49.768677 (+ 580us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:35:49.768839 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:49.768923 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 02:35:49.769004 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 02:35:49.778259 19834 raft_consensus.cc:1261] T e6652dce28894dc0b1c10dace8169b86 P 6ee01a7a442b406389a1a8ccf350f936 [term 1 FOLLOWER]: Refusing update from remote peer 7da4a6f4b9ce43879b0b02b8ae642b2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:35:49.778259 20053 raft_consensus.cc:1261] T e6652dce28894dc0b1c10dace8169b86 P 3ddd24796e84484f882ae67fe4bfb57e [term 1 FOLLOWER]: Refusing update from remote peer 7da4a6f4b9ce43879b0b02b8ae642b2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:35:49.779438 20178 consensus_queue.cc:1035] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ddd24796e84484f882ae67fe4bfb57e" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 40991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:35:49.779868 20175 consensus_queue.cc:1035] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee01a7a442b406389a1a8ccf350f936" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 38109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:35:49.793020 20182 mvcc.cc:205] Tried to move back new op lower bound from 7316097227880255488 to 7316097227703275520. Current Snapshot: MvccSnapshot[applied={T|T < 7316097227880255488}]
I20260808 02:35:49.809288 19390 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:35:49.809612 19390 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:35:49.813269 19390 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a61791df6c8f4318a4291ed9e89e94e8: Sending DeleteTablet for 3 replicas of tablet e6652dce28894dc0b1c10dace8169b86
I20260808 02:35:49.814464 19589 tablet_service.cc:1514] Processing DeleteTablet for tablet e6652dce28894dc0b1c10dace8169b86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:35:49 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:53478
I20260808 02:35:49.814644 19802 tablet_service.cc:1514] Processing DeleteTablet for tablet e6652dce28894dc0b1c10dace8169b86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:35:49 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:42710
I20260808 02:35:49.814810 20025 tablet_service.cc:1514] Processing DeleteTablet for tablet e6652dce28894dc0b1c10dace8169b86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:35:49 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:49836
I20260808 02:35:49.819624 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 19480
I20260808 02:35:49.835399 20201 tablet_replica.cc:330] T e6652dce28894dc0b1c10dace8169b86 P 6ee01a7a442b406389a1a8ccf350f936: stopping tablet replica
I20260808 02:35:49.835986 20201 raft_consensus.cc:2229] T e6652dce28894dc0b1c10dace8169b86 P 6ee01a7a442b406389a1a8ccf350f936 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:35:49.836655 20201 raft_consensus.cc:2258] T e6652dce28894dc0b1c10dace8169b86 P 6ee01a7a442b406389a1a8ccf350f936 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:35:49.837392 20200 tablet_replica.cc:330] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d: stopping tablet replica
I20260808 02:35:49.839329 20201 ts_tablet_manager.cc:1905] T e6652dce28894dc0b1c10dace8169b86 P 6ee01a7a442b406389a1a8ccf350f936: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:35:49.839946 20200 raft_consensus.cc:2229] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:35:49.840942 20200 raft_consensus.cc:2258] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:35:49.843606 20200 ts_tablet_manager.cc:1905] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:35:49.844252 20203 tablet_replica.cc:330] T e6652dce28894dc0b1c10dace8169b86 P 3ddd24796e84484f882ae67fe4bfb57e: stopping tablet replica
I20260808 02:35:49.844720 20203 raft_consensus.cc:2229] T e6652dce28894dc0b1c10dace8169b86 P 3ddd24796e84484f882ae67fe4bfb57e [term 1 FOLLOWER]: Raft consensus shutting down.
Aug 08 02:35:49 dist-test-slave-45dx krb5kdc[19306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156547, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.193@KRBTEST.COM
I20260808 02:35:49.845310 20203 raft_consensus.cc:2258] T e6652dce28894dc0b1c10dace8169b86 P 3ddd24796e84484f882ae67fe4bfb57e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:35:49.848862 20201 ts_tablet_manager.cc:1918] T e6652dce28894dc0b1c10dace8169b86 P 6ee01a7a442b406389a1a8ccf350f936: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:35:49.849061 20201 log.cc:1196] T e6652dce28894dc0b1c10dace8169b86 P 6ee01a7a442b406389a1a8ccf350f936: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/e6652dce28894dc0b1c10dace8169b86
I20260808 02:35:49.851511 20200 ts_tablet_manager.cc:1918] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:35:49.851704 20200 log.cc:1196] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/e6652dce28894dc0b1c10dace8169b86
I20260808 02:35:49.851761 20203 ts_tablet_manager.cc:1905] T e6652dce28894dc0b1c10dace8169b86 P 3ddd24796e84484f882ae67fe4bfb57e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:35:49.852334 20200 ts_tablet_manager.cc:1939] T e6652dce28894dc0b1c10dace8169b86 P 7da4a6f4b9ce43879b0b02b8ae642b2d: Deleting consensus metadata
I20260808 02:35:49.854387 19365 catalog_manager.cc:4841] TS 7da4a6f4b9ce43879b0b02b8ae642b2d (127.24.116.193:43303): tablet e6652dce28894dc0b1c10dace8169b86 (table test-table [id=3266a1809a6e40d7926b81892b0f8e25]) successfully deleted
I20260808 02:35:49.854651 20201 ts_tablet_manager.cc:1939] T e6652dce28894dc0b1c10dace8169b86 P 6ee01a7a442b406389a1a8ccf350f936: Deleting consensus metadata
I20260808 02:35:49.856459 19368 catalog_manager.cc:4841] TS 6ee01a7a442b406389a1a8ccf350f936 (127.24.116.194:38109): tablet e6652dce28894dc0b1c10dace8169b86 (table test-table [id=3266a1809a6e40d7926b81892b0f8e25]) successfully deleted
I20260808 02:35:49.858012 20153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:49.821144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53502 (local address 127.24.116.193:43303)
0808 02:35:49.821328 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:49.821335 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:49.830366 (+ 9031us) server_negotiation.cc:407] Connection header received
0808 02:35:49.830950 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:49.830957 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:49.831052 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:49.831158 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:49.833807 (+ 2649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.835366 (+ 1559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.838406 (+ 3040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.839203 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.839322 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:49.846713 (+ 7391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:49.846731 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:49.846751 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:49.846814 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:49.852102 (+ 5288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:49.853684 (+ 1582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:49.853694 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:49.853698 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:49.853934 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:49.855350 (+ 1416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:49.855356 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:49.855360 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:49.855891 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:49.856212 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:49.857376 (+ 1164us) server_negotiation.cc:299] Negotiation successful
0808 02:35:49.857627 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 02:35:49.858744 19679 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:35:49.860029 20203 ts_tablet_manager.cc:1918] T e6652dce28894dc0b1c10dace8169b86 P 3ddd24796e84484f882ae67fe4bfb57e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:35:49.860340 20203 log.cc:1196] T e6652dce28894dc0b1c10dace8169b86 P 3ddd24796e84484f882ae67fe4bfb57e: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/e6652dce28894dc0b1c10dace8169b86
I20260808 02:35:49.861219 20203 ts_tablet_manager.cc:1939] T e6652dce28894dc0b1c10dace8169b86 P 3ddd24796e84484f882ae67fe4bfb57e: Deleting consensus metadata
I20260808 02:35:49.863653 19368 catalog_manager.cc:4841] TS 3ddd24796e84484f882ae67fe4bfb57e (127.24.116.195:40991): tablet e6652dce28894dc0b1c10dace8169b86 (table test-table [id=3266a1809a6e40d7926b81892b0f8e25]) successfully deleted
I20260808 02:35:49.958702 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 19480
I20260808 02:35:49.990075 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 19699
Aug 08 02:35:49 dist-test-slave-45dx krb5kdc[19306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156547, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.194@KRBTEST.COM
I20260808 02:35:50.007449 20154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:49.991000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42726 (local address 127.24.116.194:38109)
0808 02:35:49.991208 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:49.991215 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:49.991313 (+ 98us) server_negotiation.cc:407] Connection header received
0808 02:35:49.991534 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:49.991546 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:49.991623 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:49.991736 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:49.993107 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.993865 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.995210 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:49.995598 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:49.995738 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:50.000220 (+ 4482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:50.000238 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:50.000256 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:50.000295 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:50.003823 (+ 3528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:50.004997 (+ 1174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:50.005007 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:50.005009 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:50.005157 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:50.005598 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:50.005603 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:50.005606 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:50.006171 (+ 565us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:50.006488 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:50.006767 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 02:35:50.006999 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 02:35:50.008432 19900 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:35:50.101387 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 19699
I20260808 02:35:50.126870 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 19913
Aug 08 02:35:50 dist-test-slave-45dx krb5kdc[19306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156547, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.195@KRBTEST.COM
I20260808 02:35:50.142649 20161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:50.127854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49850 (local address 127.24.116.195:40991)
0808 02:35:50.128074 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:50.128080 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:50.128103 (+ 23us) server_negotiation.cc:407] Connection header received
0808 02:35:50.128279 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:50.128283 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:50.128433 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:50.128520 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:50.129917 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:50.130665 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:50.131948 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:50.132435 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:50.132534 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:50.136853 (+ 4319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:50.136869 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:50.136886 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:50.136918 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:50.139616 (+ 2698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:50.140290 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:50.140298 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:50.140336 (+ 38us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:50.140556 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:50.140969 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:50.140974 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:50.140976 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:50.141414 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:50.141671 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:50.142005 (+ 334us) server_negotiation.cc:299] Negotiation successful
0808 02:35:50.142222 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 02:35:50.143347 20122 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:35:50.234022 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 19913
I20260808 02:35:50.261468 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 19328
I20260808 02:35:50.263029 19439 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:35:50.385952 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 19328
2026-08-08T02:35:50Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4950 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T02:35:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:35:50Z Disabled control of system clock
I20260808 02:35:50.495569 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:40223
--webserver_interface=127.24.116.254
--webserver_port=0
--builtin_ntp_servers=127.24.116.212:40357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:40223
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 02:35:50.850916 20222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:35:50.851203 20222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:35:50.851287 20222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:35:50.858446 20222 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:35:50.858556 20222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:35:50.858593 20222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:35:50.858645 20222 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:35:50.858690 20222 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:35:50.867893 20222 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:40357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:40223
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:40223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:35:50.869269 20222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:35:50.871142 20222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:35:50.883985 20228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:50.883988 20227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:50.884519 20231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:35:50.884966 20222 server_base.cc:1034] running on GCE node
I20260808 02:35:50.885782 20222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:35:50.887418 20222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:35:50.888630 20222 hybrid_clock.cc:648] HybridClock initialized: now 1786156550888578 us; error 31 us; skew 500 ppm
I20260808 02:35:50.889077 20222 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:35:50.891714 20222 webserver.cc:460] Webserver started at http://127.24.116.254:39479/ using document root <none> and password file <none>
I20260808 02:35:50.892588 20222 fs_manager.cc:359] Metadata directory not provided
I20260808 02:35:50.892721 20222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:35:50.893110 20222 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:35:50.896456 20222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "a2fbf0b738f04d61adec17f090c91cf0"
format_stamp: "Formatted at 2026-08-08 02:35:50 on dist-test-slave-45dx"
server_key: "d3acd38dbfbf5c7b2cef92c45f3bb620"
server_key_iv: "a8a55ed514869199c17d331cf2901922"
server_key_version: "encryptionkey@0"
I20260808 02:35:50.897404 20222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "a2fbf0b738f04d61adec17f090c91cf0"
format_stamp: "Formatted at 2026-08-08 02:35:50 on dist-test-slave-45dx"
server_key: "d3acd38dbfbf5c7b2cef92c45f3bb620"
server_key_iv: "a8a55ed514869199c17d331cf2901922"
server_key_version: "encryptionkey@0"
I20260808 02:35:50.903023 20222 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260808 02:35:50.906983 20238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:50.908556 20222 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 02:35:50.908771 20222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "a2fbf0b738f04d61adec17f090c91cf0"
format_stamp: "Formatted at 2026-08-08 02:35:50 on dist-test-slave-45dx"
server_key: "d3acd38dbfbf5c7b2cef92c45f3bb620"
server_key_iv: "a8a55ed514869199c17d331cf2901922"
server_key_version: "encryptionkey@0"
I20260808 02:35:50.909020 20222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:35:50.931041 20222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:35:50.932051 20222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:35:50.932440 20222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:35:50.954259 20222 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:40223
I20260808 02:35:50.954278 20323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:40223 every 8 connection(s)
I20260808 02:35:50.955817 20222 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:35:50.957967 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 20222
I20260808 02:35:50.958161 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:35:50.958824 25043 external_mini_cluster.cc:1428] Setting key f986f9a79595765106c5b8ee75119c0a
I20260808 02:35:50.960808 20324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:35:50.973667 20327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:50.961010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41396 (local address 127.24.116.254:40223)
0808 02:35:50.962096 (+ 1086us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:50.962108 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:50.962154 (+ 46us) server_negotiation.cc:407] Connection header received
0808 02:35:50.963782 (+ 1628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:50.963804 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:50.964280 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:50.964763 (+ 483us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:50.965425 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:50.966795 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:50.968876 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:50.969575 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:50.969719 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:50.971074 (+ 1355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:50.971081 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:50.971098 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:35:50.971710 (+ 612us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:50.971802 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:35:50.971832 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:50.971928 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:50.972189 (+ 261us) server_negotiation.cc:299] Negotiation successful
0808 02:35:50.972612 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":657,"thread_start_us":437,"threads_started":1}
I20260808 02:35:50.975255 20324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2fbf0b738f04d61adec17f090c91cf0: Bootstrap starting.
I20260808 02:35:50.978904 20324 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2fbf0b738f04d61adec17f090c91cf0: Neither blocks nor log segments found. Creating new log.
I20260808 02:35:50.980036 20324 log.cc:824] T 00000000000000000000000000000000 P a2fbf0b738f04d61adec17f090c91cf0: Log is configured to *not* fsync() on all Append() calls
I20260808 02:35:50.983206 20324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2fbf0b738f04d61adec17f090c91cf0: No bootstrap required, opened a new log
I20260808 02:35:50.991000 20324 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2fbf0b738f04d61adec17f090c91cf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2fbf0b738f04d61adec17f090c91cf0" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40223 } }
I20260808 02:35:50.991441 20324 raft_consensus.cc:374] T 00000000000000000000000000000000 P a2fbf0b738f04d61adec17f090c91cf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:35:50.991586 20324 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2fbf0b738f04d61adec17f090c91cf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2fbf0b738f04d61adec17f090c91cf0, State: Initialized, Role: FOLLOWER
I20260808 02:35:50.992372 20324 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2fbf0b738f04d61adec17f090c91cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2fbf0b738f04d61adec17f090c91cf0" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40223 } }
I20260808 02:35:50.992681 20324 raft_consensus.cc:388] T 00000000000000000000000000000000 P a2fbf0b738f04d61adec17f090c91cf0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:35:50.992906 20324 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2fbf0b738f04d61adec17f090c91cf0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:35:50.993113 20324 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2fbf0b738f04d61adec17f090c91cf0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:35:50.995379 20324 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2fbf0b738f04d61adec17f090c91cf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2fbf0b738f04d61adec17f090c91cf0" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40223 } }
I20260808 02:35:50.995908 20324 leader_election.cc:302] T 00000000000000000000000000000000 P a2fbf0b738f04d61adec17f090c91cf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a2fbf0b738f04d61adec17f090c91cf0; no voters:
I20260808 02:35:50.996616 20324 leader_election.cc:288] T 00000000000000000000000000000000 P a2fbf0b738f04d61adec17f090c91cf0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:35:50.996762 20332 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a2fbf0b738f04d61adec17f090c91cf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:35:50.998086 20332 raft_consensus.cc:686] T 00000000000000000000000000000000 P a2fbf0b738f04d61adec17f090c91cf0 [term 1 LEADER]: Becoming Leader. State: Replica: a2fbf0b738f04d61adec17f090c91cf0, State: Running, Role: LEADER
I20260808 02:35:50.998672 20332 consensus_queue.cc:237] T 00000000000000000000000000000000 P a2fbf0b738f04d61adec17f090c91cf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2fbf0b738f04d61adec17f090c91cf0" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40223 } }
I20260808 02:35:50.999058 20324 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2fbf0b738f04d61adec17f090c91cf0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:35:51.002041 20335 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2fbf0b738f04d61adec17f090c91cf0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a2fbf0b738f04d61adec17f090c91cf0. Latest consensus state: current_term: 1 leader_uuid: "a2fbf0b738f04d61adec17f090c91cf0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2fbf0b738f04d61adec17f090c91cf0" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40223 } } }
I20260808 02:35:51.002534 20335 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2fbf0b738f04d61adec17f090c91cf0 [sys.catalog]: This master's current role is: LEADER
I20260808 02:35:51.003242 20333 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2fbf0b738f04d61adec17f090c91cf0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a2fbf0b738f04d61adec17f090c91cf0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2fbf0b738f04d61adec17f090c91cf0" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40223 } } }
I20260808 02:35:51.003587 20333 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2fbf0b738f04d61adec17f090c91cf0 [sys.catalog]: This master's current role is: LEADER
I20260808 02:35:51.004884 20347 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:35:51.010241 20347 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:35:51.019714 20347 catalog_manager.cc:1347] Generated new cluster ID: f6d70c6252604db0be28993a68d1f4f3
I20260808 02:35:51.019923 20347 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:35:51.042376 20347 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:35:51.043900 20347 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:35:51.050733 20347 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a2fbf0b738f04d61adec17f090c91cf0: Generated new TSK 0
I20260808 02:35:51.051882 20347 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:35:51.071507 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:40223
--builtin_ntp_servers=127.24.116.212:40357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 02:35:51.431581 20361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:35:51.431939 20361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:35:51.432132 20361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:35:51.439719 20361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:35:51.439829 20361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:35:51.440018 20361 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:35:51.449370 20361 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:40357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:40223
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:35:51.450743 20361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:35:51.452589 20361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:35:51.465894 20368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:51.465914 20369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:51.466215 20371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:35:51.466675 20361 server_base.cc:1034] running on GCE node
I20260808 02:35:51.467340 20361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:35:51.468266 20361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:35:51.469540 20361 hybrid_clock.cc:648] HybridClock initialized: now 1786156551469492 us; error 46 us; skew 500 ppm
I20260808 02:35:51.469873 20361 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:35:51.472213 20361 webserver.cc:460] Webserver started at http://127.24.116.193:46807/ using document root <none> and password file <none>
I20260808 02:35:51.472954 20361 fs_manager.cc:359] Metadata directory not provided
I20260808 02:35:51.473100 20361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:35:51.473430 20361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:35:51.476593 20361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "a70f036812844e0fbc8339ad1e742424"
format_stamp: "Formatted at 2026-08-08 02:35:51 on dist-test-slave-45dx"
server_key: "3b89bcd4c09074b47bd168be0d547dbf"
server_key_iv: "27f88c450d0b8f1311963e421d97c90d"
server_key_version: "encryptionkey@0"
I20260808 02:35:51.477401 20361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "a70f036812844e0fbc8339ad1e742424"
format_stamp: "Formatted at 2026-08-08 02:35:51 on dist-test-slave-45dx"
server_key: "3b89bcd4c09074b47bd168be0d547dbf"
server_key_iv: "27f88c450d0b8f1311963e421d97c90d"
server_key_version: "encryptionkey@0"
I20260808 02:35:51.482724 20361 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 02:35:51.486367 20381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:51.487730 20361 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 02:35:51.487941 20361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "a70f036812844e0fbc8339ad1e742424"
format_stamp: "Formatted at 2026-08-08 02:35:51 on dist-test-slave-45dx"
server_key: "3b89bcd4c09074b47bd168be0d547dbf"
server_key_iv: "27f88c450d0b8f1311963e421d97c90d"
server_key_version: "encryptionkey@0"
I20260808 02:35:51.488178 20361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:35:51.510146 20361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:35:51.511137 20361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:35:51.511488 20361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:35:51.512573 20361 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:35:51.514413 20361 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:35:51.514539 20361 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:51.514704 20361 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:35:51.514806 20361 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:51.549888 20361 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:40733
I20260808 02:35:51.549952 20559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:40733 every 8 connection(s)
I20260808 02:35:51.551288 20361 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:35:51.557304 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 20361
I20260808 02:35:51.557528 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:35:51.558128 25043 external_mini_cluster.cc:1428] Setting key 11a396feeaba5e9e51fb4294277e5795
I20260808 02:35:51.561580 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:40223
--builtin_ntp_servers=127.24.116.212:40357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 02:35:51.566067 20568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:51.554064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:53395 (local address 127.24.116.254:40223)
0808 02:35:51.554528 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:51.554534 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:51.555824 (+ 1290us) server_negotiation.cc:407] Connection header received
0808 02:35:51.557825 (+ 2001us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:51.557833 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:51.557962 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:51.558091 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:51.559337 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:51.560433 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:51.562998 (+ 2565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:51.563404 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:51.563508 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:51.565256 (+ 1748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:51.565261 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:51.565264 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:35:51.565281 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:51.565335 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:35:51.565348 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:51.565426 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:51.565713 (+ 287us) server_negotiation.cc:299] Negotiation successful
0808 02:35:51.565794 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":219,"threads_started":1}
I20260808 02:35:51.567533 20570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:51.554711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40223 (local address 127.24.116.193:53395)
0808 02:35:51.555650 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:51.555697 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:51.557478 (+ 1781us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:51.558355 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:51.558363 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:51.558447 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:35:51.559128 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:51.559157 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:51.560594 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:51.560600 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:51.562820 (+ 2220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:51.562840 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:51.563653 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:51.563664 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:51.564030 (+ 366us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:51.564854 (+ 824us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:35:51.564860 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:35:51.564917 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:35:51.565043 (+ 126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:35:51.565457 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:35:51.565472 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:35:51.565484 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 02:35:51.565682 (+ 198us) client_negotiation.cc:240] Negotiation successful
0808 02:35:51.566112 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":283,"threads_started":1}
I20260808 02:35:51.569290 20560 heartbeater.cc:347] Connected to a master server at 127.24.116.254:40223
I20260808 02:35:51.569623 20560 heartbeater.cc:464] Registering TS with master...
I20260808 02:35:51.570416 20560 heartbeater.cc:511] Master 127.24.116.254:40223 requested a full tablet report, sending...
I20260808 02:35:51.572546 20263 ts_manager.cc:194] Registered new tserver with Master: a70f036812844e0fbc8339ad1e742424 (127.24.116.193:40733)
I20260808 02:35:51.574059 20263 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.116.193:53395
W20260808 02:35:51.922209 20572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:35:51.922524 20572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:35:51.922621 20572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:35:51.930025 20572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:35:51.930140 20572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:35:51.930250 20572 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:35:51.939491 20572 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:40357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:40223
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:35:51.940827 20572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:35:51.942718 20572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:35:51.956943 20580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:51.957242 20579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:51.956943 20586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:35:51.957720 20572 server_base.cc:1034] running on GCE node
I20260808 02:35:51.958472 20572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:35:51.959503 20572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:35:51.960765 20572 hybrid_clock.cc:648] HybridClock initialized: now 1786156551960683 us; error 58 us; skew 500 ppm
I20260808 02:35:51.961097 20572 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:35:51.963531 20572 webserver.cc:460] Webserver started at http://127.24.116.194:40689/ using document root <none> and password file <none>
I20260808 02:35:51.964252 20572 fs_manager.cc:359] Metadata directory not provided
I20260808 02:35:51.964411 20572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:35:51.964749 20572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:35:51.967783 20572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "ade13cf55a344912aab54fb02a9936ed"
format_stamp: "Formatted at 2026-08-08 02:35:51 on dist-test-slave-45dx"
server_key: "7cff90fb4e0a886bae92500333afcd79"
server_key_iv: "6df63ccd4f25f7f6b4e374e8a13aadf5"
server_key_version: "encryptionkey@0"
I20260808 02:35:51.968667 20572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "ade13cf55a344912aab54fb02a9936ed"
format_stamp: "Formatted at 2026-08-08 02:35:51 on dist-test-slave-45dx"
server_key: "7cff90fb4e0a886bae92500333afcd79"
server_key_iv: "6df63ccd4f25f7f6b4e374e8a13aadf5"
server_key_version: "encryptionkey@0"
I20260808 02:35:51.973960 20572 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260808 02:35:51.977633 20594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:51.978926 20572 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 02:35:51.979123 20572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "ade13cf55a344912aab54fb02a9936ed"
format_stamp: "Formatted at 2026-08-08 02:35:51 on dist-test-slave-45dx"
server_key: "7cff90fb4e0a886bae92500333afcd79"
server_key_iv: "6df63ccd4f25f7f6b4e374e8a13aadf5"
server_key_version: "encryptionkey@0"
I20260808 02:35:51.979349 20572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:35:52.012372 20572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:35:52.013381 20572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:35:52.013727 20572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:35:52.014802 20572 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:35:52.016358 20572 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:35:52.016494 20572 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:52.016625 20572 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:35:52.016721 20572 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:52.051550 20572 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:36889
I20260808 02:35:52.051645 20784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:36889 every 8 connection(s)
I20260808 02:35:52.052999 20572 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:35:52.057798 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 20572
I20260808 02:35:52.058020 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:35:52.058517 25043 external_mini_cluster.cc:1428] Setting key 56d5bad16420a24184b87a291985e753
I20260808 02:35:52.062050 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:40223
--builtin_ntp_servers=127.24.116.212:40357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 02:35:52.067163 20568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:52.055685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:35991 (local address 127.24.116.254:40223)
0808 02:35:52.055890 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:52.055895 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:52.057452 (+ 1557us) server_negotiation.cc:407] Connection header received
0808 02:35:52.059714 (+ 2262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:52.059720 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:52.059786 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:52.059884 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:52.061263 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.062405 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.063956 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.064708 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.064843 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:52.066172 (+ 1329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:52.066180 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:52.066187 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:35:52.066212 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:52.066255 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:35:52.066273 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:52.066378 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:52.066654 (+ 276us) server_negotiation.cc:299] Negotiation successful
0808 02:35:52.066764 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 02:35:52.068074 20788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:52.056179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40223 (local address 127.24.116.194:35991)
0808 02:35:52.057245 (+ 1066us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:52.057284 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:52.059438 (+ 2154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:52.060147 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:52.060158 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:52.060268 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:35:52.061088 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:52.061108 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.062573 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.062577 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:52.063807 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:52.063819 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.064911 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.064916 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:52.065109 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:52.065855 (+ 746us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:35:52.065858 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:35:52.065897 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:35:52.065974 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:35:52.066405 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:35:52.066414 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:35:52.066421 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 02:35:52.066613 (+ 192us) client_negotiation.cc:240] Negotiation successful
0808 02:35:52.066913 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":611,"thread_start_us":320,"threads_started":1}
I20260808 02:35:52.069661 20785 heartbeater.cc:347] Connected to a master server at 127.24.116.254:40223
I20260808 02:35:52.069993 20785 heartbeater.cc:464] Registering TS with master...
I20260808 02:35:52.070746 20785 heartbeater.cc:511] Master 127.24.116.254:40223 requested a full tablet report, sending...
I20260808 02:35:52.072247 20263 ts_manager.cc:194] Registered new tserver with Master: ade13cf55a344912aab54fb02a9936ed (127.24.116.194:36889)
I20260808 02:35:52.073122 20263 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.116.194:35991
W20260808 02:35:52.436590 20789 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:35:52.436906 20789 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:35:52.437088 20789 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:35:52.444479 20789 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:35:52.444583 20789 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:35:52.444774 20789 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:35:52.454610 20789 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:40357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:40223
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:35:52.456113 20789 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:35:52.458078 20789 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:35:52.472487 20800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:52.472553 20798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:52.472571 20797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:35:52.473665 20789 server_base.cc:1034] running on GCE node
I20260808 02:35:52.474308 20789 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:35:52.475277 20789 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:35:52.476532 20789 hybrid_clock.cc:648] HybridClock initialized: now 1786156552476489 us; error 57 us; skew 500 ppm
I20260808 02:35:52.476935 20789 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:35:52.479400 20789 webserver.cc:460] Webserver started at http://127.24.116.195:39677/ using document root <none> and password file <none>
I20260808 02:35:52.480146 20789 fs_manager.cc:359] Metadata directory not provided
I20260808 02:35:52.480290 20789 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:35:52.480682 20789 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:35:52.484022 20789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "bedf04e8ea614641a5f5d2e5671d1dfc"
format_stamp: "Formatted at 2026-08-08 02:35:52 on dist-test-slave-45dx"
server_key: "24c96ff7657653dc7b63bca98d3bc258"
server_key_iv: "09b93bb2ac2d62cdaff30536a55bc6da"
server_key_version: "encryptionkey@0"
I20260808 02:35:52.485060 20789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "bedf04e8ea614641a5f5d2e5671d1dfc"
format_stamp: "Formatted at 2026-08-08 02:35:52 on dist-test-slave-45dx"
server_key: "24c96ff7657653dc7b63bca98d3bc258"
server_key_iv: "09b93bb2ac2d62cdaff30536a55bc6da"
server_key_version: "encryptionkey@0"
I20260808 02:35:52.490479 20789 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260808 02:35:52.494234 20814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:52.495649 20789 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 02:35:52.495787 20789 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "bedf04e8ea614641a5f5d2e5671d1dfc"
format_stamp: "Formatted at 2026-08-08 02:35:52 on dist-test-slave-45dx"
server_key: "24c96ff7657653dc7b63bca98d3bc258"
server_key_iv: "09b93bb2ac2d62cdaff30536a55bc6da"
server_key_version: "encryptionkey@0"
I20260808 02:35:52.495986 20789 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:35:52.511099 20789 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:35:52.512207 20789 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:35:52.512604 20789 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:35:52.514065 20789 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:35:52.516165 20789 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:35:52.516281 20789 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:52.516429 20789 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:35:52.516525 20789 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:52.556437 20789 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:39659
I20260808 02:35:52.556514 20998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:39659 every 8 connection(s)
I20260808 02:35:52.558207 20789 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:35:52.568008 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 20789
I20260808 02:35:52.568243 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:35:52.568802 25043 external_mini_cluster.cc:1428] Setting key 0ee345dd4f5c79f651499683a711e872
I20260808 02:35:52.576995 20568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:52.561101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:58235 (local address 127.24.116.254:40223)
0808 02:35:52.561321 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:52.561327 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:52.562914 (+ 1587us) server_negotiation.cc:407] Connection header received
0808 02:35:52.564865 (+ 1951us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:52.564871 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:52.564952 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:52.565075 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:52.566302 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.567191 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.569235 (+ 2044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.569658 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.569804 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:52.576092 (+ 6288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:52.576097 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:52.576100 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:35:52.576120 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:52.576186 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:35:52.576208 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:52.576361 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:52.576613 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 02:35:52.576716 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 02:35:52.577750 20560 heartbeater.cc:503] Master 127.24.116.254:40223 was elected leader, sending a full tablet report...
I20260808 02:35:52.578400 21007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:52.561662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:40223 (local address 127.24.116.195:58235)
0808 02:35:52.562682 (+ 1020us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:52.562734 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:52.564493 (+ 1759us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:52.565378 (+ 885us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:52.565388 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:52.565484 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:35:52.566103 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:52.566121 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.567361 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.567365 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:52.569077 (+ 1712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:52.569091 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.569932 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.569940 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:52.570170 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:52.575657 (+ 5487us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:35:52.575660 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:35:52.575713 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:35:52.575823 (+ 110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:35:52.576368 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:35:52.576384 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:35:52.576397 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 02:35:52.576572 (+ 175us) client_negotiation.cc:240] Negotiation successful
0808 02:35:52.576934 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":329,"threads_started":1}
I20260808 02:35:52.580272 21003 heartbeater.cc:347] Connected to a master server at 127.24.116.254:40223
I20260808 02:35:52.580670 21003 heartbeater.cc:464] Registering TS with master...
I20260808 02:35:52.581547 21003 heartbeater.cc:511] Master 127.24.116.254:40223 requested a full tablet report, sending...
I20260808 02:35:52.583328 20263 ts_manager.cc:194] Registered new tserver with Master: bedf04e8ea614641a5f5d2e5671d1dfc (127.24.116.195:39659)
I20260808 02:35:52.584487 20263 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.116.195:58235
I20260808 02:35:52.584782 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:35:52.595587 20568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:52.589174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48074 (local address 127.24.116.254:40223)
0808 02:35:52.589373 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:52.589378 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:52.589928 (+ 550us) server_negotiation.cc:407] Connection header received
0808 02:35:52.590083 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:52.590086 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:52.590146 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:52.590229 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:52.590766 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.591456 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.593225 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.593635 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.593732 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:52.594984 (+ 1252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:52.594988 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:52.594991 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:35:52.595009 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:52.595039 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:35:52.595050 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:52.595118 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:52.595262 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 02:35:52.595348 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 02:35:52.599552 20263 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48074:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:35:52.606894 20263 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:35:52.643795 21027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:52.619829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:39659 (local address 127.0.0.1:60934)
0808 02:35:52.631985 (+ 12156us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:52.632031 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:52.632238 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:52.635432 (+ 3194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:52.635438 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:52.635467 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:35:52.636219 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:52.636237 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.638387 (+ 2150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.638393 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:52.640600 (+ 2207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:52.640613 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.642705 (+ 2092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.642711 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:52.642933 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:52.642987 (+ 54us) client_negotiation.cc:769] Sending connection context
0808 02:35:52.643125 (+ 138us) client_negotiation.cc:240] Negotiation successful
0808 02:35:52.643356 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11858,"mutex_wait_us":141,"thread_start_us":15306,"threads_started":1}
I20260808 02:35:52.644443 21029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:52.620929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52528 (local address 127.24.116.193:40733)
0808 02:35:52.632945 (+ 12016us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:52.632960 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:52.634930 (+ 1970us) server_negotiation.cc:407] Connection header received
0808 02:35:52.635070 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:52.635081 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:52.635334 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:52.635579 (+ 245us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:35:52.636494 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.638240 (+ 1746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.641365 (+ 3125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.642923 (+ 1558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.643144 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:52.643374 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:52.643600 (+ 226us) server_negotiation.cc:299] Negotiation successful
0808 02:35:52.643790 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11747,"thread_start_us":11589,"threads_started":1}
I20260808 02:35:52.644083 21022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:52.620086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:40733 (local address 127.0.0.1:52528)
0808 02:35:52.634578 (+ 14492us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:52.634603 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:52.634748 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:52.635565 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:52.635570 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:52.635620 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:35:52.636219 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:52.636235 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.638416 (+ 2181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.638421 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:52.641108 (+ 2687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:52.641123 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.643197 (+ 2074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.643202 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:52.643381 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:52.643410 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 02:35:52.643492 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 02:35:52.643618 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14310,"mutex_wait_us":212,"spinlock_wait_cycles":1920,"thread_start_us":14127,"threads_started":1}
I20260808 02:35:52.644758 21031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:52.621716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56354 (local address 127.24.116.194:36889)
0808 02:35:52.633483 (+ 11767us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:52.633495 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:52.635759 (+ 2264us) server_negotiation.cc:407] Connection header received
0808 02:35:52.635897 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:52.635903 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:52.636061 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:52.636283 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:35:52.637199 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.638838 (+ 1639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.641611 (+ 2773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.643060 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.643210 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:52.643374 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:52.644194 (+ 820us) server_negotiation.cc:299] Negotiation successful
0808 02:35:52.644410 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11550,"thread_start_us":11406,"threads_started":1}
I20260808 02:35:52.644430 21021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:52.620866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:36889 (local address 127.0.0.1:56354)
0808 02:35:52.635433 (+ 14567us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:52.635456 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:52.635584 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:52.636266 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:52.636275 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:52.636332 (+ 57us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:35:52.636713 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:52.636724 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.639028 (+ 2304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.639033 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:52.641385 (+ 2352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:52.641398 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.643556 (+ 2158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.643565 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:52.643753 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:52.643799 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 02:35:52.643879 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 02:35:52.644011 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14407,"thread_start_us":10633,"threads_started":1}
I20260808 02:35:52.645015 21026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:52.620188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60934 (local address 127.24.116.195:39659)
0808 02:35:52.634165 (+ 13977us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:52.634177 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:52.634226 (+ 49us) server_negotiation.cc:407] Connection header received
0808 02:35:52.634375 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:52.634388 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:52.634762 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:52.635054 (+ 292us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:35:52.636515 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.638230 (+ 1715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.641066 (+ 2836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.642496 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.642722 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:52.643047 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:52.644098 (+ 1051us) server_negotiation.cc:299] Negotiation successful
0808 02:35:52.644281 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13734,"thread_start_us":13544,"threads_started":1}
I20260808 02:35:52.649047 20893 tablet_service.cc:1467] Processing CreateTablet for tablet 2c464064ca1e4423819a286b12c8c39f (DEFAULT_TABLE table=test-table [id=1ba56f522c3945f895359a13e2418788]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:35:52.649065 20462 tablet_service.cc:1467] Processing CreateTablet for tablet 2c464064ca1e4423819a286b12c8c39f (DEFAULT_TABLE table=test-table [id=1ba56f522c3945f895359a13e2418788]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:35:52.649065 20671 tablet_service.cc:1467] Processing CreateTablet for tablet 2c464064ca1e4423819a286b12c8c39f (DEFAULT_TABLE table=test-table [id=1ba56f522c3945f895359a13e2418788]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:35:52.650509 20462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c464064ca1e4423819a286b12c8c39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:35:52.650508 20671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c464064ca1e4423819a286b12c8c39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:35:52.650523 20893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c464064ca1e4423819a286b12c8c39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:35:52.662529 21032 tablet_bootstrap.cc:492] T 2c464064ca1e4423819a286b12c8c39f P bedf04e8ea614641a5f5d2e5671d1dfc: Bootstrap starting.
I20260808 02:35:52.667182 21032 tablet_bootstrap.cc:654] T 2c464064ca1e4423819a286b12c8c39f P bedf04e8ea614641a5f5d2e5671d1dfc: Neither blocks nor log segments found. Creating new log.
I20260808 02:35:52.667428 21036 tablet_bootstrap.cc:492] T 2c464064ca1e4423819a286b12c8c39f P ade13cf55a344912aab54fb02a9936ed: Bootstrap starting.
I20260808 02:35:52.668804 21032 log.cc:824] T 2c464064ca1e4423819a286b12c8c39f P bedf04e8ea614641a5f5d2e5671d1dfc: Log is configured to *not* fsync() on all Append() calls
I20260808 02:35:52.670449 21035 tablet_bootstrap.cc:492] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424: Bootstrap starting.
I20260808 02:35:52.671372 21036 tablet_bootstrap.cc:654] T 2c464064ca1e4423819a286b12c8c39f P ade13cf55a344912aab54fb02a9936ed: Neither blocks nor log segments found. Creating new log.
I20260808 02:35:52.672219 21032 tablet_bootstrap.cc:492] T 2c464064ca1e4423819a286b12c8c39f P bedf04e8ea614641a5f5d2e5671d1dfc: No bootstrap required, opened a new log
I20260808 02:35:52.672549 21032 ts_tablet_manager.cc:1397] T 2c464064ca1e4423819a286b12c8c39f P bedf04e8ea614641a5f5d2e5671d1dfc: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260808 02:35:52.672736 21036 log.cc:824] T 2c464064ca1e4423819a286b12c8c39f P ade13cf55a344912aab54fb02a9936ed: Log is configured to *not* fsync() on all Append() calls
I20260808 02:35:52.674361 21035 tablet_bootstrap.cc:654] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424: Neither blocks nor log segments found. Creating new log.
I20260808 02:35:52.675956 21035 log.cc:824] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424: Log is configured to *not* fsync() on all Append() calls
I20260808 02:35:52.678964 21035 tablet_bootstrap.cc:492] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424: No bootstrap required, opened a new log
I20260808 02:35:52.679261 21035 ts_tablet_manager.cc:1397] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 02:35:52.679425 21036 tablet_bootstrap.cc:492] T 2c464064ca1e4423819a286b12c8c39f P ade13cf55a344912aab54fb02a9936ed: No bootstrap required, opened a new log
I20260808 02:35:52.679715 21036 ts_tablet_manager.cc:1397] T 2c464064ca1e4423819a286b12c8c39f P ade13cf55a344912aab54fb02a9936ed: Time spent bootstrapping tablet: real 0.013s user 0.010s sys 0.000s
I20260808 02:35:52.682968 21032 raft_consensus.cc:348] T 2c464064ca1e4423819a286b12c8c39f P bedf04e8ea614641a5f5d2e5671d1dfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedf04e8ea614641a5f5d2e5671d1dfc" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39659 } } peers { permanent_uuid: "a70f036812844e0fbc8339ad1e742424" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40733 } } peers { permanent_uuid: "ade13cf55a344912aab54fb02a9936ed" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 36889 } }
I20260808 02:35:52.683451 21032 raft_consensus.cc:374] T 2c464064ca1e4423819a286b12c8c39f P bedf04e8ea614641a5f5d2e5671d1dfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:35:52.683562 21032 raft_consensus.cc:729] T 2c464064ca1e4423819a286b12c8c39f P bedf04e8ea614641a5f5d2e5671d1dfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bedf04e8ea614641a5f5d2e5671d1dfc, State: Initialized, Role: FOLLOWER
I20260808 02:35:52.684232 21032 consensus_queue.cc:260] T 2c464064ca1e4423819a286b12c8c39f P bedf04e8ea614641a5f5d2e5671d1dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedf04e8ea614641a5f5d2e5671d1dfc" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39659 } } peers { permanent_uuid: "a70f036812844e0fbc8339ad1e742424" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40733 } } peers { permanent_uuid: "ade13cf55a344912aab54fb02a9936ed" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 36889 } }
I20260808 02:35:52.687934 21035 raft_consensus.cc:348] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedf04e8ea614641a5f5d2e5671d1dfc" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39659 } } peers { permanent_uuid: "a70f036812844e0fbc8339ad1e742424" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40733 } } peers { permanent_uuid: "ade13cf55a344912aab54fb02a9936ed" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 36889 } }
I20260808 02:35:52.688414 21035 raft_consensus.cc:374] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:35:52.688546 21035 raft_consensus.cc:729] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70f036812844e0fbc8339ad1e742424, State: Initialized, Role: FOLLOWER
I20260808 02:35:52.689163 21035 consensus_queue.cc:260] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedf04e8ea614641a5f5d2e5671d1dfc" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39659 } } peers { permanent_uuid: "a70f036812844e0fbc8339ad1e742424" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40733 } } peers { permanent_uuid: "ade13cf55a344912aab54fb02a9936ed" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 36889 } }
I20260808 02:35:52.691125 21035 ts_tablet_manager.cc:1428] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260808 02:35:52.692179 21003 heartbeater.cc:503] Master 127.24.116.254:40223 was elected leader, sending a full tablet report...
I20260808 02:35:52.692903 21036 raft_consensus.cc:348] T 2c464064ca1e4423819a286b12c8c39f P ade13cf55a344912aab54fb02a9936ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedf04e8ea614641a5f5d2e5671d1dfc" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39659 } } peers { permanent_uuid: "a70f036812844e0fbc8339ad1e742424" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40733 } } peers { permanent_uuid: "ade13cf55a344912aab54fb02a9936ed" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 36889 } }
I20260808 02:35:52.693377 21036 raft_consensus.cc:374] T 2c464064ca1e4423819a286b12c8c39f P ade13cf55a344912aab54fb02a9936ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:35:52.693436 21032 ts_tablet_manager.cc:1428] T 2c464064ca1e4423819a286b12c8c39f P bedf04e8ea614641a5f5d2e5671d1dfc: Time spent starting tablet: real 0.021s user 0.019s sys 0.001s
I20260808 02:35:52.693490 21036 raft_consensus.cc:729] T 2c464064ca1e4423819a286b12c8c39f P ade13cf55a344912aab54fb02a9936ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade13cf55a344912aab54fb02a9936ed, State: Initialized, Role: FOLLOWER
I20260808 02:35:52.694134 21036 consensus_queue.cc:260] T 2c464064ca1e4423819a286b12c8c39f P ade13cf55a344912aab54fb02a9936ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedf04e8ea614641a5f5d2e5671d1dfc" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39659 } } peers { permanent_uuid: "a70f036812844e0fbc8339ad1e742424" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40733 } } peers { permanent_uuid: "ade13cf55a344912aab54fb02a9936ed" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 36889 } }
I20260808 02:35:52.695446 20785 heartbeater.cc:503] Master 127.24.116.254:40223 was elected leader, sending a full tablet report...
I20260808 02:35:52.696086 21036 ts_tablet_manager.cc:1428] T 2c464064ca1e4423819a286b12c8c39f P ade13cf55a344912aab54fb02a9936ed: Time spent starting tablet: real 0.016s user 0.017s sys 0.000s
I20260808 02:35:52.800997 21043 raft_consensus.cc:482] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:35:52.801388 21043 raft_consensus.cc:504] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedf04e8ea614641a5f5d2e5671d1dfc" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39659 } } peers { permanent_uuid: "a70f036812844e0fbc8339ad1e742424" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40733 } } peers { permanent_uuid: "ade13cf55a344912aab54fb02a9936ed" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 36889 } }
W20260808 02:35:52.803902 20563 tablet.cc:2369] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:35:52.803334 21043 leader_election.cc:288] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bedf04e8ea614641a5f5d2e5671d1dfc (127.24.116.195:39659), ade13cf55a344912aab54fb02a9936ed (127.24.116.194:36889)
W20260808 02:35:52.805143 20787 tablet.cc:2369] T 2c464064ca1e4423819a286b12c8c39f P ade13cf55a344912aab54fb02a9936ed: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:35:52.810096 21006 tablet.cc:2369] T 2c464064ca1e4423819a286b12c8c39f P bedf04e8ea614641a5f5d2e5671d1dfc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:35:52.811431 21031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:52.803939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:47199 (local address 127.24.116.194:36889)
0808 02:35:52.804133 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:52.804140 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:52.805739 (+ 1599us) server_negotiation.cc:407] Connection header received
0808 02:35:52.806094 (+ 355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:52.806100 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:52.806185 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:52.806291 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:35:52.806863 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.807572 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.809499 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.810267 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.810425 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:52.810510 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:52.811115 (+ 605us) server_negotiation.cc:299] Negotiation successful
0808 02:35:52.811223 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 02:35:52.811776 21047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:52.804788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:36889 (local address 127.24.116.193:47199)
0808 02:35:52.805629 (+ 841us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:52.805648 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:52.805874 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:52.806315 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:52.806320 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:52.806347 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:35:52.806704 (+ 357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:52.806713 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.807724 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.807730 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:52.809305 (+ 1575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:52.809318 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.810626 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.810631 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:52.810838 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:52.810972 (+ 134us) client_negotiation.cc:769] Sending connection context
0808 02:35:52.811070 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 02:35:52.811351 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":700,"mutex_wait_us":112,"thread_start_us":444,"threads_started":1}
I20260808 02:35:52.811798 21046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:52.804025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:39659 (local address 127.24.116.193:36257)
0808 02:35:52.805426 (+ 1401us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:52.805452 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:52.805617 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:52.805991 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:52.805997 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:52.806021 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:35:52.806407 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:52.806417 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.807466 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.807472 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:52.809098 (+ 1626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:52.809111 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.810602 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.810614 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:52.810863 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:52.810976 (+ 113us) client_negotiation.cc:769] Sending connection context
0808 02:35:52.811070 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 02:35:52.811350 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1094,"mutex_wait_us":185,"thread_start_us":838,"threads_started":1}
I20260808 02:35:52.812116 21026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:52.803691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:36257 (local address 127.24.116.195:39659)
0808 02:35:52.803947 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:52.803953 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:52.805541 (+ 1588us) server_negotiation.cc:407] Connection header received
0808 02:35:52.805780 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:52.805786 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:52.805865 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:52.805968 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:35:52.806566 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.807322 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.809298 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.810388 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.810567 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:52.810636 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:52.811682 (+ 1046us) server_negotiation.cc:299] Negotiation successful
0808 02:35:52.811825 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 02:35:52.813231 20927 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c464064ca1e4423819a286b12c8c39f" candidate_uuid: "a70f036812844e0fbc8339ad1e742424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedf04e8ea614641a5f5d2e5671d1dfc" is_pre_election: true
I20260808 02:35:52.813335 20702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c464064ca1e4423819a286b12c8c39f" candidate_uuid: "a70f036812844e0fbc8339ad1e742424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade13cf55a344912aab54fb02a9936ed" is_pre_election: true
I20260808 02:35:52.813817 20927 raft_consensus.cc:2454] T 2c464064ca1e4423819a286b12c8c39f P bedf04e8ea614641a5f5d2e5671d1dfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70f036812844e0fbc8339ad1e742424 in term 0.
I20260808 02:35:52.813900 20702 raft_consensus.cc:2454] T 2c464064ca1e4423819a286b12c8c39f P ade13cf55a344912aab54fb02a9936ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70f036812844e0fbc8339ad1e742424 in term 0.
I20260808 02:35:52.814625 20387 leader_election.cc:302] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: a70f036812844e0fbc8339ad1e742424, ade13cf55a344912aab54fb02a9936ed, bedf04e8ea614641a5f5d2e5671d1dfc; no voters:
I20260808 02:35:52.815092 21043 raft_consensus.cc:2781] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:35:52.815260 21043 raft_consensus.cc:482] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:35:52.815389 21043 raft_consensus.cc:3037] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:35:52.817723 21043 raft_consensus.cc:504] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedf04e8ea614641a5f5d2e5671d1dfc" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39659 } } peers { permanent_uuid: "a70f036812844e0fbc8339ad1e742424" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40733 } } peers { permanent_uuid: "ade13cf55a344912aab54fb02a9936ed" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 36889 } }
I20260808 02:35:52.818409 21043 leader_election.cc:288] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424 [CANDIDATE]: Term 1 election: Requested vote from peers bedf04e8ea614641a5f5d2e5671d1dfc (127.24.116.195:39659), ade13cf55a344912aab54fb02a9936ed (127.24.116.194:36889)
I20260808 02:35:52.818926 20702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c464064ca1e4423819a286b12c8c39f" candidate_uuid: "a70f036812844e0fbc8339ad1e742424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade13cf55a344912aab54fb02a9936ed"
I20260808 02:35:52.818934 20927 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c464064ca1e4423819a286b12c8c39f" candidate_uuid: "a70f036812844e0fbc8339ad1e742424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedf04e8ea614641a5f5d2e5671d1dfc"
I20260808 02:35:52.819142 20702 raft_consensus.cc:3037] T 2c464064ca1e4423819a286b12c8c39f P ade13cf55a344912aab54fb02a9936ed [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:35:52.819154 20927 raft_consensus.cc:3037] T 2c464064ca1e4423819a286b12c8c39f P bedf04e8ea614641a5f5d2e5671d1dfc [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:35:52.821537 20927 raft_consensus.cc:2454] T 2c464064ca1e4423819a286b12c8c39f P bedf04e8ea614641a5f5d2e5671d1dfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70f036812844e0fbc8339ad1e742424 in term 1.
I20260808 02:35:52.821631 20702 raft_consensus.cc:2454] T 2c464064ca1e4423819a286b12c8c39f P ade13cf55a344912aab54fb02a9936ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70f036812844e0fbc8339ad1e742424 in term 1.
I20260808 02:35:52.822022 20387 leader_election.cc:302] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a70f036812844e0fbc8339ad1e742424, bedf04e8ea614641a5f5d2e5671d1dfc; no voters:
I20260808 02:35:52.822329 21043 raft_consensus.cc:2781] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:35:52.822822 21043 raft_consensus.cc:686] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424 [term 1 LEADER]: Becoming Leader. State: Replica: a70f036812844e0fbc8339ad1e742424, State: Running, Role: LEADER
I20260808 02:35:52.823300 21043 consensus_queue.cc:237] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedf04e8ea614641a5f5d2e5671d1dfc" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39659 } } peers { permanent_uuid: "a70f036812844e0fbc8339ad1e742424" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40733 } } peers { permanent_uuid: "ade13cf55a344912aab54fb02a9936ed" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 36889 } }
I20260808 02:35:52.828155 20263 catalog_manager.cc:5495] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424 reported cstate change: term changed from 0 to 1, leader changed from <none> to a70f036812844e0fbc8339ad1e742424 (127.24.116.193). New cstate: current_term: 1 leader_uuid: "a70f036812844e0fbc8339ad1e742424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedf04e8ea614641a5f5d2e5671d1dfc" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a70f036812844e0fbc8339ad1e742424" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ade13cf55a344912aab54fb02a9936ed" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 36889 } health_report { overall_health: UNKNOWN } } }
I20260808 02:35:52.885113 21029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:52.879485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52538 (local address 127.24.116.193:40733)
0808 02:35:52.879707 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:52.879713 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:52.879734 (+ 21us) server_negotiation.cc:407] Connection header received
0808 02:35:52.879920 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:52.879924 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:52.880022 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:52.880187 (+ 165us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:35:52.880616 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.881326 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.882812 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.883257 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.883410 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:52.883922 (+ 512us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:35:52.884525 (+ 603us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:35:52.884707 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:52.884757 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 02:35:52.884840 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 02:35:52.894318 20702 raft_consensus.cc:1261] T 2c464064ca1e4423819a286b12c8c39f P ade13cf55a344912aab54fb02a9936ed [term 1 FOLLOWER]: Refusing update from remote peer a70f036812844e0fbc8339ad1e742424: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:35:52.894318 20927 raft_consensus.cc:1261] T 2c464064ca1e4423819a286b12c8c39f P bedf04e8ea614641a5f5d2e5671d1dfc [term 1 FOLLOWER]: Refusing update from remote peer a70f036812844e0fbc8339ad1e742424: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:35:52.895545 21048 consensus_queue.cc:1035] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade13cf55a344912aab54fb02a9936ed" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:35:52.895905 21043 consensus_queue.cc:1035] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bedf04e8ea614641a5f5d2e5671d1dfc" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:35:52.913615 21056 mvcc.cc:205] Tried to move back new op lower bound from 7316097240642465792 to 7316097240367828992. Current Snapshot: MvccSnapshot[applied={T|T < 7316097240642465792}]
I20260808 02:35:52.928650 20263 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:35:52.928923 20263 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:35:52.932686 20263 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a2fbf0b738f04d61adec17f090c91cf0: Sending DeleteTablet for 3 replicas of tablet 2c464064ca1e4423819a286b12c8c39f
I20260808 02:35:52.934021 20671 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c464064ca1e4423819a286b12c8c39f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:35:52 UTC) from {username='slave'} at 127.0.0.1:56354
I20260808 02:35:52.934026 20462 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c464064ca1e4423819a286b12c8c39f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:35:52 UTC) from {username='slave'} at 127.0.0.1:52528
I20260808 02:35:52.934031 20893 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c464064ca1e4423819a286b12c8c39f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:35:52 UTC) from {username='slave'} at 127.0.0.1:60934
I20260808 02:35:52.939488 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 20361
I20260808 02:35:52.947584 21070 tablet_replica.cc:330] T 2c464064ca1e4423819a286b12c8c39f P ade13cf55a344912aab54fb02a9936ed: stopping tablet replica
I20260808 02:35:52.948338 21070 raft_consensus.cc:2229] T 2c464064ca1e4423819a286b12c8c39f P ade13cf55a344912aab54fb02a9936ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:35:52.949074 21070 raft_consensus.cc:2258] T 2c464064ca1e4423819a286b12c8c39f P ade13cf55a344912aab54fb02a9936ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:35:52.950304 21068 tablet_replica.cc:330] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424: stopping tablet replica
I20260808 02:35:52.950732 21068 raft_consensus.cc:2229] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:35:52.951426 21068 raft_consensus.cc:2258] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:35:52.953437 21070 ts_tablet_manager.cc:1905] T 2c464064ca1e4423819a286b12c8c39f P ade13cf55a344912aab54fb02a9936ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:35:52.954257 21068 ts_tablet_manager.cc:1905] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:35:52.961350 21070 ts_tablet_manager.cc:1918] T 2c464064ca1e4423819a286b12c8c39f P ade13cf55a344912aab54fb02a9936ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:35:52.961537 21070 log.cc:1196] T 2c464064ca1e4423819a286b12c8c39f P ade13cf55a344912aab54fb02a9936ed: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/2c464064ca1e4423819a286b12c8c39f
I20260808 02:35:52.962128 21070 ts_tablet_manager.cc:1939] T 2c464064ca1e4423819a286b12c8c39f P ade13cf55a344912aab54fb02a9936ed: Deleting consensus metadata
I20260808 02:35:52.962587 21068 ts_tablet_manager.cc:1918] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:35:52.962847 21068 log.cc:1196] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/2c464064ca1e4423819a286b12c8c39f
I20260808 02:35:52.963552 21068 ts_tablet_manager.cc:1939] T 2c464064ca1e4423819a286b12c8c39f P a70f036812844e0fbc8339ad1e742424: Deleting consensus metadata
I20260808 02:35:52.964409 20241 catalog_manager.cc:4841] TS ade13cf55a344912aab54fb02a9936ed (127.24.116.194:36889): tablet 2c464064ca1e4423819a286b12c8c39f (table test-table [id=1ba56f522c3945f895359a13e2418788]) successfully deleted
I20260808 02:35:52.965543 20242 catalog_manager.cc:4841] TS a70f036812844e0fbc8339ad1e742424 (127.24.116.193:40733): tablet 2c464064ca1e4423819a286b12c8c39f (table test-table [id=1ba56f522c3945f895359a13e2418788]) successfully deleted
I20260808 02:35:52.969565 21075 tablet_replica.cc:330] T 2c464064ca1e4423819a286b12c8c39f P bedf04e8ea614641a5f5d2e5671d1dfc: stopping tablet replica
I20260808 02:35:52.970132 21075 raft_consensus.cc:2229] T 2c464064ca1e4423819a286b12c8c39f P bedf04e8ea614641a5f5d2e5671d1dfc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:35:52.970709 21075 raft_consensus.cc:2258] T 2c464064ca1e4423819a286b12c8c39f P bedf04e8ea614641a5f5d2e5671d1dfc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:35:52.973104 21075 ts_tablet_manager.cc:1905] T 2c464064ca1e4423819a286b12c8c39f P bedf04e8ea614641a5f5d2e5671d1dfc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:35:52.977988 21029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:52.941075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52552 (local address 127.24.116.193:40733)
0808 02:35:52.941293 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:52.941299 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:52.968921 (+ 27622us) server_negotiation.cc:407] Connection header received
0808 02:35:52.969141 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:52.969147 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:52.969256 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:52.969379 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:52.970138 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.971396 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.973455 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:52.974122 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:52.974230 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:52.975918 (+ 1688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:52.975932 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:52.975949 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:35:52.976802 (+ 853us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:52.976862 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:35:52.977051 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:52.977169 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:52.977466 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 02:35:52.977578 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 02:35:52.979221 20555 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:35:52.980705 21075 ts_tablet_manager.cc:1918] T 2c464064ca1e4423819a286b12c8c39f P bedf04e8ea614641a5f5d2e5671d1dfc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:35:52.980891 21075 log.cc:1196] T 2c464064ca1e4423819a286b12c8c39f P bedf04e8ea614641a5f5d2e5671d1dfc: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/2c464064ca1e4423819a286b12c8c39f
I20260808 02:35:52.981431 21075 ts_tablet_manager.cc:1939] T 2c464064ca1e4423819a286b12c8c39f P bedf04e8ea614641a5f5d2e5671d1dfc: Deleting consensus metadata
I20260808 02:35:52.983492 20243 catalog_manager.cc:4841] TS bedf04e8ea614641a5f5d2e5671d1dfc (127.24.116.195:39659): tablet 2c464064ca1e4423819a286b12c8c39f (table test-table [id=1ba56f522c3945f895359a13e2418788]) successfully deleted
I20260808 02:35:53.081014 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 20361
I20260808 02:35:53.107568 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 20572
I20260808 02:35:53.114903 21031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:53.108567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56358 (local address 127.24.116.194:36889)
0808 02:35:53.108791 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:53.108797 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:53.108821 (+ 24us) server_negotiation.cc:407] Connection header received
0808 02:35:53.108938 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:53.108942 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:53.109023 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:53.109135 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:53.109606 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:53.110379 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:53.111707 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:53.112116 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:53.112267 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:53.113484 (+ 1217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:53.113493 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:53.113508 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:35:53.114171 (+ 663us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:53.114222 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:35:53.114242 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:53.114381 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:53.114504 (+ 123us) server_negotiation.cc:299] Negotiation successful
0808 02:35:53.114599 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 02:35:53.115648 20771 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:35:53.207176 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 20572
I20260808 02:35:53.239166 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 20789
I20260808 02:35:53.246527 21026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:53.240046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60946 (local address 127.24.116.195:39659)
0808 02:35:53.240247 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:53.240255 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:53.240362 (+ 107us) server_negotiation.cc:407] Connection header received
0808 02:35:53.240602 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:53.240608 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:53.240710 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:53.240823 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:53.241252 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:53.242024 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:53.243308 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:53.243702 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:53.243853 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:53.245032 (+ 1179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:53.245041 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:53.245057 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:35:53.245645 (+ 588us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:53.245693 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:35:53.245714 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:53.245855 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:53.245985 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 02:35:53.246105 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 02:35:53.247390 20992 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:35:53.337456 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 20789
I20260808 02:35:53.366508 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 20222
I20260808 02:35:53.367614 20318 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:35:53.478763 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 20222
2026-08-08T02:35:53Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3087 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:35:53 dist-test-slave-45dx krb5kdc[21092](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:35:53 dist-test-slave-45dx krb5kdc[21092](info): set up 2 sockets
Aug 08 02:35:53 dist-test-slave-45dx krb5kdc[21092](info): commencing operation
krb5kdc: starting...
W20260808 02:35:54.854948 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.324s user 0.000s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:35:55 dist-test-slave-45dx krb5kdc[21092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:35:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:35:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:35:55.204854 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:44097
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:40689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:44097
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:35:55.563295 21114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:35:55.563689 21114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:35:55.563870 21114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:35:55.571352 21114 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:35:55.571520 21114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:35:55.571642 21114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:35:55.571753 21114 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:35:55.571838 21114 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:35:55.582161 21114 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:40689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:44097
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:44097
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:35:55.583732 21114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:35:55.585182 21114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:35:55.597920 21120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:55.597996 21125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:55.597951 21121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:35:55.599261 21114 server_base.cc:1034] running on GCE node
I20260808 02:35:55.600122 21114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:35:55.601666 21114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:35:55.602960 21114 hybrid_clock.cc:648] HybridClock initialized: now 1786156555602906 us; error 48 us; skew 500 ppm
I20260808 02:35:55.603434 21114 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:35:55 dist-test-slave-45dx krb5kdc[21092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156555, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:35:55.606977 21114 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:35:55.608752 21114 webserver.cc:460] Webserver started at http://127.24.116.254:45143/ using document root <none> and password file <none>
I20260808 02:35:55.609448 21114 fs_manager.cc:359] Metadata directory not provided
I20260808 02:35:55.609560 21114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:35:55.609823 21114 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:35:55.613082 21114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "fbd49998fb4c49a1afb67cb9fee7726d"
format_stamp: "Formatted at 2026-08-08 02:35:55 on dist-test-slave-45dx"
server_key: "91fcc448928fabc264535aefe1ac05d2"
server_key_iv: "4850e4a77b6234e40b529cdefa642689"
server_key_version: "encryptionkey@0"
I20260808 02:35:55.613811 21114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "fbd49998fb4c49a1afb67cb9fee7726d"
format_stamp: "Formatted at 2026-08-08 02:35:55 on dist-test-slave-45dx"
server_key: "91fcc448928fabc264535aefe1ac05d2"
server_key_iv: "4850e4a77b6234e40b529cdefa642689"
server_key_version: "encryptionkey@0"
I20260808 02:35:55.619282 21114 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 02:35:55.623031 21138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:55.624543 21114 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:35:55.624754 21114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "fbd49998fb4c49a1afb67cb9fee7726d"
format_stamp: "Formatted at 2026-08-08 02:35:55 on dist-test-slave-45dx"
server_key: "91fcc448928fabc264535aefe1ac05d2"
server_key_iv: "4850e4a77b6234e40b529cdefa642689"
server_key_version: "encryptionkey@0"
I20260808 02:35:55.625000 21114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:35:55.652928 21114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:35:55.657939 21114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:35:55.658309 21114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:35:55.678730 21114 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:44097
I20260808 02:35:55.678752 21216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:44097 every 8 connection(s)
I20260808 02:35:55.680367 21114 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:35:55.684604 21217 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:35:55.689194 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 21114
I20260808 02:35:55.689400 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:35:55.689904 25043 external_mini_cluster.cc:1428] Setting key bbd6ee62b8a581e84e7970c5cb862ff8
I20260808 02:35:55.697870 21217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbd49998fb4c49a1afb67cb9fee7726d: Bootstrap starting.
I20260808 02:35:55.701839 21217 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbd49998fb4c49a1afb67cb9fee7726d: Neither blocks nor log segments found. Creating new log.
I20260808 02:35:55.702997 21217 log.cc:824] T 00000000000000000000000000000000 P fbd49998fb4c49a1afb67cb9fee7726d: Log is configured to *not* fsync() on all Append() calls
I20260808 02:35:55.707033 21217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbd49998fb4c49a1afb67cb9fee7726d: No bootstrap required, opened a new log
Aug 08 02:35:55 dist-test-slave-45dx krb5kdc[21092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:35:55.716564 21221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:55.692011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53338 (local address 127.24.116.254:44097)
0808 02:35:55.692966 (+ 955us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:55.692983 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:55.693036 (+ 53us) server_negotiation.cc:407] Connection header received
0808 02:35:55.695887 (+ 2851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:55.695923 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:55.696504 (+ 581us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:55.696979 (+ 475us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:55.698552 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:55.700649 (+ 2097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:55.702144 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:55.702848 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:55.703078 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:55.708666 (+ 5588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:55.708675 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:55.708690 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:55.708731 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:55.712036 (+ 3305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:55.712893 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:55.712905 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:55.712919 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:55.713108 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:55.713528 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:55.713533 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:55.713537 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:55.714119 (+ 582us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:55.714474 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:55.714940 (+ 466us) server_negotiation.cc:299] Negotiation successful
0808 02:35:55.715405 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654,"thread_start_us":406,"threads_started":1}
I20260808 02:35:55.716667 21217 raft_consensus.cc:348] T 00000000000000000000000000000000 P fbd49998fb4c49a1afb67cb9fee7726d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbd49998fb4c49a1afb67cb9fee7726d" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 44097 } }
I20260808 02:35:55.717172 21217 raft_consensus.cc:374] T 00000000000000000000000000000000 P fbd49998fb4c49a1afb67cb9fee7726d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:35:55.717306 21217 raft_consensus.cc:729] T 00000000000000000000000000000000 P fbd49998fb4c49a1afb67cb9fee7726d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbd49998fb4c49a1afb67cb9fee7726d, State: Initialized, Role: FOLLOWER
I20260808 02:35:55.717953 21217 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbd49998fb4c49a1afb67cb9fee7726d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbd49998fb4c49a1afb67cb9fee7726d" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 44097 } }
I20260808 02:35:55.718271 21217 raft_consensus.cc:388] T 00000000000000000000000000000000 P fbd49998fb4c49a1afb67cb9fee7726d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:35:55.718456 21217 raft_consensus.cc:482] T 00000000000000000000000000000000 P fbd49998fb4c49a1afb67cb9fee7726d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:35:55.718672 21217 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fbd49998fb4c49a1afb67cb9fee7726d [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:35:55.721715 21217 raft_consensus.cc:504] T 00000000000000000000000000000000 P fbd49998fb4c49a1afb67cb9fee7726d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbd49998fb4c49a1afb67cb9fee7726d" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 44097 } }
I20260808 02:35:55.722374 21217 leader_election.cc:302] T 00000000000000000000000000000000 P fbd49998fb4c49a1afb67cb9fee7726d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fbd49998fb4c49a1afb67cb9fee7726d; no voters:
I20260808 02:35:55.723057 21217 leader_election.cc:288] T 00000000000000000000000000000000 P fbd49998fb4c49a1afb67cb9fee7726d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:35:55.723176 21223 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fbd49998fb4c49a1afb67cb9fee7726d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:35:55.723882 21223 raft_consensus.cc:686] T 00000000000000000000000000000000 P fbd49998fb4c49a1afb67cb9fee7726d [term 1 LEADER]: Becoming Leader. State: Replica: fbd49998fb4c49a1afb67cb9fee7726d, State: Running, Role: LEADER
I20260808 02:35:55.724586 21223 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbd49998fb4c49a1afb67cb9fee7726d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbd49998fb4c49a1afb67cb9fee7726d" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 44097 } }
I20260808 02:35:55.725596 21217 sys_catalog.cc:564] T 00000000000000000000000000000000 P fbd49998fb4c49a1afb67cb9fee7726d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:35:55.727675 21224 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbd49998fb4c49a1afb67cb9fee7726d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fbd49998fb4c49a1afb67cb9fee7726d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbd49998fb4c49a1afb67cb9fee7726d" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 44097 } } }
I20260808 02:35:55.728080 21224 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbd49998fb4c49a1afb67cb9fee7726d [sys.catalog]: This master's current role is: LEADER
I20260808 02:35:55.727725 21225 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbd49998fb4c49a1afb67cb9fee7726d [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbd49998fb4c49a1afb67cb9fee7726d. Latest consensus state: current_term: 1 leader_uuid: "fbd49998fb4c49a1afb67cb9fee7726d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbd49998fb4c49a1afb67cb9fee7726d" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 44097 } } }
I20260808 02:35:55.728400 21225 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbd49998fb4c49a1afb67cb9fee7726d [sys.catalog]: This master's current role is: LEADER
I20260808 02:35:55.729889 21229 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:35:55.734943 21229 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:35:55.744562 21229 catalog_manager.cc:1347] Generated new cluster ID: 410cef4c330140e4a59082d72b41c228
I20260808 02:35:55.744684 21229 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:35:55.759922 21229 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:35:55.761432 21229 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:35:55.782755 21229 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fbd49998fb4c49a1afb67cb9fee7726d: Generated new TSK 0
I20260808 02:35:55.783676 21229 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.116.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
I20260808 02:35:55.859196 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:44097
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:40689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:35:56.226092 21253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:35:56.226399 21253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:35:56.226574 21253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:35:56.235253 21253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:35:56.235406 21253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:35:56.235617 21253 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:35:56.246112 21253 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:40689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:44097
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:35:56.247377 21253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:35:56.248799 21253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:35:56.265990 21261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:56.266629 21259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:56.266786 21264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:35:56.267437 21253 server_base.cc:1034] running on GCE node
I20260808 02:35:56.268148 21253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:35:56.269169 21253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:35:56.270395 21253 hybrid_clock.cc:648] HybridClock initialized: now 1786156556270342 us; error 39 us; skew 500 ppm
I20260808 02:35:56.270726 21253 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:35:56 dist-test-slave-45dx krb5kdc[21092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156556, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:35:56.274055 21253 init.cc:377] Logged in from keytab as kudu/127.24.116.193@KRBTEST.COM (short username kudu)
I20260808 02:35:56.275565 21253 webserver.cc:460] Webserver started at http://127.24.116.193:46765/ using document root <none> and password file <none>
I20260808 02:35:56.276257 21253 fs_manager.cc:359] Metadata directory not provided
I20260808 02:35:56.276461 21253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:35:56.276813 21253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:35:56.279824 21253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "666c514777194331a5fc5fbdb394e73a"
format_stamp: "Formatted at 2026-08-08 02:35:56 on dist-test-slave-45dx"
server_key: "14e3a16b39cb7e65cc156562adc3b59d"
server_key_iv: "0440aad3fef71f5e251d371156ecae1a"
server_key_version: "encryptionkey@0"
I20260808 02:35:56.280668 21253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "666c514777194331a5fc5fbdb394e73a"
format_stamp: "Formatted at 2026-08-08 02:35:56 on dist-test-slave-45dx"
server_key: "14e3a16b39cb7e65cc156562adc3b59d"
server_key_iv: "0440aad3fef71f5e251d371156ecae1a"
server_key_version: "encryptionkey@0"
I20260808 02:35:56.286491 21253 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 02:35:56.290236 21272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:56.292075 21253 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 02:35:56.292289 21253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "666c514777194331a5fc5fbdb394e73a"
format_stamp: "Formatted at 2026-08-08 02:35:56 on dist-test-slave-45dx"
server_key: "14e3a16b39cb7e65cc156562adc3b59d"
server_key_iv: "0440aad3fef71f5e251d371156ecae1a"
server_key_version: "encryptionkey@0"
I20260808 02:35:56.292601 21253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:35:56.333454 21253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:35:56.337885 21253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:35:56.338213 21253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:35:56.339239 21253 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:35:56.340651 21253 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:35:56.340735 21253 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:56.340921 21253 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:35:56.340991 21253 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:56.375767 21253 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:37447
I20260808 02:35:56.375869 21455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:37447 every 8 connection(s)
I20260808 02:35:56.377225 21253 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:35:56.383582 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 21253
I20260808 02:35:56.383821 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:35:56.384344 25043 external_mini_cluster.cc:1428] Setting key 3ec98b4113e1544fe63f4f4887e99fb7
Aug 08 02:35:56 dist-test-slave-45dx krb5kdc[21092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156556, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:35:56.400964 21459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:56.379835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:56379 (local address 127.24.116.254:44097)
0808 02:35:56.380389 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:56.380394 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:56.381302 (+ 908us) server_negotiation.cc:407] Connection header received
0808 02:35:56.383294 (+ 1992us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:56.383300 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:56.383404 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:56.383525 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:56.385476 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:56.386694 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:56.389273 (+ 2579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:56.389726 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:56.389876 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:56.394399 (+ 4523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:56.394404 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:56.394407 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:56.394441 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:56.397503 (+ 3062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:56.398411 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:56.398419 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:56.398422 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:56.398575 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:56.399052 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:56.399057 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:56.399061 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:56.399357 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:56.399525 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:56.400351 (+ 826us) server_negotiation.cc:299] Negotiation successful
0808 02:35:56.400597 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":263,"threads_started":1}
I20260808 02:35:56.402105 21461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:56.380396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:44097 (local address 127.24.116.193:56379)
0808 02:35:56.381128 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:56.381176 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:56.382965 (+ 1789us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:56.383803 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:56.383816 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:56.384518 (+ 702us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:35:56.385221 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:56.385249 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:56.386914 (+ 1665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:56.386919 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:56.389096 (+ 2177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:56.389116 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:56.390007 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:56.390017 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:56.390356 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:56.391195 (+ 839us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:35:56.391230 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:35:56.394110 (+ 2880us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:35:56.397650 (+ 3540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:35:56.397661 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:35:56.397678 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:35:56.398272 (+ 594us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:35:56.398695 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:35:56.398700 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:35:56.398704 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:35:56.398921 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:35:56.399505 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:35:56.399513 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:35:56.399899 (+ 386us) client_negotiation.cc:769] Sending connection context
0808 02:35:56.400189 (+ 290us) client_negotiation.cc:240] Negotiation successful
0808 02:35:56.400814 (+ 625us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":283,"threads_started":1}
I20260808 02:35:56.403824 21457 heartbeater.cc:347] Connected to a master server at 127.24.116.254:44097
I20260808 02:35:56.404175 21457 heartbeater.cc:464] Registering TS with master...
I20260808 02:35:56.405210 21457 heartbeater.cc:511] Master 127.24.116.254:44097 requested a full tablet report, sending...
I20260808 02:35:56.407742 21162 ts_manager.cc:194] Registered new tserver with Master: 666c514777194331a5fc5fbdb394e73a (127.24.116.193:37447)
I20260808 02:35:56.410028 21162 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.193@KRBTEST.COM'} at 127.24.116.193:56379
WARNING: no policy specified for kudu/127.24.116.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
I20260808 02:35:56.464134 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:44097
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:40689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:35:56.821559 21465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:35:56.821877 21465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:35:56.821983 21465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:35:56.829448 21465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:35:56.829604 21465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:35:56.829746 21465 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:35:56.839447 21465 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:40689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:44097
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:35:56.840732 21465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:35:56.842060 21465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:35:56.854992 21473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:56.854982 21477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:56.855337 21475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:35:56.856760 21465 server_base.cc:1034] running on GCE node
I20260808 02:35:56.857501 21465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:35:56.858645 21465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:35:56.859886 21465 hybrid_clock.cc:648] HybridClock initialized: now 1786156556859799 us; error 62 us; skew 500 ppm
I20260808 02:35:56.860239 21465 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:35:56 dist-test-slave-45dx krb5kdc[21092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156556, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:35:56.863729 21465 init.cc:377] Logged in from keytab as kudu/127.24.116.194@KRBTEST.COM (short username kudu)
I20260808 02:35:56.865459 21465 webserver.cc:460] Webserver started at http://127.24.116.194:37315/ using document root <none> and password file <none>
I20260808 02:35:56.866230 21465 fs_manager.cc:359] Metadata directory not provided
I20260808 02:35:56.866381 21465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:35:56.866736 21465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:35:56.869979 21465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "a48e446f6c6343c8b387b282c64c95dc"
format_stamp: "Formatted at 2026-08-08 02:35:56 on dist-test-slave-45dx"
server_key: "3837c937b80c6736b024c5843beec104"
server_key_iv: "79843fe02d2e5a00965ddb0b01873f6f"
server_key_version: "encryptionkey@0"
I20260808 02:35:56.870831 21465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "a48e446f6c6343c8b387b282c64c95dc"
format_stamp: "Formatted at 2026-08-08 02:35:56 on dist-test-slave-45dx"
server_key: "3837c937b80c6736b024c5843beec104"
server_key_iv: "79843fe02d2e5a00965ddb0b01873f6f"
server_key_version: "encryptionkey@0"
I20260808 02:35:56.876588 21465 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 02:35:56.880362 21488 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:56.881887 21465 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:35:56.882172 21465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "a48e446f6c6343c8b387b282c64c95dc"
format_stamp: "Formatted at 2026-08-08 02:35:56 on dist-test-slave-45dx"
server_key: "3837c937b80c6736b024c5843beec104"
server_key_iv: "79843fe02d2e5a00965ddb0b01873f6f"
server_key_version: "encryptionkey@0"
I20260808 02:35:56.882413 21465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:35:56.911393 21465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:35:56.915992 21465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:35:56.916361 21465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:35:56.917444 21465 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:35:56.919062 21465 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:35:56.919145 21465 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:56.919319 21465 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:35:56.919380 21465 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:56.955873 21465 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:45741
I20260808 02:35:56.955971 21671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:45741 every 8 connection(s)
I20260808 02:35:56.957262 21465 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:35:56.959261 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 21465
I20260808 02:35:56.959497 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:35:56.960104 25043 external_mini_cluster.cc:1428] Setting key 121de31d92264d1c9a0eefae11c4eb2e
Aug 08 02:35:56 dist-test-slave-45dx krb5kdc[21092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156556, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:35:56.980917 21675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:56.960274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:60605 (local address 127.24.116.254:44097)
0808 02:35:56.960843 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:56.960848 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:56.964103 (+ 3255us) server_negotiation.cc:407] Connection header received
0808 02:35:56.964168 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:56.964175 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:56.964257 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:56.964385 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:56.966469 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:56.967194 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:56.969698 (+ 2504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:56.970120 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:56.970215 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:56.974672 (+ 4457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:56.974677 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:56.974681 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:56.974714 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:56.977833 (+ 3119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:56.978561 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:56.978567 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:56.978577 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:56.978703 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:56.979155 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:56.979160 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:56.979162 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:56.979429 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:56.979590 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:56.980265 (+ 675us) server_negotiation.cc:299] Negotiation successful
0808 02:35:56.980512 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":231,"threads_started":1}
I20260808 02:35:56.981945 21676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:56.960926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:44097 (local address 127.24.116.194:60605)
0808 02:35:56.961870 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:56.961956 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:56.963797 (+ 1841us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:56.964659 (+ 862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:56.964673 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:56.965469 (+ 796us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:35:56.966275 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:56.966304 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:56.967384 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:56.967392 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:56.969532 (+ 2140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:56.969551 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:56.970351 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:56.970361 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:56.970683 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:56.971490 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:35:56.971524 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:35:56.974332 (+ 2808us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:35:56.977976 (+ 3644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:35:56.977985 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:35:56.978001 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:35:56.978427 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:35:56.978825 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:35:56.978830 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:35:56.978834 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:35:56.979024 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:35:56.979563 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:35:56.979571 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:35:56.979905 (+ 334us) client_negotiation.cc:769] Sending connection context
0808 02:35:56.980175 (+ 270us) client_negotiation.cc:240] Negotiation successful
0808 02:35:56.980736 (+ 561us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":644,"thread_start_us":410,"threads_started":1}
I20260808 02:35:56.983461 21672 heartbeater.cc:347] Connected to a master server at 127.24.116.254:44097
I20260808 02:35:56.983839 21672 heartbeater.cc:464] Registering TS with master...
I20260808 02:35:56.984632 21672 heartbeater.cc:511] Master 127.24.116.254:44097 requested a full tablet report, sending...
I20260808 02:35:56.986254 21162 ts_manager.cc:194] Registered new tserver with Master: a48e446f6c6343c8b387b282c64c95dc (127.24.116.194:45741)
I20260808 02:35:56.987713 21162 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.194@KRBTEST.COM'} at 127.24.116.194:60605
WARNING: no policy specified for kudu/127.24.116.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
I20260808 02:35:57.036118 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:44097
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:40689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:35:57.394150 21680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:35:57.394472 21680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:35:57.394589 21680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:35:57.402226 21680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:35:57.402344 21680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:35:57.402460 21680 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:35:57.412146 21680 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:40689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:44097
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:35:57.413455 21680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:35:57.414086 21457 heartbeater.cc:503] Master 127.24.116.254:44097 was elected leader, sending a full tablet report...
I20260808 02:35:57.415051 21680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:35:57.428740 21687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:57.428952 21688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:57.428891 21690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:35:57.430315 21680 server_base.cc:1034] running on GCE node
I20260808 02:35:57.430950 21680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:35:57.431878 21680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:35:57.433148 21680 hybrid_clock.cc:648] HybridClock initialized: now 1786156557433090 us; error 58 us; skew 500 ppm
I20260808 02:35:57.433472 21680 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:35:57 dist-test-slave-45dx krb5kdc[21092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156557, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:35:57.436774 21680 init.cc:377] Logged in from keytab as kudu/127.24.116.195@KRBTEST.COM (short username kudu)
I20260808 02:35:57.438318 21680 webserver.cc:460] Webserver started at http://127.24.116.195:42091/ using document root <none> and password file <none>
I20260808 02:35:57.439035 21680 fs_manager.cc:359] Metadata directory not provided
I20260808 02:35:57.439190 21680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:35:57.439576 21680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:35:57.442678 21680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "4f3bf3f1fbe24c0ab738d219eaa39004"
format_stamp: "Formatted at 2026-08-08 02:35:57 on dist-test-slave-45dx"
server_key: "26ee715be122721dd78e11ef9e764a35"
server_key_iv: "7ae5957e7d52c6d2ffc0da667d69f362"
server_key_version: "encryptionkey@0"
I20260808 02:35:57.443545 21680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "4f3bf3f1fbe24c0ab738d219eaa39004"
format_stamp: "Formatted at 2026-08-08 02:35:57 on dist-test-slave-45dx"
server_key: "26ee715be122721dd78e11ef9e764a35"
server_key_iv: "7ae5957e7d52c6d2ffc0da667d69f362"
server_key_version: "encryptionkey@0"
I20260808 02:35:57.449343 21680 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 02:35:57.452988 21699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:57.454413 21680 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:35:57.454600 21680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "4f3bf3f1fbe24c0ab738d219eaa39004"
format_stamp: "Formatted at 2026-08-08 02:35:57 on dist-test-slave-45dx"
server_key: "26ee715be122721dd78e11ef9e764a35"
server_key_iv: "7ae5957e7d52c6d2ffc0da667d69f362"
server_key_version: "encryptionkey@0"
I20260808 02:35:57.454814 21680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:35:57.469136 21680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:35:57.473261 21680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:35:57.473564 21680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:35:57.474555 21680 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:35:57.475883 21680 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:35:57.475991 21680 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:57.476138 21680 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:35:57.476217 21680 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:57.511442 21680 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:37717
I20260808 02:35:57.511492 21862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:37717 every 8 connection(s)
I20260808 02:35:57.512835 21680 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:35:57.521214 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 21680
I20260808 02:35:57.521430 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:35:57.522154 25043 external_mini_cluster.cc:1428] Setting key 0cc45b71cb085837fda43bc5b45c601f
Aug 08 02:35:57 dist-test-slave-45dx krb5kdc[21092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156557, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:35:57.541787 21870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:57.515495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:54485 (local address 127.24.116.254:44097)
0808 02:35:57.515986 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:57.515990 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:57.517013 (+ 1023us) server_negotiation.cc:407] Connection header received
0808 02:35:57.518895 (+ 1882us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:57.518900 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:57.518989 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:57.519127 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:57.523377 (+ 4250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.524613 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.527075 (+ 2462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.527723 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.527847 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:57.534223 (+ 6376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:57.534231 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:57.534240 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:57.534283 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:57.538314 (+ 4031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:57.539101 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:57.539107 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:57.539111 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:57.539252 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:57.539715 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:57.539720 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:57.539724 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:57.540020 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:57.540189 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:57.541136 (+ 947us) server_negotiation.cc:299] Negotiation successful
0808 02:35:57.541369 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":259,"threads_started":1}
I20260808 02:35:57.542783 21873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:57.516057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:44097 (local address 127.24.116.195:54485)
0808 02:35:57.516832 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:57.516881 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:57.518589 (+ 1708us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:57.519444 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:57.519456 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:57.520269 (+ 813us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:35:57.523159 (+ 2890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:57.523186 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.524816 (+ 1630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.524821 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:57.526936 (+ 2115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:57.526956 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.529085 (+ 2129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.529090 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:57.529291 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:57.531143 (+ 1852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:35:57.531167 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:35:57.533999 (+ 2832us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:35:57.538488 (+ 4489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:35:57.538498 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:35:57.538517 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:35:57.538958 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:35:57.539372 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:35:57.539377 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:35:57.539381 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:35:57.539586 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:35:57.540165 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:35:57.540173 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:35:57.540684 (+ 511us) client_negotiation.cc:769] Sending connection context
0808 02:35:57.541012 (+ 328us) client_negotiation.cc:240] Negotiation successful
0808 02:35:57.541576 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":315,"threads_started":1}
I20260808 02:35:57.544344 21864 heartbeater.cc:347] Connected to a master server at 127.24.116.254:44097
I20260808 02:35:57.544703 21864 heartbeater.cc:464] Registering TS with master...
I20260808 02:35:57.545439 21864 heartbeater.cc:511] Master 127.24.116.254:44097 requested a full tablet report, sending...
I20260808 02:35:57.546984 21162 ts_manager.cc:194] Registered new tserver with Master: 4f3bf3f1fbe24c0ab738d219eaa39004 (127.24.116.195:37717)
I20260808 02:35:57.548035 21162 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.195@KRBTEST.COM'} at 127.24.116.195:54485
I20260808 02:35:57.550323 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:35:57.568215 21870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:57.554667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53354 (local address 127.24.116.254:44097)
0808 02:35:57.554914 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:57.554924 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:57.555318 (+ 394us) server_negotiation.cc:407] Connection header received
0808 02:35:57.555434 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:57.555438 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:57.555499 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:57.555578 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:57.557165 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.557894 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.559210 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.559625 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.559757 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:57.562824 (+ 3067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:57.562829 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:57.562832 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:57.562888 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:57.565619 (+ 2731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:57.566365 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:57.566369 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:57.566371 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:57.566488 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:57.566871 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:57.566874 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:57.566876 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:57.567174 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:57.567376 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:57.567669 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 02:35:57.567815 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 02:35:57.572513 21162 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53354:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:35:57.579353 21162 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:35:57.605806 21890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:57.591665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:37447 (local address 127.0.0.1:49142)
0808 02:35:57.592812 (+ 1147us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:57.592854 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:57.593028 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:57.594997 (+ 1969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:57.595008 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:57.595051 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:35:57.595608 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:57.595625 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.598344 (+ 2719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.598353 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:57.601655 (+ 3302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:57.601676 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.604370 (+ 2694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.604380 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:57.604696 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:57.604785 (+ 89us) client_negotiation.cc:769] Sending connection context
0808 02:35:57.604942 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 02:35:57.605219 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":916,"thread_start_us":750,"threads_started":1}
I20260808 02:35:57.607043 21892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:57.591990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:37717 (local address 127.0.0.1:46214)
0808 02:35:57.594611 (+ 2621us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:57.594631 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:57.594759 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:57.595884 (+ 1125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:57.595892 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:57.595929 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:35:57.596507 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:57.596523 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.599429 (+ 2906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.599438 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:57.602531 (+ 3093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:57.602552 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.605515 (+ 2963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.605524 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:57.605806 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:57.605857 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 02:35:57.606304 (+ 447us) client_negotiation.cc:240] Negotiation successful
0808 02:35:57.606517 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2488,"thread_start_us":2326,"threads_started":1}
I20260808 02:35:57.607486 21891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:57.591913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49142 (local address 127.24.116.193:37447)
0808 02:35:57.594229 (+ 2316us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:57.594239 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:57.594271 (+ 32us) server_negotiation.cc:407] Connection header received
0808 02:35:57.594382 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:57.594390 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:57.594704 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:57.595834 (+ 1130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:35:57.596072 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.598144 (+ 2072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.601956 (+ 3812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.604066 (+ 2110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.606598 (+ 2532us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:57.606824 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:57.606910 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 02:35:57.607129 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2143,"thread_start_us":1970,"threads_started":1}
I20260808 02:35:57.608325 21894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:57.592720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46214 (local address 127.24.116.195:37717)
0808 02:35:57.593568 (+ 848us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:57.593576 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:57.594885 (+ 1309us) server_negotiation.cc:407] Connection header received
0808 02:35:57.595019 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:57.595029 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:57.595284 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:57.595527 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:35:57.596838 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.599196 (+ 2358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.602775 (+ 3579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.604780 (+ 2005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.605047 (+ 267us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:57.605291 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:57.607776 (+ 2485us) server_negotiation.cc:299] Negotiation successful
0808 02:35:57.607936 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":673,"thread_start_us":504,"threads_started":1}
I20260808 02:35:57.612722 21777 tablet_service.cc:1467] Processing CreateTablet for tablet 061c6fe15a7948d9a50bdedb52bd226f (DEFAULT_TABLE table=test-table [id=3c529ae932744a4486286c79dfb23563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:35:57.612723 21347 tablet_service.cc:1467] Processing CreateTablet for tablet 061c6fe15a7948d9a50bdedb52bd226f (DEFAULT_TABLE table=test-table [id=3c529ae932744a4486286c79dfb23563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:35:57.614310 21347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 061c6fe15a7948d9a50bdedb52bd226f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:35:57.614332 21777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 061c6fe15a7948d9a50bdedb52bd226f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:35:57.616168 21890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:57.594137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:45741 (local address 127.0.0.1:54598)
0808 02:35:57.606151 (+ 12014us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:57.606171 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:57.606285 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:57.610577 (+ 4292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:57.610582 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:57.610611 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:35:57.610789 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:57.610801 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.612222 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.612230 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:57.613974 (+ 1744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:57.613986 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.615353 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.615359 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:57.615526 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:57.615560 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 02:35:57.615704 (+ 144us) client_negotiation.cc:240] Negotiation successful
0808 02:35:57.615862 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11914,"thread_start_us":13154,"threads_started":1}
I20260808 02:35:57.616240 21898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:57.594710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54598 (local address 127.24.116.194:45741)
0808 02:35:57.610048 (+ 15338us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:57.610059 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:57.610091 (+ 32us) server_negotiation.cc:407] Connection header received
0808 02:35:57.610187 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:57.610192 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:57.610378 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:57.610597 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:35:57.610960 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.612062 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.614143 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.615170 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.615370 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:57.615544 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:57.615762 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 02:35:57.615923 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15144,"thread_start_us":16084,"threads_started":1}
I20260808 02:35:57.620143 21567 tablet_service.cc:1467] Processing CreateTablet for tablet 061c6fe15a7948d9a50bdedb52bd226f (DEFAULT_TABLE table=test-table [id=3c529ae932744a4486286c79dfb23563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:35:57.621541 21567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 061c6fe15a7948d9a50bdedb52bd226f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:35:57.630230 21899 tablet_bootstrap.cc:492] T 061c6fe15a7948d9a50bdedb52bd226f P 666c514777194331a5fc5fbdb394e73a: Bootstrap starting.
I20260808 02:35:57.631167 21901 tablet_bootstrap.cc:492] T 061c6fe15a7948d9a50bdedb52bd226f P 4f3bf3f1fbe24c0ab738d219eaa39004: Bootstrap starting.
I20260808 02:35:57.634864 21899 tablet_bootstrap.cc:654] T 061c6fe15a7948d9a50bdedb52bd226f P 666c514777194331a5fc5fbdb394e73a: Neither blocks nor log segments found. Creating new log.
I20260808 02:35:57.634974 21901 tablet_bootstrap.cc:654] T 061c6fe15a7948d9a50bdedb52bd226f P 4f3bf3f1fbe24c0ab738d219eaa39004: Neither blocks nor log segments found. Creating new log.
I20260808 02:35:57.636165 21899 log.cc:824] T 061c6fe15a7948d9a50bdedb52bd226f P 666c514777194331a5fc5fbdb394e73a: Log is configured to *not* fsync() on all Append() calls
I20260808 02:35:57.636464 21901 log.cc:824] T 061c6fe15a7948d9a50bdedb52bd226f P 4f3bf3f1fbe24c0ab738d219eaa39004: Log is configured to *not* fsync() on all Append() calls
I20260808 02:35:57.637995 21903 tablet_bootstrap.cc:492] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc: Bootstrap starting.
I20260808 02:35:57.641711 21899 tablet_bootstrap.cc:492] T 061c6fe15a7948d9a50bdedb52bd226f P 666c514777194331a5fc5fbdb394e73a: No bootstrap required, opened a new log
I20260808 02:35:57.642032 21899 ts_tablet_manager.cc:1397] T 061c6fe15a7948d9a50bdedb52bd226f P 666c514777194331a5fc5fbdb394e73a: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.005s
I20260808 02:35:57.642035 21901 tablet_bootstrap.cc:492] T 061c6fe15a7948d9a50bdedb52bd226f P 4f3bf3f1fbe24c0ab738d219eaa39004: No bootstrap required, opened a new log
I20260808 02:35:57.642052 21903 tablet_bootstrap.cc:654] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc: Neither blocks nor log segments found. Creating new log.
I20260808 02:35:57.642329 21901 ts_tablet_manager.cc:1397] T 061c6fe15a7948d9a50bdedb52bd226f P 4f3bf3f1fbe24c0ab738d219eaa39004: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260808 02:35:57.643312 21903 log.cc:824] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc: Log is configured to *not* fsync() on all Append() calls
I20260808 02:35:57.646514 21903 tablet_bootstrap.cc:492] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc: No bootstrap required, opened a new log
I20260808 02:35:57.646785 21903 ts_tablet_manager.cc:1397] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260808 02:35:57.650579 21901 raft_consensus.cc:348] T 061c6fe15a7948d9a50bdedb52bd226f P 4f3bf3f1fbe24c0ab738d219eaa39004 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666c514777194331a5fc5fbdb394e73a" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37447 } } peers { permanent_uuid: "4f3bf3f1fbe24c0ab738d219eaa39004" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37717 } } peers { permanent_uuid: "a48e446f6c6343c8b387b282c64c95dc" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 45741 } }
I20260808 02:35:57.651058 21901 raft_consensus.cc:374] T 061c6fe15a7948d9a50bdedb52bd226f P 4f3bf3f1fbe24c0ab738d219eaa39004 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:35:57.651194 21901 raft_consensus.cc:729] T 061c6fe15a7948d9a50bdedb52bd226f P 4f3bf3f1fbe24c0ab738d219eaa39004 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf3f1fbe24c0ab738d219eaa39004, State: Initialized, Role: FOLLOWER
I20260808 02:35:57.651949 21901 consensus_queue.cc:260] T 061c6fe15a7948d9a50bdedb52bd226f P 4f3bf3f1fbe24c0ab738d219eaa39004 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666c514777194331a5fc5fbdb394e73a" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37447 } } peers { permanent_uuid: "4f3bf3f1fbe24c0ab738d219eaa39004" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37717 } } peers { permanent_uuid: "a48e446f6c6343c8b387b282c64c95dc" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 45741 } }
I20260808 02:35:57.652582 21899 raft_consensus.cc:348] T 061c6fe15a7948d9a50bdedb52bd226f P 666c514777194331a5fc5fbdb394e73a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666c514777194331a5fc5fbdb394e73a" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37447 } } peers { permanent_uuid: "4f3bf3f1fbe24c0ab738d219eaa39004" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37717 } } peers { permanent_uuid: "a48e446f6c6343c8b387b282c64c95dc" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 45741 } }
I20260808 02:35:57.653031 21899 raft_consensus.cc:374] T 061c6fe15a7948d9a50bdedb52bd226f P 666c514777194331a5fc5fbdb394e73a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:35:57.653137 21899 raft_consensus.cc:729] T 061c6fe15a7948d9a50bdedb52bd226f P 666c514777194331a5fc5fbdb394e73a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666c514777194331a5fc5fbdb394e73a, State: Initialized, Role: FOLLOWER
I20260808 02:35:57.653466 21864 heartbeater.cc:503] Master 127.24.116.254:44097 was elected leader, sending a full tablet report...
I20260808 02:35:57.653954 21901 ts_tablet_manager.cc:1428] T 061c6fe15a7948d9a50bdedb52bd226f P 4f3bf3f1fbe24c0ab738d219eaa39004: Time spent starting tablet: real 0.011s user 0.009s sys 0.003s
I20260808 02:35:57.653865 21899 consensus_queue.cc:260] T 061c6fe15a7948d9a50bdedb52bd226f P 666c514777194331a5fc5fbdb394e73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666c514777194331a5fc5fbdb394e73a" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37447 } } peers { permanent_uuid: "4f3bf3f1fbe24c0ab738d219eaa39004" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37717 } } peers { permanent_uuid: "a48e446f6c6343c8b387b282c64c95dc" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 45741 } }
I20260808 02:35:57.655601 21899 ts_tablet_manager.cc:1428] T 061c6fe15a7948d9a50bdedb52bd226f P 666c514777194331a5fc5fbdb394e73a: Time spent starting tablet: real 0.013s user 0.012s sys 0.003s
I20260808 02:35:57.658304 21903 raft_consensus.cc:348] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666c514777194331a5fc5fbdb394e73a" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37447 } } peers { permanent_uuid: "4f3bf3f1fbe24c0ab738d219eaa39004" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37717 } } peers { permanent_uuid: "a48e446f6c6343c8b387b282c64c95dc" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 45741 } }
I20260808 02:35:57.658814 21903 raft_consensus.cc:374] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:35:57.658962 21903 raft_consensus.cc:729] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a48e446f6c6343c8b387b282c64c95dc, State: Initialized, Role: FOLLOWER
I20260808 02:35:57.659677 21903 consensus_queue.cc:260] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666c514777194331a5fc5fbdb394e73a" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37447 } } peers { permanent_uuid: "4f3bf3f1fbe24c0ab738d219eaa39004" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37717 } } peers { permanent_uuid: "a48e446f6c6343c8b387b282c64c95dc" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 45741 } }
I20260808 02:35:57.660959 21672 heartbeater.cc:503] Master 127.24.116.254:44097 was elected leader, sending a full tablet report...
I20260808 02:35:57.661657 21903 ts_tablet_manager.cc:1428] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
W20260808 02:35:57.709404 21674 tablet.cc:2369] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:35:57.764592 21866 tablet.cc:2369] T 061c6fe15a7948d9a50bdedb52bd226f P 4f3bf3f1fbe24c0ab738d219eaa39004: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:35:57.879880 21458 tablet.cc:2369] T 061c6fe15a7948d9a50bdedb52bd226f P 666c514777194331a5fc5fbdb394e73a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:35:57.939899 21912 raft_consensus.cc:482] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:35:57.940272 21912 raft_consensus.cc:504] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666c514777194331a5fc5fbdb394e73a" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37447 } } peers { permanent_uuid: "4f3bf3f1fbe24c0ab738d219eaa39004" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37717 } } peers { permanent_uuid: "a48e446f6c6343c8b387b282c64c95dc" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 45741 } }
I20260808 02:35:57.942188 21912 leader_election.cc:288] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 666c514777194331a5fc5fbdb394e73a (127.24.116.193:37447), 4f3bf3f1fbe24c0ab738d219eaa39004 (127.24.116.195:37717)
I20260808 02:35:57.949342 21891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:57.942679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:43057 (local address 127.24.116.193:37447)
0808 02:35:57.942910 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:57.942920 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:57.943744 (+ 824us) server_negotiation.cc:407] Connection header received
0808 02:35:57.943944 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:57.943948 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:57.944010 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:57.944109 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:35:57.944825 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.945568 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.947461 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.948240 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.948516 (+ 276us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:57.948592 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:57.948930 (+ 338us) server_negotiation.cc:299] Negotiation successful
0808 02:35:57.949059 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 02:35:57.949359 21894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:57.942715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:59285 (local address 127.24.116.195:37717)
0808 02:35:57.942965 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:57.942974 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:57.943830 (+ 856us) server_negotiation.cc:407] Connection header received
0808 02:35:57.944054 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:57.944058 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:57.944117 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:57.944211 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:35:57.944898 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.945629 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.947444 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.948213 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.948442 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:57.948537 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:57.948958 (+ 421us) server_negotiation.cc:299] Negotiation successful
0808 02:35:57.949086 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 02:35:57.949512 21913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:57.942612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:37447 (local address 127.24.116.194:43057)
0808 02:35:57.943607 (+ 995us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:57.943629 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:57.943764 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:57.944142 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:57.944147 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:57.944172 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:35:57.944662 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:57.944673 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.945709 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.945716 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:57.947292 (+ 1576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:57.947304 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.948549 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.948555 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:57.948738 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:57.948775 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 02:35:57.948904 (+ 129us) client_negotiation.cc:240] Negotiation successful
0808 02:35:57.949035 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":868,"mutex_wait_us":26,"thread_start_us":556,"threads_started":1}
I20260808 02:35:57.949893 21915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:57.942626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:37717 (local address 127.24.116.194:59285)
0808 02:35:57.943726 (+ 1100us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:57.943744 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:57.943899 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:57.944245 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:57.944249 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:57.944289 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:35:57.944738 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:57.944747 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.945774 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.945780 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:57.947283 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:57.947294 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.948635 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.948643 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:57.948795 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:57.948825 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 02:35:57.948931 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 02:35:57.949056 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":967,"mutex_wait_us":4,"thread_start_us":559,"threads_started":1}
I20260808 02:35:57.950611 21382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "061c6fe15a7948d9a50bdedb52bd226f" candidate_uuid: "a48e446f6c6343c8b387b282c64c95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c514777194331a5fc5fbdb394e73a" is_pre_election: true
I20260808 02:35:57.950867 21801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "061c6fe15a7948d9a50bdedb52bd226f" candidate_uuid: "a48e446f6c6343c8b387b282c64c95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf3f1fbe24c0ab738d219eaa39004" is_pre_election: true
I20260808 02:35:57.951169 21382 raft_consensus.cc:2454] T 061c6fe15a7948d9a50bdedb52bd226f P 666c514777194331a5fc5fbdb394e73a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a48e446f6c6343c8b387b282c64c95dc in term 0.
I20260808 02:35:57.951401 21801 raft_consensus.cc:2454] T 061c6fe15a7948d9a50bdedb52bd226f P 4f3bf3f1fbe24c0ab738d219eaa39004 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a48e446f6c6343c8b387b282c64c95dc in term 0.
I20260808 02:35:57.951961 21495 leader_election.cc:302] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666c514777194331a5fc5fbdb394e73a, a48e446f6c6343c8b387b282c64c95dc; no voters:
I20260808 02:35:57.952450 21912 raft_consensus.cc:2781] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:35:57.952600 21912 raft_consensus.cc:482] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:35:57.952715 21912 raft_consensus.cc:3037] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:35:57.954917 21912 raft_consensus.cc:504] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666c514777194331a5fc5fbdb394e73a" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37447 } } peers { permanent_uuid: "4f3bf3f1fbe24c0ab738d219eaa39004" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37717 } } peers { permanent_uuid: "a48e446f6c6343c8b387b282c64c95dc" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 45741 } }
I20260808 02:35:57.955662 21912 leader_election.cc:288] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc [CANDIDATE]: Term 1 election: Requested vote from peers 666c514777194331a5fc5fbdb394e73a (127.24.116.193:37447), 4f3bf3f1fbe24c0ab738d219eaa39004 (127.24.116.195:37717)
I20260808 02:35:57.956012 21382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "061c6fe15a7948d9a50bdedb52bd226f" candidate_uuid: "a48e446f6c6343c8b387b282c64c95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "666c514777194331a5fc5fbdb394e73a"
I20260808 02:35:57.956247 21382 raft_consensus.cc:3037] T 061c6fe15a7948d9a50bdedb52bd226f P 666c514777194331a5fc5fbdb394e73a [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:35:57.956224 21801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "061c6fe15a7948d9a50bdedb52bd226f" candidate_uuid: "a48e446f6c6343c8b387b282c64c95dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf3f1fbe24c0ab738d219eaa39004"
I20260808 02:35:57.956456 21801 raft_consensus.cc:3037] T 061c6fe15a7948d9a50bdedb52bd226f P 4f3bf3f1fbe24c0ab738d219eaa39004 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:35:57.958772 21382 raft_consensus.cc:2454] T 061c6fe15a7948d9a50bdedb52bd226f P 666c514777194331a5fc5fbdb394e73a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a48e446f6c6343c8b387b282c64c95dc in term 1.
I20260808 02:35:57.959198 21495 leader_election.cc:302] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666c514777194331a5fc5fbdb394e73a, a48e446f6c6343c8b387b282c64c95dc; no voters:
I20260808 02:35:57.959486 21912 raft_consensus.cc:2781] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:35:57.959651 21801 raft_consensus.cc:2454] T 061c6fe15a7948d9a50bdedb52bd226f P 4f3bf3f1fbe24c0ab738d219eaa39004 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a48e446f6c6343c8b387b282c64c95dc in term 1.
I20260808 02:35:57.960146 21912 raft_consensus.cc:686] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc [term 1 LEADER]: Becoming Leader. State: Replica: a48e446f6c6343c8b387b282c64c95dc, State: Running, Role: LEADER
I20260808 02:35:57.960673 21912 consensus_queue.cc:237] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666c514777194331a5fc5fbdb394e73a" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37447 } } peers { permanent_uuid: "4f3bf3f1fbe24c0ab738d219eaa39004" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37717 } } peers { permanent_uuid: "a48e446f6c6343c8b387b282c64c95dc" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 45741 } }
I20260808 02:35:57.965592 21162 catalog_manager.cc:5495] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc reported cstate change: term changed from 0 to 1, leader changed from <none> to a48e446f6c6343c8b387b282c64c95dc (127.24.116.194). New cstate: current_term: 1 leader_uuid: "a48e446f6c6343c8b387b282c64c95dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666c514777194331a5fc5fbdb394e73a" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f3bf3f1fbe24c0ab738d219eaa39004" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a48e446f6c6343c8b387b282c64c95dc" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 45741 } health_report { overall_health: HEALTHY } } }
I20260808 02:35:57.985909 21898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:57.980399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54612 (local address 127.24.116.194:45741)
0808 02:35:57.980626 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:57.980634 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:57.980654 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:35:57.980746 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:57.980750 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:57.980835 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:57.980992 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:35:57.981414 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.982167 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.983520 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:57.983958 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:57.984098 (+ 140us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:57.984782 (+ 684us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:35:57.985271 (+ 489us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:35:57.985475 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:57.985596 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 02:35:57.985644 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 02:35:57.994990 21801 raft_consensus.cc:1261] T 061c6fe15a7948d9a50bdedb52bd226f P 4f3bf3f1fbe24c0ab738d219eaa39004 [term 1 FOLLOWER]: Refusing update from remote peer a48e446f6c6343c8b387b282c64c95dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:35:57.994989 21382 raft_consensus.cc:1261] T 061c6fe15a7948d9a50bdedb52bd226f P 666c514777194331a5fc5fbdb394e73a [term 1 FOLLOWER]: Refusing update from remote peer a48e446f6c6343c8b387b282c64c95dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:35:57.996047 21916 consensus_queue.cc:1035] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "666c514777194331a5fc5fbdb394e73a" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 37447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:35:57.996492 21912 consensus_queue.cc:1035] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf3f1fbe24c0ab738d219eaa39004" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 37717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:35:58.009048 21921 mvcc.cc:205] Tried to move back new op lower bound from 7316097261536976896 to 7316097261411028992. Current Snapshot: MvccSnapshot[applied={T|T < 7316097261536976896}]
I20260808 02:35:58.023104 21162 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53354:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:35:58.023449 21162 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53354:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:35:58.027895 21162 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fbd49998fb4c49a1afb67cb9fee7726d: Sending DeleteTablet for 3 replicas of tablet 061c6fe15a7948d9a50bdedb52bd226f
I20260808 02:35:58.029284 21347 tablet_service.cc:1514] Processing DeleteTablet for tablet 061c6fe15a7948d9a50bdedb52bd226f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:35:58 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:49142
I20260808 02:35:58.029284 21777 tablet_service.cc:1514] Processing DeleteTablet for tablet 061c6fe15a7948d9a50bdedb52bd226f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:35:58 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:46214
I20260808 02:35:58.029372 21567 tablet_service.cc:1514] Processing DeleteTablet for tablet 061c6fe15a7948d9a50bdedb52bd226f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:35:58 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:54598
I20260808 02:35:58.033280 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 21253
I20260808 02:35:58.039393 21935 tablet_replica.cc:330] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc: stopping tablet replica
I20260808 02:35:58.039915 21935 raft_consensus.cc:2229] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:35:58.040695 21935 raft_consensus.cc:2258] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:35:58.041751 21933 tablet_replica.cc:330] T 061c6fe15a7948d9a50bdedb52bd226f P 666c514777194331a5fc5fbdb394e73a: stopping tablet replica
I20260808 02:35:58.042197 21933 raft_consensus.cc:2229] T 061c6fe15a7948d9a50bdedb52bd226f P 666c514777194331a5fc5fbdb394e73a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:35:58.042734 21933 raft_consensus.cc:2258] T 061c6fe15a7948d9a50bdedb52bd226f P 666c514777194331a5fc5fbdb394e73a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:35:58.045140 21933 ts_tablet_manager.cc:1905] T 061c6fe15a7948d9a50bdedb52bd226f P 666c514777194331a5fc5fbdb394e73a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:35:58.048784 21932 tablet_replica.cc:330] T 061c6fe15a7948d9a50bdedb52bd226f P 4f3bf3f1fbe24c0ab738d219eaa39004: stopping tablet replica
I20260808 02:35:58.049324 21932 raft_consensus.cc:2229] T 061c6fe15a7948d9a50bdedb52bd226f P 4f3bf3f1fbe24c0ab738d219eaa39004 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:35:58.049938 21932 raft_consensus.cc:2258] T 061c6fe15a7948d9a50bdedb52bd226f P 4f3bf3f1fbe24c0ab738d219eaa39004 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:35:58.050149 21935 ts_tablet_manager.cc:1905] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:35:58.053037 21933 ts_tablet_manager.cc:1918] T 061c6fe15a7948d9a50bdedb52bd226f P 666c514777194331a5fc5fbdb394e73a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:35:58.053229 21933 log.cc:1196] T 061c6fe15a7948d9a50bdedb52bd226f P 666c514777194331a5fc5fbdb394e73a: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/061c6fe15a7948d9a50bdedb52bd226f
I20260808 02:35:58.053822 21933 ts_tablet_manager.cc:1939] T 061c6fe15a7948d9a50bdedb52bd226f P 666c514777194331a5fc5fbdb394e73a: Deleting consensus metadata
I20260808 02:35:58.056092 21144 catalog_manager.cc:4841] TS 666c514777194331a5fc5fbdb394e73a (127.24.116.193:37447): tablet 061c6fe15a7948d9a50bdedb52bd226f (table test-table [id=3c529ae932744a4486286c79dfb23563]) successfully deleted
I20260808 02:35:58.057644 21932 ts_tablet_manager.cc:1905] T 061c6fe15a7948d9a50bdedb52bd226f P 4f3bf3f1fbe24c0ab738d219eaa39004: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:35:58.060261 21935 ts_tablet_manager.cc:1918] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:35:58.060526 21935 log.cc:1196] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/061c6fe15a7948d9a50bdedb52bd226f
I20260808 02:35:58.061143 21935 ts_tablet_manager.cc:1939] T 061c6fe15a7948d9a50bdedb52bd226f P a48e446f6c6343c8b387b282c64c95dc: Deleting consensus metadata
I20260808 02:35:58.063179 21143 catalog_manager.cc:4841] TS a48e446f6c6343c8b387b282c64c95dc (127.24.116.194:45741): tablet 061c6fe15a7948d9a50bdedb52bd226f (table test-table [id=3c529ae932744a4486286c79dfb23563]) successfully deleted
I20260808 02:35:58.065466 21932 ts_tablet_manager.cc:1918] T 061c6fe15a7948d9a50bdedb52bd226f P 4f3bf3f1fbe24c0ab738d219eaa39004: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:35:58.065655 21932 log.cc:1196] T 061c6fe15a7948d9a50bdedb52bd226f P 4f3bf3f1fbe24c0ab738d219eaa39004: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/061c6fe15a7948d9a50bdedb52bd226f
I20260808 02:35:58.066212 21932 ts_tablet_manager.cc:1939] T 061c6fe15a7948d9a50bdedb52bd226f P 4f3bf3f1fbe24c0ab738d219eaa39004: Deleting consensus metadata
I20260808 02:35:58.068177 21141 catalog_manager.cc:4841] TS 4f3bf3f1fbe24c0ab738d219eaa39004 (127.24.116.195:37717): tablet 061c6fe15a7948d9a50bdedb52bd226f (table test-table [id=3c529ae932744a4486286c79dfb23563]) successfully deleted
Aug 08 02:35:58 dist-test-slave-45dx krb5kdc[21092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.193@KRBTEST.COM
I20260808 02:35:58.077921 21891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:58.035277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49144 (local address 127.24.116.193:37447)
0808 02:35:58.035517 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:58.035526 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:58.053914 (+ 18388us) server_negotiation.cc:407] Connection header received
0808 02:35:58.054508 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:58.054515 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:58.054606 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:58.054678 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:58.057450 (+ 2772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:58.058580 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:58.061155 (+ 2575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:58.061818 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:58.061918 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:58.071660 (+ 9742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:58.071679 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:58.071695 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:58.071736 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:58.074901 (+ 3165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:58.075667 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:58.075675 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:58.075677 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:58.075829 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:58.076231 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:58.076235 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:58.076237 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:58.076667 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:58.076996 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:58.077293 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 02:35:58.077533 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 02:35:58.078574 21451 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:35:58.173955 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 21253
I20260808 02:35:58.202944 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 21465
Aug 08 02:35:58 dist-test-slave-45dx krb5kdc[21092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.194@KRBTEST.COM
I20260808 02:35:58.220839 21898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:58.203873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54622 (local address 127.24.116.194:45741)
0808 02:35:58.204100 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:58.204106 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:58.204130 (+ 24us) server_negotiation.cc:407] Connection header received
0808 02:35:58.204267 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:58.204274 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:58.204382 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:58.204490 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:58.205796 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:58.207050 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:58.208445 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:58.209138 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:58.209267 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:58.213829 (+ 4562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:58.213853 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:58.213873 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:58.213911 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:58.217809 (+ 3898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:58.218468 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:58.218478 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:58.218481 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:58.218658 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:58.219035 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:58.219040 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:58.219043 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:58.219474 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:58.219876 (+ 402us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:58.220186 (+ 310us) server_negotiation.cc:299] Negotiation successful
0808 02:35:58.220448 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 02:35:58.221710 21664 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:35:58.342525 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 21465
I20260808 02:35:58.366415 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 21680
Aug 08 02:35:58 dist-test-slave-45dx krb5kdc[21092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.195@KRBTEST.COM
I20260808 02:35:58.381486 21894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:58.367180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46220 (local address 127.24.116.195:37717)
0808 02:35:58.367360 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:58.367365 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:58.367437 (+ 72us) server_negotiation.cc:407] Connection header received
0808 02:35:58.367584 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:58.367587 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:58.367651 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:58.367739 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:58.369130 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:58.369827 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:58.371060 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:58.371425 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:58.371514 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:58.376021 (+ 4507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:58.376036 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:58.376052 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:35:58.376090 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:58.378769 (+ 2679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:58.379424 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:58.379432 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:58.379434 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:58.379574 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:35:58.379912 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:35:58.379915 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:35:58.379917 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:35:58.380265 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:58.380617 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:58.380918 (+ 301us) server_negotiation.cc:299] Negotiation successful
0808 02:35:58.381153 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 02:35:58.382158 21857 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:35:58.472536 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 21680
I20260808 02:35:58.501999 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 21114
I20260808 02:35:58.503211 21209 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:35:58.614908 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 21114
2026-08-08T02:35:58Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (5137 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T02:35:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:35:58Z Disabled control of system clock
I20260808 02:35:58.721642 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:38871
--webserver_interface=127.24.116.254
--webserver_port=0
--builtin_ntp_servers=127.24.116.212:46307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:38871
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 02:35:59.085598 21945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:35:59.085906 21945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:35:59.085989 21945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:35:59.093312 21945 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:35:59.093456 21945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:35:59.093549 21945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:35:59.093645 21945 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:35:59.093713 21945 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:35:59.103437 21945 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:46307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:38871
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:38871
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:35:59.104975 21945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:35:59.106909 21945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:35:59.119735 21959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:59.119637 21961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:59.119637 21965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:35:59.120847 21945 server_base.cc:1034] running on GCE node
I20260808 02:35:59.121719 21945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:35:59.123358 21945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:35:59.124616 21945 hybrid_clock.cc:648] HybridClock initialized: now 1786156559124544 us; error 59 us; skew 500 ppm
I20260808 02:35:59.125034 21945 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:35:59.127485 21945 webserver.cc:460] Webserver started at http://127.24.116.254:39861/ using document root <none> and password file <none>
I20260808 02:35:59.128192 21945 fs_manager.cc:359] Metadata directory not provided
I20260808 02:35:59.128363 21945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:35:59.128726 21945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:35:59.131812 21945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "366bfb7225784cfaaa1058808f64756e"
format_stamp: "Formatted at 2026-08-08 02:35:59 on dist-test-slave-45dx"
server_key: "11817547378fe0ea6e9bc6cadd6c5054"
server_key_iv: "6d201d746c985089872407c26d905288"
server_key_version: "encryptionkey@0"
I20260808 02:35:59.132728 21945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "366bfb7225784cfaaa1058808f64756e"
format_stamp: "Formatted at 2026-08-08 02:35:59 on dist-test-slave-45dx"
server_key: "11817547378fe0ea6e9bc6cadd6c5054"
server_key_iv: "6d201d746c985089872407c26d905288"
server_key_version: "encryptionkey@0"
I20260808 02:35:59.138108 21945 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260808 02:35:59.141999 21974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:59.143440 21945 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:35:59.143653 21945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "366bfb7225784cfaaa1058808f64756e"
format_stamp: "Formatted at 2026-08-08 02:35:59 on dist-test-slave-45dx"
server_key: "11817547378fe0ea6e9bc6cadd6c5054"
server_key_iv: "6d201d746c985089872407c26d905288"
server_key_version: "encryptionkey@0"
I20260808 02:35:59.143899 21945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:35:59.162331 21945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:35:59.163324 21945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:35:59.163661 21945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:35:59.183961 21945 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:38871
I20260808 02:35:59.183996 22060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:38871 every 8 connection(s)
I20260808 02:35:59.185447 21945 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:35:59.189471 22062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:35:59.195770 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 21945
I20260808 02:35:59.196007 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:35:59.196548 25043 external_mini_cluster.cc:1428] Setting key 3bab5f6d1da5cac044b1ece0f7467a7e
I20260808 02:35:59.200825 22062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 366bfb7225784cfaaa1058808f64756e: Bootstrap starting.
I20260808 02:35:59.204277 22062 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 366bfb7225784cfaaa1058808f64756e: Neither blocks nor log segments found. Creating new log.
I20260808 02:35:59.205713 22062 log.cc:824] T 00000000000000000000000000000000 P 366bfb7225784cfaaa1058808f64756e: Log is configured to *not* fsync() on all Append() calls
I20260808 02:35:59.209227 22062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 366bfb7225784cfaaa1058808f64756e: No bootstrap required, opened a new log
I20260808 02:35:59.211257 22067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:59.198650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60562 (local address 127.24.116.254:38871)
0808 02:35:59.199651 (+ 1001us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:59.199662 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:59.199704 (+ 42us) server_negotiation.cc:407] Connection header received
0808 02:35:59.201612 (+ 1908us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:59.201634 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:59.202078 (+ 444us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:59.202464 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:59.203094 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:59.204481 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:59.206466 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:59.207421 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:59.207548 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:59.208923 (+ 1375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:59.208931 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:59.208944 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:35:59.209541 (+ 597us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:59.209625 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:35:59.209648 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:59.209751 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:59.209975 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 02:35:59.210302 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":592,"thread_start_us":373,"threads_started":1}
I20260808 02:35:59.217221 22062 raft_consensus.cc:348] T 00000000000000000000000000000000 P 366bfb7225784cfaaa1058808f64756e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "366bfb7225784cfaaa1058808f64756e" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38871 } }
I20260808 02:35:59.217603 22062 raft_consensus.cc:374] T 00000000000000000000000000000000 P 366bfb7225784cfaaa1058808f64756e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:35:59.217708 22062 raft_consensus.cc:729] T 00000000000000000000000000000000 P 366bfb7225784cfaaa1058808f64756e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 366bfb7225784cfaaa1058808f64756e, State: Initialized, Role: FOLLOWER
I20260808 02:35:59.218295 22062 consensus_queue.cc:260] T 00000000000000000000000000000000 P 366bfb7225784cfaaa1058808f64756e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "366bfb7225784cfaaa1058808f64756e" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38871 } }
I20260808 02:35:59.218554 22062 raft_consensus.cc:388] T 00000000000000000000000000000000 P 366bfb7225784cfaaa1058808f64756e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:35:59.218722 22062 raft_consensus.cc:482] T 00000000000000000000000000000000 P 366bfb7225784cfaaa1058808f64756e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:35:59.218909 22062 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 366bfb7225784cfaaa1058808f64756e [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:35:59.221477 22062 raft_consensus.cc:504] T 00000000000000000000000000000000 P 366bfb7225784cfaaa1058808f64756e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "366bfb7225784cfaaa1058808f64756e" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38871 } }
I20260808 02:35:59.222023 22062 leader_election.cc:302] T 00000000000000000000000000000000 P 366bfb7225784cfaaa1058808f64756e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 366bfb7225784cfaaa1058808f64756e; no voters:
I20260808 02:35:59.222651 22062 leader_election.cc:288] T 00000000000000000000000000000000 P 366bfb7225784cfaaa1058808f64756e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:35:59.222805 22071 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 366bfb7225784cfaaa1058808f64756e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:35:59.223567 22071 raft_consensus.cc:686] T 00000000000000000000000000000000 P 366bfb7225784cfaaa1058808f64756e [term 1 LEADER]: Becoming Leader. State: Replica: 366bfb7225784cfaaa1058808f64756e, State: Running, Role: LEADER
I20260808 02:35:59.224061 22071 consensus_queue.cc:237] T 00000000000000000000000000000000 P 366bfb7225784cfaaa1058808f64756e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "366bfb7225784cfaaa1058808f64756e" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38871 } }
I20260808 02:35:59.224893 22062 sys_catalog.cc:564] T 00000000000000000000000000000000 P 366bfb7225784cfaaa1058808f64756e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:35:59.227187 22073 sys_catalog.cc:455] T 00000000000000000000000000000000 P 366bfb7225784cfaaa1058808f64756e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 366bfb7225784cfaaa1058808f64756e. Latest consensus state: current_term: 1 leader_uuid: "366bfb7225784cfaaa1058808f64756e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "366bfb7225784cfaaa1058808f64756e" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38871 } } }
I20260808 02:35:59.227612 22073 sys_catalog.cc:458] T 00000000000000000000000000000000 P 366bfb7225784cfaaa1058808f64756e [sys.catalog]: This master's current role is: LEADER
I20260808 02:35:59.228647 22072 sys_catalog.cc:455] T 00000000000000000000000000000000 P 366bfb7225784cfaaa1058808f64756e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "366bfb7225784cfaaa1058808f64756e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "366bfb7225784cfaaa1058808f64756e" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38871 } } }
I20260808 02:35:59.229027 22072 sys_catalog.cc:458] T 00000000000000000000000000000000 P 366bfb7225784cfaaa1058808f64756e [sys.catalog]: This master's current role is: LEADER
I20260808 02:35:59.230968 22081 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:35:59.236663 22081 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:35:59.246338 22081 catalog_manager.cc:1347] Generated new cluster ID: 00c520a0f45246699e6ec14f68717ffd
I20260808 02:35:59.246480 22081 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:35:59.281913 22081 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:35:59.283258 22081 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:35:59.298117 22081 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 366bfb7225784cfaaa1058808f64756e: Generated new TSK 0
I20260808 02:35:59.299050 22081 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:35:59.308566 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:38871
--builtin_ntp_servers=127.24.116.212:46307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 02:35:59.671353 22097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:35:59.671622 22097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:35:59.671736 22097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:35:59.678855 22097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:35:59.678951 22097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:35:59.679055 22097 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:35:59.688143 22097 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:46307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:38871
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:35:59.689458 22097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:35:59.691236 22097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:35:59.704875 22105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:59.704906 22104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:35:59.705461 22109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:35:59.705734 22097 server_base.cc:1034] running on GCE node
I20260808 02:35:59.706367 22097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:35:59.707350 22097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:35:59.708588 22097 hybrid_clock.cc:648] HybridClock initialized: now 1786156559708532 us; error 52 us; skew 500 ppm
I20260808 02:35:59.708923 22097 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:35:59.711390 22097 webserver.cc:460] Webserver started at http://127.24.116.193:33729/ using document root <none> and password file <none>
I20260808 02:35:59.712126 22097 fs_manager.cc:359] Metadata directory not provided
I20260808 02:35:59.712218 22097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:35:59.712627 22097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:35:59.715508 22097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "41a3a61bb2bc4dd19de24cdca8be8c11"
format_stamp: "Formatted at 2026-08-08 02:35:59 on dist-test-slave-45dx"
server_key: "cd2522ce0a6962d192357092b23d2686"
server_key_iv: "ec0715f6db1b5298de311beb858b29ea"
server_key_version: "encryptionkey@0"
I20260808 02:35:59.716370 22097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "41a3a61bb2bc4dd19de24cdca8be8c11"
format_stamp: "Formatted at 2026-08-08 02:35:59 on dist-test-slave-45dx"
server_key: "cd2522ce0a6962d192357092b23d2686"
server_key_iv: "ec0715f6db1b5298de311beb858b29ea"
server_key_version: "encryptionkey@0"
I20260808 02:35:59.721467 22097 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 02:35:59.724978 22119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:59.726388 22097 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:35:59.726567 22097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "41a3a61bb2bc4dd19de24cdca8be8c11"
format_stamp: "Formatted at 2026-08-08 02:35:59 on dist-test-slave-45dx"
server_key: "cd2522ce0a6962d192357092b23d2686"
server_key_iv: "ec0715f6db1b5298de311beb858b29ea"
server_key_version: "encryptionkey@0"
I20260808 02:35:59.726773 22097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:35:59.744689 22097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:35:59.745582 22097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:35:59.745919 22097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:35:59.746981 22097 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:35:59.748895 22097 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:35:59.749022 22097 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:59.749161 22097 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:35:59.749248 22097 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:35:59.785123 22097 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:40119
I20260808 02:35:59.785156 22295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:40119 every 8 connection(s)
I20260808 02:35:59.786582 22097 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:35:59.794243 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 22097
I20260808 02:35:59.794453 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:35:59.794936 25043 external_mini_cluster.cc:1428] Setting key e70f08e4204348fbb81f5ab898170cac
I20260808 02:35:59.797936 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:38871
--builtin_ntp_servers=127.24.116.212:46307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 02:35:59.800751 22299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:59.789383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:44827 (local address 127.24.116.254:38871)
0808 02:35:59.789820 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0808 02:35:59.789825 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:35:59.791065 (+ 1240us) server_negotiation.cc:407] Connection header received
0808 02:35:59.793056 (+ 1991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:35:59.793063 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:35:59.793160 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:35:59.793283 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:35:59.794641 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:59.795490 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:59.797233 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:35:59.797716 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:35:59.797880 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:59.799803 (+ 1923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:35:59.799808 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:35:59.799811 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:35:59.799828 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:35:59.799873 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:35:59.799885 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:35:59.799959 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 02:35:59.800278 (+ 319us) server_negotiation.cc:299] Negotiation successful
0808 02:35:59.800456 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":209,"threads_started":1}
I20260808 02:35:59.802129 22300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:35:59.789971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:38871 (local address 127.24.116.193:44827)
0808 02:35:59.790902 (+ 931us) negotiation.cc:107] Waiting for socket to connect
0808 02:35:59.790942 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 02:35:59.792778 (+ 1836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:35:59.793527 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:35:59.793535 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:35:59.793621 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:35:59.794431 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:59.794461 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:59.795657 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:59.795661 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:59.797066 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:35:59.797081 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:35:59.798073 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:35:59.798084 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:35:59.798544 (+ 460us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:35:59.799416 (+ 872us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:35:59.799422 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:35:59.799478 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:35:59.799594 (+ 116us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:35:59.799992 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:35:59.800007 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:35:59.800018 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 02:35:59.800210 (+ 192us) client_negotiation.cc:240] Negotiation successful
0808 02:35:59.800683 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":278,"threads_started":1}
I20260808 02:35:59.803757 22296 heartbeater.cc:347] Connected to a master server at 127.24.116.254:38871
I20260808 02:35:59.804103 22296 heartbeater.cc:464] Registering TS with master...
I20260808 02:35:59.805080 22296 heartbeater.cc:511] Master 127.24.116.254:38871 requested a full tablet report, sending...
I20260808 02:35:59.807327 21998 ts_manager.cc:194] Registered new tserver with Master: 41a3a61bb2bc4dd19de24cdca8be8c11 (127.24.116.193:40119)
I20260808 02:35:59.808881 21998 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.116.193:44827
W20260808 02:36:00.153934 22301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:00.154229 22301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:00.154318 22301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:00.161669 22301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:00.161800 22301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:00.161908 22301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:36:00.171151 22301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:46307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:38871
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:00.172557 22301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:00.174322 22301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:00.187626 22311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:00.187469 22312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:00.187680 22317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:00.188812 22301 server_base.cc:1034] running on GCE node
I20260808 02:36:00.189574 22301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:00.190689 22301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:00.191946 22301 hybrid_clock.cc:648] HybridClock initialized: now 1786156560191878 us; error 58 us; skew 500 ppm
I20260808 02:36:00.192337 22301 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:36:00.195111 22301 webserver.cc:460] Webserver started at http://127.24.116.194:37111/ using document root <none> and password file <none>
I20260808 02:36:00.195964 22301 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:00.196092 22301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:00.196484 22301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:00.200452 22301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "0015562a567544c4be18f1fb81d68685"
format_stamp: "Formatted at 2026-08-08 02:36:00 on dist-test-slave-45dx"
server_key: "ab52dc3d96b7e76efdd27f63e45e1dfb"
server_key_iv: "7a8a73ccfd403eb594dd8cc3baaf9541"
server_key_version: "encryptionkey@0"
I20260808 02:36:00.201465 22301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "0015562a567544c4be18f1fb81d68685"
format_stamp: "Formatted at 2026-08-08 02:36:00 on dist-test-slave-45dx"
server_key: "ab52dc3d96b7e76efdd27f63e45e1dfb"
server_key_iv: "7a8a73ccfd403eb594dd8cc3baaf9541"
server_key_version: "encryptionkey@0"
I20260808 02:36:00.207707 22301 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 02:36:00.211376 22324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:00.212795 22301 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:36:00.213014 22301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "0015562a567544c4be18f1fb81d68685"
format_stamp: "Formatted at 2026-08-08 02:36:00 on dist-test-slave-45dx"
server_key: "ab52dc3d96b7e76efdd27f63e45e1dfb"
server_key_iv: "7a8a73ccfd403eb594dd8cc3baaf9541"
server_key_version: "encryptionkey@0"
I20260808 02:36:00.213218 22301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:00.225471 22301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:00.226269 22301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:00.226583 22301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:00.227500 22301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:36:00.229029 22301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:36:00.229121 22301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:00.229195 22301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:36:00.229255 22301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:00.265869 22301 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:35737
I20260808 02:36:00.265939 22487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:35737 every 8 connection(s)
I20260808 02:36:00.267668 22301 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:36:00.274371 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 22301
I20260808 02:36:00.274602 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:36:00.275104 25043 external_mini_cluster.cc:1428] Setting key 8178f617bc9dcd44d7f85549ce7437d1
I20260808 02:36:00.278080 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:38871
--builtin_ntp_servers=127.24.116.212:46307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 02:36:00.282034 22299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:00.271679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:51169 (local address 127.24.116.254:38871)
0808 02:36:00.271916 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:00.271922 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:00.272711 (+ 789us) server_negotiation.cc:407] Connection header received
0808 02:36:00.274675 (+ 1964us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:00.274681 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:00.274778 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:00.274902 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:00.276213 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:00.277106 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:00.278762 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:00.279526 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:00.279676 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:00.281086 (+ 1410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:00.281094 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:00.281101 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:00.281127 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:00.281169 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:00.281188 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:00.281285 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:00.281499 (+ 214us) server_negotiation.cc:299] Negotiation successful
0808 02:36:00.281612 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 02:36:00.282927 22490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:00.271310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:38871 (local address 127.24.116.194:51169)
0808 02:36:00.272547 (+ 1237us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:00.272587 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:00.274338 (+ 1751us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:00.275150 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:00.275159 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:00.275296 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:36:00.276023 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:00.276044 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:00.277293 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:00.277297 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:00.278608 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:00.278620 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:00.279751 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:00.279756 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:00.279995 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:00.280728 (+ 733us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:36:00.280731 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:36:00.280775 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:36:00.280883 (+ 108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:36:00.281289 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:36:00.281296 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:36:00.281302 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 02:36:00.281458 (+ 156us) client_negotiation.cc:240] Negotiation successful
0808 02:36:00.281767 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":693,"thread_start_us":421,"threads_started":1}
I20260808 02:36:00.284468 22488 heartbeater.cc:347] Connected to a master server at 127.24.116.254:38871
I20260808 02:36:00.284826 22488 heartbeater.cc:464] Registering TS with master...
I20260808 02:36:00.285702 22488 heartbeater.cc:511] Master 127.24.116.254:38871 requested a full tablet report, sending...
I20260808 02:36:00.287276 21998 ts_manager.cc:194] Registered new tserver with Master: 0015562a567544c4be18f1fb81d68685 (127.24.116.194:35737)
I20260808 02:36:00.288120 21998 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.116.194:51169
W20260808 02:36:00.636205 22491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:00.636622 22491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:00.636790 22491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:00.644164 22491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:00.644313 22491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:00.644546 22491 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:36:00.654374 22491 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:46307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:38871
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:00.655788 22491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:00.657647 22491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:00.671548 22496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:00.671509 22499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:00.671485 22501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:00.672614 22491 server_base.cc:1034] running on GCE node
I20260808 02:36:00.673338 22491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:00.674288 22491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:00.675522 22491 hybrid_clock.cc:648] HybridClock initialized: now 1786156560675482 us; error 50 us; skew 500 ppm
I20260808 02:36:00.675843 22491 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:36:00.678227 22491 webserver.cc:460] Webserver started at http://127.24.116.195:37513/ using document root <none> and password file <none>
I20260808 02:36:00.678954 22491 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:00.679100 22491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:00.679461 22491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:00.682968 22491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "db335b24ffca4fa6b379fbde3ae13ae2"
format_stamp: "Formatted at 2026-08-08 02:36:00 on dist-test-slave-45dx"
server_key: "a03d4f73793736dfc11f8bd491ce42f1"
server_key_iv: "512455ac7705f1c2cb7cd9bfbcb95347"
server_key_version: "encryptionkey@0"
I20260808 02:36:00.683782 22491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "db335b24ffca4fa6b379fbde3ae13ae2"
format_stamp: "Formatted at 2026-08-08 02:36:00 on dist-test-slave-45dx"
server_key: "a03d4f73793736dfc11f8bd491ce42f1"
server_key_iv: "512455ac7705f1c2cb7cd9bfbcb95347"
server_key_version: "encryptionkey@0"
I20260808 02:36:00.689178 22491 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260808 02:36:00.692847 22511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:00.694280 22491 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 02:36:00.694478 22491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "db335b24ffca4fa6b379fbde3ae13ae2"
format_stamp: "Formatted at 2026-08-08 02:36:00 on dist-test-slave-45dx"
server_key: "a03d4f73793736dfc11f8bd491ce42f1"
server_key_iv: "512455ac7705f1c2cb7cd9bfbcb95347"
server_key_version: "encryptionkey@0"
I20260808 02:36:00.694731 22491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:00.714794 22491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:00.715672 22491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:00.716005 22491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:00.717276 22491 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:36:00.718823 22491 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:36:00.718961 22491 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:00.719105 22491 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:36:00.719198 22491 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:00.752204 22491 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:33097
I20260808 02:36:00.752301 22684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:33097 every 8 connection(s)
I20260808 02:36:00.753679 22491 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:36:00.763650 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 22491
I20260808 02:36:00.763836 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:36:00.764358 25043 external_mini_cluster.cc:1428] Setting key 8a176559531d1cf5eb35a1febbe468db
I20260808 02:36:00.767431 22299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:00.756992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:59553 (local address 127.24.116.254:38871)
0808 02:36:00.757198 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:00.757203 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:00.758734 (+ 1531us) server_negotiation.cc:407] Connection header received
0808 02:36:00.760642 (+ 1908us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:00.760647 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:00.760742 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:00.760870 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:00.761957 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:00.762726 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:00.764482 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:00.764925 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:00.765069 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:00.766546 (+ 1477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:00.766550 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:00.766554 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:00.766574 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:00.766608 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:00.766621 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:00.766720 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:00.766947 (+ 227us) server_negotiation.cc:299] Negotiation successful
0808 02:36:00.767092 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 02:36:00.768457 22687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:00.757487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:38871 (local address 127.24.116.195:59553)
0808 02:36:00.758527 (+ 1040us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:00.758600 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:00.760287 (+ 1687us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:00.761102 (+ 815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:00.761111 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:00.761201 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:36:00.761780 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:00.761798 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:00.762902 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:00.762908 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:00.764277 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:00.764290 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:00.765175 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:00.765183 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:00.765445 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:00.766195 (+ 750us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:36:00.766197 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:36:00.766238 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:36:00.766323 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:36:00.766722 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:36:00.766737 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:36:00.766747 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 02:36:00.766934 (+ 187us) client_negotiation.cc:240] Negotiation successful
0808 02:36:00.767354 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":313,"threads_started":1}
I20260808 02:36:00.769812 22685 heartbeater.cc:347] Connected to a master server at 127.24.116.254:38871
I20260808 02:36:00.770175 22685 heartbeater.cc:464] Registering TS with master...
I20260808 02:36:00.771075 22685 heartbeater.cc:511] Master 127.24.116.254:38871 requested a full tablet report, sending...
I20260808 02:36:00.772774 21998 ts_manager.cc:194] Registered new tserver with Master: db335b24ffca4fa6b379fbde3ae13ae2 (127.24.116.195:33097)
I20260808 02:36:00.773736 21998 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.116.195:59553
I20260808 02:36:00.779333 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:36:00.790799 22299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:00.783728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60574 (local address 127.24.116.254:38871)
0808 02:36:00.783914 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:00.783918 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:00.784482 (+ 564us) server_negotiation.cc:407] Connection header received
0808 02:36:00.784646 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:00.784653 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:00.784734 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:00.784840 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:00.785357 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:00.786428 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:00.788023 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:00.788742 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:00.788876 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:00.790012 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:00.790018 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:00.790022 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:00.790045 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:00.790085 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:00.790100 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:00.790269 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:00.790434 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 02:36:00.790490 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 02:36:00.794745 21998 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60574:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:36:00.802225 21998 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:36:00.812652 22296 heartbeater.cc:503] Master 127.24.116.254:38871 was elected leader, sending a full tablet report...
I20260808 02:36:00.834198 22704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:00.815340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:40119 (local address 127.0.0.1:56896)
0808 02:36:00.821097 (+ 5757us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:00.821152 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:00.821409 (+ 257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:00.822801 (+ 1392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:00.822812 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:00.822864 (+ 52us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:36:00.823492 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:00.823510 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:00.826204 (+ 2694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:00.826213 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:00.829532 (+ 3319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:00.829556 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:00.832859 (+ 3303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:00.832869 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:00.833182 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:00.833257 (+ 75us) client_negotiation.cc:769] Sending connection context
0808 02:36:00.833444 (+ 187us) client_negotiation.cc:240] Negotiation successful
0808 02:36:00.833716 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5388,"threads_started":1}
I20260808 02:36:00.835494 22703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:00.815492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56896 (local address 127.24.116.193:40119)
0808 02:36:00.816387 (+ 895us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:00.816398 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:00.821655 (+ 5257us) server_negotiation.cc:407] Connection header received
0808 02:36:00.821808 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:00.821820 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:00.822145 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:00.822411 (+ 266us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:36:00.823776 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:00.825948 (+ 2172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:00.829842 (+ 3894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:00.832085 (+ 2243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:00.832379 (+ 294us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:00.832692 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:00.834722 (+ 2030us) server_negotiation.cc:299] Negotiation successful
0808 02:36:00.834969 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":687,"thread_start_us":542,"threads_started":1}
I20260808 02:36:00.846094 22196 tablet_service.cc:1467] Processing CreateTablet for tablet 42ba3452149048beb2a2cf186432ceab (DEFAULT_TABLE table=test-table [id=d717f38d3c8c47548fc1b542920ac03e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:36:00.847138 22708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:00.816390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50022 (local address 127.24.116.194:35737)
0808 02:36:00.837237 (+ 20847us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:00.837251 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:00.837296 (+ 45us) server_negotiation.cc:407] Connection header received
0808 02:36:00.837441 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:00.837454 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:00.837815 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:00.838664 (+ 849us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:36:00.838962 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:00.841068 (+ 2106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:00.844331 (+ 3263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:00.845786 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:00.846032 (+ 246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:00.846282 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:00.846509 (+ 227us) server_negotiation.cc:299] Negotiation successful
0808 02:36:00.846706 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20610,"thread_start_us":21719,"threads_started":1}
I20260808 02:36:00.847157 22704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:00.815795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:35737 (local address 127.0.0.1:50022)
0808 02:36:00.836035 (+ 20240us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:00.836065 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:00.836199 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:00.838107 (+ 1908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:00.838115 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:00.838156 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:36:00.838431 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:00.838445 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:00.842118 (+ 3673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:00.842124 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:00.844113 (+ 1989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:00.844145 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:00.846025 (+ 1880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:00.846031 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:00.846292 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:00.846332 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 02:36:00.846448 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 02:36:00.846745 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20063,"mutex_wait_us":131,"thread_start_us":5005,"threads_started":1}
I20260808 02:36:00.848048 22196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42ba3452149048beb2a2cf186432ceab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:00.850502 22705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:00.815795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:33097 (local address 127.0.0.1:42416)
0808 02:36:00.841804 (+ 26009us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:00.841827 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:00.841968 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:00.843533 (+ 1565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:00.843543 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:00.843572 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:36:00.844017 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:00.844030 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:00.846045 (+ 2015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:00.846050 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:00.848147 (+ 2097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:00.848164 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:00.849702 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:00.849709 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:00.849887 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:00.849920 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 02:36:00.850021 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 02:36:00.850152 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25809,"mutex_wait_us":664,"thread_start_us":24983,"threads_started":1}
I20260808 02:36:00.850732 22709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:00.816342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42416 (local address 127.24.116.195:33097)
0808 02:36:00.842616 (+ 26274us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:00.842625 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:00.842671 (+ 46us) server_negotiation.cc:407] Connection header received
0808 02:36:00.842772 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:00.842780 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:00.843055 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:00.843254 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:36:00.844244 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:00.845784 (+ 1540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:00.848416 (+ 2632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:00.849491 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:00.849719 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:00.849931 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:00.850061 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 02:36:00.850218 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26090,"thread_start_us":25917,"threads_started":1}
I20260808 02:36:00.851305 22391 tablet_service.cc:1467] Processing CreateTablet for tablet 42ba3452149048beb2a2cf186432ceab (DEFAULT_TABLE table=test-table [id=d717f38d3c8c47548fc1b542920ac03e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:36:00.853039 22391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42ba3452149048beb2a2cf186432ceab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:00.854161 22583 tablet_service.cc:1467] Processing CreateTablet for tablet 42ba3452149048beb2a2cf186432ceab (DEFAULT_TABLE table=test-table [id=d717f38d3c8c47548fc1b542920ac03e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:36:00.855324 22583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42ba3452149048beb2a2cf186432ceab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:00.863473 22710 tablet_bootstrap.cc:492] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11: Bootstrap starting.
I20260808 02:36:00.867587 22714 tablet_bootstrap.cc:492] T 42ba3452149048beb2a2cf186432ceab P 0015562a567544c4be18f1fb81d68685: Bootstrap starting.
I20260808 02:36:00.867802 22710 tablet_bootstrap.cc:654] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:00.869074 22715 tablet_bootstrap.cc:492] T 42ba3452149048beb2a2cf186432ceab P db335b24ffca4fa6b379fbde3ae13ae2: Bootstrap starting.
I20260808 02:36:00.869343 22710 log.cc:824] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:00.871510 22714 tablet_bootstrap.cc:654] T 42ba3452149048beb2a2cf186432ceab P 0015562a567544c4be18f1fb81d68685: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:00.872681 22715 tablet_bootstrap.cc:654] T 42ba3452149048beb2a2cf186432ceab P db335b24ffca4fa6b379fbde3ae13ae2: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:00.872805 22714 log.cc:824] T 42ba3452149048beb2a2cf186432ceab P 0015562a567544c4be18f1fb81d68685: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:00.873898 22715 log.cc:824] T 42ba3452149048beb2a2cf186432ceab P db335b24ffca4fa6b379fbde3ae13ae2: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:00.874366 22710 tablet_bootstrap.cc:492] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11: No bootstrap required, opened a new log
I20260808 02:36:00.874698 22710 ts_tablet_manager.cc:1397] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260808 02:36:00.876762 22714 tablet_bootstrap.cc:492] T 42ba3452149048beb2a2cf186432ceab P 0015562a567544c4be18f1fb81d68685: No bootstrap required, opened a new log
I20260808 02:36:00.877100 22715 tablet_bootstrap.cc:492] T 42ba3452149048beb2a2cf186432ceab P db335b24ffca4fa6b379fbde3ae13ae2: No bootstrap required, opened a new log
I20260808 02:36:00.877116 22714 ts_tablet_manager.cc:1397] T 42ba3452149048beb2a2cf186432ceab P 0015562a567544c4be18f1fb81d68685: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260808 02:36:00.877360 22715 ts_tablet_manager.cc:1397] T 42ba3452149048beb2a2cf186432ceab P db335b24ffca4fa6b379fbde3ae13ae2: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.001s
I20260808 02:36:00.882831 22710 raft_consensus.cc:348] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a3a61bb2bc4dd19de24cdca8be8c11" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40119 } } peers { permanent_uuid: "0015562a567544c4be18f1fb81d68685" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35737 } } peers { permanent_uuid: "db335b24ffca4fa6b379fbde3ae13ae2" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33097 } }
I20260808 02:36:00.883244 22710 raft_consensus.cc:374] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:00.883364 22710 raft_consensus.cc:729] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41a3a61bb2bc4dd19de24cdca8be8c11, State: Initialized, Role: FOLLOWER
I20260808 02:36:00.884032 22710 consensus_queue.cc:260] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a3a61bb2bc4dd19de24cdca8be8c11" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40119 } } peers { permanent_uuid: "0015562a567544c4be18f1fb81d68685" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35737 } } peers { permanent_uuid: "db335b24ffca4fa6b379fbde3ae13ae2" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33097 } }
I20260808 02:36:00.885689 22710 ts_tablet_manager.cc:1428] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11: Time spent starting tablet: real 0.011s user 0.004s sys 0.008s
I20260808 02:36:00.887641 22715 raft_consensus.cc:348] T 42ba3452149048beb2a2cf186432ceab P db335b24ffca4fa6b379fbde3ae13ae2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a3a61bb2bc4dd19de24cdca8be8c11" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40119 } } peers { permanent_uuid: "0015562a567544c4be18f1fb81d68685" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35737 } } peers { permanent_uuid: "db335b24ffca4fa6b379fbde3ae13ae2" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33097 } }
I20260808 02:36:00.888033 22715 raft_consensus.cc:374] T 42ba3452149048beb2a2cf186432ceab P db335b24ffca4fa6b379fbde3ae13ae2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:00.888160 22715 raft_consensus.cc:729] T 42ba3452149048beb2a2cf186432ceab P db335b24ffca4fa6b379fbde3ae13ae2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db335b24ffca4fa6b379fbde3ae13ae2, State: Initialized, Role: FOLLOWER
I20260808 02:36:00.888577 22714 raft_consensus.cc:348] T 42ba3452149048beb2a2cf186432ceab P 0015562a567544c4be18f1fb81d68685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a3a61bb2bc4dd19de24cdca8be8c11" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40119 } } peers { permanent_uuid: "0015562a567544c4be18f1fb81d68685" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35737 } } peers { permanent_uuid: "db335b24ffca4fa6b379fbde3ae13ae2" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33097 } }
I20260808 02:36:00.888868 22715 consensus_queue.cc:260] T 42ba3452149048beb2a2cf186432ceab P db335b24ffca4fa6b379fbde3ae13ae2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a3a61bb2bc4dd19de24cdca8be8c11" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40119 } } peers { permanent_uuid: "0015562a567544c4be18f1fb81d68685" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35737 } } peers { permanent_uuid: "db335b24ffca4fa6b379fbde3ae13ae2" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33097 } }
I20260808 02:36:00.889063 22714 raft_consensus.cc:374] T 42ba3452149048beb2a2cf186432ceab P 0015562a567544c4be18f1fb81d68685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:00.889209 22714 raft_consensus.cc:729] T 42ba3452149048beb2a2cf186432ceab P 0015562a567544c4be18f1fb81d68685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0015562a567544c4be18f1fb81d68685, State: Initialized, Role: FOLLOWER
I20260808 02:36:00.889921 22714 consensus_queue.cc:260] T 42ba3452149048beb2a2cf186432ceab P 0015562a567544c4be18f1fb81d68685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a3a61bb2bc4dd19de24cdca8be8c11" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40119 } } peers { permanent_uuid: "0015562a567544c4be18f1fb81d68685" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35737 } } peers { permanent_uuid: "db335b24ffca4fa6b379fbde3ae13ae2" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33097 } }
I20260808 02:36:00.890762 22685 heartbeater.cc:503] Master 127.24.116.254:38871 was elected leader, sending a full tablet report...
I20260808 02:36:00.891124 22488 heartbeater.cc:503] Master 127.24.116.254:38871 was elected leader, sending a full tablet report...
I20260808 02:36:00.891390 22715 ts_tablet_manager.cc:1428] T 42ba3452149048beb2a2cf186432ceab P db335b24ffca4fa6b379fbde3ae13ae2: Time spent starting tablet: real 0.014s user 0.011s sys 0.003s
I20260808 02:36:00.891784 22714 ts_tablet_manager.cc:1428] T 42ba3452149048beb2a2cf186432ceab P 0015562a567544c4be18f1fb81d68685: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
W20260808 02:36:01.005986 22686 tablet.cc:2369] T 42ba3452149048beb2a2cf186432ceab P db335b24ffca4fa6b379fbde3ae13ae2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:36:01.020085 22489 tablet.cc:2369] T 42ba3452149048beb2a2cf186432ceab P 0015562a567544c4be18f1fb81d68685: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:36:01.039220 22297 tablet.cc:2369] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:36:01.189041 22719 raft_consensus.cc:482] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:36:01.189400 22719 raft_consensus.cc:504] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a3a61bb2bc4dd19de24cdca8be8c11" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40119 } } peers { permanent_uuid: "0015562a567544c4be18f1fb81d68685" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35737 } } peers { permanent_uuid: "db335b24ffca4fa6b379fbde3ae13ae2" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33097 } }
I20260808 02:36:01.191159 22719 leader_election.cc:288] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0015562a567544c4be18f1fb81d68685 (127.24.116.194:35737), db335b24ffca4fa6b379fbde3ae13ae2 (127.24.116.195:33097)
I20260808 02:36:01.200008 22708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:01.191723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:34789 (local address 127.24.116.194:35737)
0808 02:36:01.191917 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:01.191924 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:01.192654 (+ 730us) server_negotiation.cc:407] Connection header received
0808 02:36:01.193009 (+ 355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:01.193016 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:01.193108 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:01.193175 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:36:01.194121 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:01.195268 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:01.197900 (+ 2632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:01.198987 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:01.199154 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:01.199230 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:01.199563 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 02:36:01.199702 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 02:36:01.200160 22723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:01.191601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:35737 (local address 127.24.116.193:34789)
0808 02:36:01.192521 (+ 920us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:01.192546 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:01.192796 (+ 250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:01.193391 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:01.193395 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:01.193421 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:36:01.193932 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:01.193952 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:01.195464 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:01.195476 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:01.197675 (+ 2199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:01.197688 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:01.199195 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:01.199202 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:01.199381 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:01.199416 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 02:36:01.199506 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 02:36:01.199727 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":775,"mutex_wait_us":71,"spinlock_wait_cycles":38144,"thread_start_us":521,"threads_started":1}
I20260808 02:36:01.200863 22709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:01.191703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:58221 (local address 127.24.116.195:33097)
0808 02:36:01.191917 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:01.191923 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:01.192951 (+ 1028us) server_negotiation.cc:407] Connection header received
0808 02:36:01.193197 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:01.193202 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:01.193274 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:01.193338 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:36:01.194247 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:01.195304 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:01.198469 (+ 3165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:01.199667 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:01.199821 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:01.199894 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:01.200476 (+ 582us) server_negotiation.cc:299] Negotiation successful
0808 02:36:01.200607 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 02:36:01.201550 22724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:01.192132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:33097 (local address 127.24.116.193:58221)
0808 02:36:01.192846 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:01.192864 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:01.193055 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:01.193555 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:01.193560 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:01.193600 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:36:01.194012 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:01.194024 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:01.195460 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:01.195466 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:01.198247 (+ 2781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:01.198263 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:01.200052 (+ 1789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:01.200059 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:01.200241 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:01.200277 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 02:36:01.201048 (+ 771us) client_negotiation.cc:240] Negotiation successful
0808 02:36:01.201186 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"mutex_wait_us":150,"thread_start_us":534,"threads_started":1}
I20260808 02:36:01.201483 22420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ba3452149048beb2a2cf186432ceab" candidate_uuid: "41a3a61bb2bc4dd19de24cdca8be8c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0015562a567544c4be18f1fb81d68685" is_pre_election: true
I20260808 02:36:01.202106 22420 raft_consensus.cc:2454] T 42ba3452149048beb2a2cf186432ceab P 0015562a567544c4be18f1fb81d68685 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41a3a61bb2bc4dd19de24cdca8be8c11 in term 0.
I20260808 02:36:01.202724 22614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ba3452149048beb2a2cf186432ceab" candidate_uuid: "41a3a61bb2bc4dd19de24cdca8be8c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db335b24ffca4fa6b379fbde3ae13ae2" is_pre_election: true
I20260808 02:36:01.202981 22121 leader_election.cc:302] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015562a567544c4be18f1fb81d68685, 41a3a61bb2bc4dd19de24cdca8be8c11; no voters:
I20260808 02:36:01.203231 22614 raft_consensus.cc:2454] T 42ba3452149048beb2a2cf186432ceab P db335b24ffca4fa6b379fbde3ae13ae2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41a3a61bb2bc4dd19de24cdca8be8c11 in term 0.
I20260808 02:36:01.203464 22719 raft_consensus.cc:2781] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:36:01.203644 22719 raft_consensus.cc:482] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:36:01.203735 22719 raft_consensus.cc:3037] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:01.206048 22719 raft_consensus.cc:504] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a3a61bb2bc4dd19de24cdca8be8c11" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40119 } } peers { permanent_uuid: "0015562a567544c4be18f1fb81d68685" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35737 } } peers { permanent_uuid: "db335b24ffca4fa6b379fbde3ae13ae2" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33097 } }
I20260808 02:36:01.206665 22719 leader_election.cc:288] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11 [CANDIDATE]: Term 1 election: Requested vote from peers 0015562a567544c4be18f1fb81d68685 (127.24.116.194:35737), db335b24ffca4fa6b379fbde3ae13ae2 (127.24.116.195:33097)
I20260808 02:36:01.207156 22614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ba3452149048beb2a2cf186432ceab" candidate_uuid: "41a3a61bb2bc4dd19de24cdca8be8c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db335b24ffca4fa6b379fbde3ae13ae2"
I20260808 02:36:01.207194 22420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42ba3452149048beb2a2cf186432ceab" candidate_uuid: "41a3a61bb2bc4dd19de24cdca8be8c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0015562a567544c4be18f1fb81d68685"
I20260808 02:36:01.207370 22614 raft_consensus.cc:3037] T 42ba3452149048beb2a2cf186432ceab P db335b24ffca4fa6b379fbde3ae13ae2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:01.207417 22420 raft_consensus.cc:3037] T 42ba3452149048beb2a2cf186432ceab P 0015562a567544c4be18f1fb81d68685 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:01.209683 22420 raft_consensus.cc:2454] T 42ba3452149048beb2a2cf186432ceab P 0015562a567544c4be18f1fb81d68685 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41a3a61bb2bc4dd19de24cdca8be8c11 in term 1.
I20260808 02:36:01.209787 22614 raft_consensus.cc:2454] T 42ba3452149048beb2a2cf186432ceab P db335b24ffca4fa6b379fbde3ae13ae2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41a3a61bb2bc4dd19de24cdca8be8c11 in term 1.
I20260808 02:36:01.210139 22121 leader_election.cc:302] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015562a567544c4be18f1fb81d68685, 41a3a61bb2bc4dd19de24cdca8be8c11; no voters:
I20260808 02:36:01.210459 22719 raft_consensus.cc:2781] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:36:01.210938 22719 raft_consensus.cc:686] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11 [term 1 LEADER]: Becoming Leader. State: Replica: 41a3a61bb2bc4dd19de24cdca8be8c11, State: Running, Role: LEADER
I20260808 02:36:01.211400 22719 consensus_queue.cc:237] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a3a61bb2bc4dd19de24cdca8be8c11" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40119 } } peers { permanent_uuid: "0015562a567544c4be18f1fb81d68685" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35737 } } peers { permanent_uuid: "db335b24ffca4fa6b379fbde3ae13ae2" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33097 } }
I20260808 02:36:01.215984 21997 catalog_manager.cc:5495] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41a3a61bb2bc4dd19de24cdca8be8c11 (127.24.116.193). New cstate: current_term: 1 leader_uuid: "41a3a61bb2bc4dd19de24cdca8be8c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a3a61bb2bc4dd19de24cdca8be8c11" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0015562a567544c4be18f1fb81d68685" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db335b24ffca4fa6b379fbde3ae13ae2" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33097 } health_report { overall_health: UNKNOWN } } }
I20260808 02:36:01.294476 22703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:01.289141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56912 (local address 127.24.116.193:40119)
0808 02:36:01.289348 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:01.289354 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:01.289373 (+ 19us) server_negotiation.cc:407] Connection header received
0808 02:36:01.289510 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:01.289514 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:01.289618 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:01.289748 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:36:01.290146 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:01.290894 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:01.292266 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:01.292750 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:01.292850 (+ 100us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:01.293435 (+ 585us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:36:01.293949 (+ 514us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:36:01.294080 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:01.294222 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 02:36:01.294261 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 02:36:01.303102 22420 raft_consensus.cc:1261] T 42ba3452149048beb2a2cf186432ceab P 0015562a567544c4be18f1fb81d68685 [term 1 FOLLOWER]: Refusing update from remote peer 41a3a61bb2bc4dd19de24cdca8be8c11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:36:01.303102 22614 raft_consensus.cc:1261] T 42ba3452149048beb2a2cf186432ceab P db335b24ffca4fa6b379fbde3ae13ae2 [term 1 FOLLOWER]: Refusing update from remote peer 41a3a61bb2bc4dd19de24cdca8be8c11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:36:01.304100 22725 consensus_queue.cc:1035] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0015562a567544c4be18f1fb81d68685" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 35737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:36:01.304600 22719 consensus_queue.cc:1035] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db335b24ffca4fa6b379fbde3ae13ae2" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 33097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:36:01.316908 22731 mvcc.cc:205] Tried to move back new op lower bound from 7316097275086823424 to 7316097274725896192. Current Snapshot: MvccSnapshot[applied={T|T < 7316097275086823424}]
I20260808 02:36:01.320001 22730 mvcc.cc:205] Tried to move back new op lower bound from 7316097275086823424 to 7316097274725896192. Current Snapshot: MvccSnapshot[applied={T|T < 7316097275086823424}]
I20260808 02:36:01.328989 21996 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60574:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:36:01.329249 21996 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60574:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:36:01.333262 21996 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 366bfb7225784cfaaa1058808f64756e: Sending DeleteTablet for 3 replicas of tablet 42ba3452149048beb2a2cf186432ceab
I20260808 02:36:01.334564 22583 tablet_service.cc:1514] Processing DeleteTablet for tablet 42ba3452149048beb2a2cf186432ceab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:36:01 UTC) from {username='slave'} at 127.0.0.1:42416
I20260808 02:36:01.334695 22391 tablet_service.cc:1514] Processing DeleteTablet for tablet 42ba3452149048beb2a2cf186432ceab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:36:01 UTC) from {username='slave'} at 127.0.0.1:50022
I20260808 02:36:01.334721 22196 tablet_service.cc:1514] Processing DeleteTablet for tablet 42ba3452149048beb2a2cf186432ceab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:36:01 UTC) from {username='slave'} at 127.0.0.1:56896
I20260808 02:36:01.339232 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 22097
I20260808 02:36:01.348812 22747 tablet_replica.cc:330] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11: stopping tablet replica
I20260808 02:36:01.349340 22747 raft_consensus.cc:2229] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:36:01.349975 22747 raft_consensus.cc:2258] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:36:01.352706 22747 ts_tablet_manager.cc:1905] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:36:01.360548 22747 ts_tablet_manager.cc:1918] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:36:01.360808 22747 log.cc:1196] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/42ba3452149048beb2a2cf186432ceab
I20260808 02:36:01.361486 22747 ts_tablet_manager.cc:1939] T 42ba3452149048beb2a2cf186432ceab P 41a3a61bb2bc4dd19de24cdca8be8c11: Deleting consensus metadata
I20260808 02:36:01.363616 21979 catalog_manager.cc:4841] TS 41a3a61bb2bc4dd19de24cdca8be8c11 (127.24.116.193:40119): tablet 42ba3452149048beb2a2cf186432ceab (table test-table [id=d717f38d3c8c47548fc1b542920ac03e]) successfully deleted
I20260808 02:36:01.365633 22745 tablet_replica.cc:330] T 42ba3452149048beb2a2cf186432ceab P db335b24ffca4fa6b379fbde3ae13ae2: stopping tablet replica
I20260808 02:36:01.366261 22746 tablet_replica.cc:330] T 42ba3452149048beb2a2cf186432ceab P 0015562a567544c4be18f1fb81d68685: stopping tablet replica
I20260808 02:36:01.366796 22746 raft_consensus.cc:2229] T 42ba3452149048beb2a2cf186432ceab P 0015562a567544c4be18f1fb81d68685 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:36:01.367324 22745 raft_consensus.cc:2229] T 42ba3452149048beb2a2cf186432ceab P db335b24ffca4fa6b379fbde3ae13ae2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:36:01.367941 22745 raft_consensus.cc:2258] T 42ba3452149048beb2a2cf186432ceab P db335b24ffca4fa6b379fbde3ae13ae2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:36:01.367957 22746 raft_consensus.cc:2258] T 42ba3452149048beb2a2cf186432ceab P 0015562a567544c4be18f1fb81d68685 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:36:01.370283 22745 ts_tablet_manager.cc:1905] T 42ba3452149048beb2a2cf186432ceab P db335b24ffca4fa6b379fbde3ae13ae2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:36:01.370464 22746 ts_tablet_manager.cc:1905] T 42ba3452149048beb2a2cf186432ceab P 0015562a567544c4be18f1fb81d68685: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:36:01.374167 22703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:01.341258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56928 (local address 127.24.116.193:40119)
0808 02:36:01.341503 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:01.341513 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:01.364917 (+ 23404us) server_negotiation.cc:407] Connection header received
0808 02:36:01.365163 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:01.365173 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:01.365316 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:01.365457 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:01.366353 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:01.367318 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:01.369615 (+ 2297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:01.370391 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:01.370516 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:01.372235 (+ 1719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:01.372247 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:01.372266 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:01.373156 (+ 890us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:01.373222 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:01.373256 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:01.373355 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:01.373620 (+ 265us) server_negotiation.cc:299] Negotiation successful
0808 02:36:01.373735 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 02:36:01.375705 22290 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:36:01.377951 22745 ts_tablet_manager.cc:1918] T 42ba3452149048beb2a2cf186432ceab P db335b24ffca4fa6b379fbde3ae13ae2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:36:01.378366 22745 log.cc:1196] T 42ba3452149048beb2a2cf186432ceab P db335b24ffca4fa6b379fbde3ae13ae2: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/42ba3452149048beb2a2cf186432ceab
I20260808 02:36:01.378880 22746 ts_tablet_manager.cc:1918] T 42ba3452149048beb2a2cf186432ceab P 0015562a567544c4be18f1fb81d68685: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:36:01.379078 22745 ts_tablet_manager.cc:1939] T 42ba3452149048beb2a2cf186432ceab P db335b24ffca4fa6b379fbde3ae13ae2: Deleting consensus metadata
I20260808 02:36:01.379129 22746 log.cc:1196] T 42ba3452149048beb2a2cf186432ceab P 0015562a567544c4be18f1fb81d68685: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/42ba3452149048beb2a2cf186432ceab
I20260808 02:36:01.379869 22746 ts_tablet_manager.cc:1939] T 42ba3452149048beb2a2cf186432ceab P 0015562a567544c4be18f1fb81d68685: Deleting consensus metadata
I20260808 02:36:01.381174 21976 catalog_manager.cc:4841] TS db335b24ffca4fa6b379fbde3ae13ae2 (127.24.116.195:33097): tablet 42ba3452149048beb2a2cf186432ceab (table test-table [id=d717f38d3c8c47548fc1b542920ac03e]) successfully deleted
I20260808 02:36:01.381963 21977 catalog_manager.cc:4841] TS 0015562a567544c4be18f1fb81d68685 (127.24.116.194:35737): tablet 42ba3452149048beb2a2cf186432ceab (table test-table [id=d717f38d3c8c47548fc1b542920ac03e]) successfully deleted
I20260808 02:36:01.476989 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 22097
I20260808 02:36:01.500864 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 22301
I20260808 02:36:01.508224 22708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:01.501941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50024 (local address 127.24.116.194:35737)
0808 02:36:01.502138 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:01.502144 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:01.502165 (+ 21us) server_negotiation.cc:407] Connection header received
0808 02:36:01.502326 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:01.502331 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:01.502424 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:01.502524 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:01.502934 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:01.503785 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:01.505147 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:01.505604 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:01.505713 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:01.506829 (+ 1116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:01.506840 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:01.506855 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:01.507517 (+ 662us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:01.507569 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:01.507590 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:01.507691 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:01.507824 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 02:36:01.507934 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 02:36:01.509032 22482 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:36:01.601177 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 22301
I20260808 02:36:01.627712 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 22491
I20260808 02:36:01.635075 22709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:01.628622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42428 (local address 127.24.116.195:33097)
0808 02:36:01.628813 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:01.628818 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:01.628844 (+ 26us) server_negotiation.cc:407] Connection header received
0808 02:36:01.628959 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:01.628963 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:01.629065 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:01.629151 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:01.629535 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:01.630312 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:01.631854 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:01.632255 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:01.632524 (+ 269us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:01.633657 (+ 1133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:01.633667 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:01.633683 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:01.634260 (+ 577us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:01.634311 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:01.634338 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:01.634441 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:01.634559 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 02:36:01.634651 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 02:36:01.635828 22676 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:36:01.725869 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 22491
I20260808 02:36:01.754717 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 21945
I20260808 02:36:01.755888 22054 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:36:01.868414 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 21945
2026-08-08T02:36:01Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3250 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:36:02 dist-test-slave-45dx krb5kdc[22759](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:36:02 dist-test-slave-45dx krb5kdc[22759](info): set up 2 sockets
Aug 08 02:36:02 dist-test-slave-45dx krb5kdc[22759](info): commencing operation
krb5kdc: starting...
W20260808 02:36:03.261416 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.342s user 0.004s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:36:03 dist-test-slave-45dx krb5kdc[22759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:36:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:36:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:36:03.615700 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:42975
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:44957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:42975
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:36:03.976801 22774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:03.977093 22774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:03.977187 22774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:03.984438 22774 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:36:03.984549 22774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:03.984596 22774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:03.984655 22774 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:36:03.984707 22774 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:36:03.994632 22774 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:44957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:42975
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:42975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:03.995937 22774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:03.997309 22774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:04.010643 22780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:04.010663 22782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:04.010689 22784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:04.011499 22774 server_base.cc:1034] running on GCE node
I20260808 02:36:04.012603 22774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:04.014114 22774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:04.015368 22774 hybrid_clock.cc:648] HybridClock initialized: now 1786156564015324 us; error 55 us; skew 500 ppm
I20260808 02:36:04.015738 22774 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:04 dist-test-slave-45dx krb5kdc[22759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156564, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:04.024166 22774 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:36:04.025847 22774 webserver.cc:460] Webserver started at http://127.24.116.254:33543/ using document root <none> and password file <none>
I20260808 02:36:04.026525 22774 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:04.026630 22774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:04.026896 22774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:04.029939 22774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "8ab9d894f2c140f58b793c802bc03d82"
format_stamp: "Formatted at 2026-08-08 02:36:04 on dist-test-slave-45dx"
server_key: "d01edef6148d9720afe60569f5cf0a6e"
server_key_iv: "6fc8f0f5796f7b01e647c042727fa090"
server_key_version: "encryptionkey@0"
I20260808 02:36:04.030665 22774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "8ab9d894f2c140f58b793c802bc03d82"
format_stamp: "Formatted at 2026-08-08 02:36:04 on dist-test-slave-45dx"
server_key: "d01edef6148d9720afe60569f5cf0a6e"
server_key_iv: "6fc8f0f5796f7b01e647c042727fa090"
server_key_version: "encryptionkey@0"
I20260808 02:36:04.036250 22774 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 02:36:04.040058 22793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:04.041599 22774 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:36:04.041771 22774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "8ab9d894f2c140f58b793c802bc03d82"
format_stamp: "Formatted at 2026-08-08 02:36:04 on dist-test-slave-45dx"
server_key: "d01edef6148d9720afe60569f5cf0a6e"
server_key_iv: "6fc8f0f5796f7b01e647c042727fa090"
server_key_version: "encryptionkey@0"
I20260808 02:36:04.041953 22774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:04.057713 22774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:04.061964 22774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:04.062201 22774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:04.081966 22774 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:42975
I20260808 02:36:04.081998 22877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:42975 every 8 connection(s)
I20260808 02:36:04.083480 22774 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:36:04.087568 22878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:04.090528 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 22774
I20260808 02:36:04.090749 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:36:04.091307 25043 external_mini_cluster.cc:1428] Setting key fa34f4dc3ea7bd0a85cc2f43dfe52044
I20260808 02:36:04.104152 22878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ab9d894f2c140f58b793c802bc03d82: Bootstrap starting.
I20260808 02:36:04.108175 22878 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ab9d894f2c140f58b793c802bc03d82: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:04.109403 22878 log.cc:824] T 00000000000000000000000000000000 P 8ab9d894f2c140f58b793c802bc03d82: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:04.112946 22878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ab9d894f2c140f58b793c802bc03d82: No bootstrap required, opened a new log
Aug 08 02:36:04 dist-test-slave-45dx krb5kdc[22759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:36:04.123530 22878 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ab9d894f2c140f58b793c802bc03d82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ab9d894f2c140f58b793c802bc03d82" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42975 } }
I20260808 02:36:04.124012 22878 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8ab9d894f2c140f58b793c802bc03d82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:04.124140 22878 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ab9d894f2c140f58b793c802bc03d82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ab9d894f2c140f58b793c802bc03d82, State: Initialized, Role: FOLLOWER
I20260808 02:36:04.124909 22878 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ab9d894f2c140f58b793c802bc03d82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ab9d894f2c140f58b793c802bc03d82" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42975 } }
I20260808 02:36:04.125216 22878 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8ab9d894f2c140f58b793c802bc03d82 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:36:04.125223 22881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:04.093498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52102 (local address 127.24.116.254:42975)
0808 02:36:04.101501 (+ 8003us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:04.101520 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:04.101583 (+ 63us) server_negotiation.cc:407] Connection header received
0808 02:36:04.104159 (+ 2576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:04.104192 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:04.104744 (+ 552us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:04.105217 (+ 473us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:04.106668 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:04.108737 (+ 2069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:04.110469 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:04.111493 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:04.111677 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:04.116143 (+ 4466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:04.116153 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:04.116172 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:04.116220 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:04.120460 (+ 4240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:04.121141 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:04.121150 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:04.121164 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:04.121406 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:04.121849 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:04.121854 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:04.121858 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:04.122628 (+ 770us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:04.122897 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:04.123290 (+ 393us) server_negotiation.cc:299] Negotiation successful
0808 02:36:04.123725 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7709,"thread_start_us":7472,"threads_started":1}
I20260808 02:36:04.125386 22878 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ab9d894f2c140f58b793c802bc03d82 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:36:04.125689 22878 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ab9d894f2c140f58b793c802bc03d82 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:04.128144 22878 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ab9d894f2c140f58b793c802bc03d82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ab9d894f2c140f58b793c802bc03d82" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42975 } }
I20260808 02:36:04.128705 22878 leader_election.cc:302] T 00000000000000000000000000000000 P 8ab9d894f2c140f58b793c802bc03d82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ab9d894f2c140f58b793c802bc03d82; no voters:
I20260808 02:36:04.129331 22878 leader_election.cc:288] T 00000000000000000000000000000000 P 8ab9d894f2c140f58b793c802bc03d82 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:36:04.129495 22883 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ab9d894f2c140f58b793c802bc03d82 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:36:04.130203 22883 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ab9d894f2c140f58b793c802bc03d82 [term 1 LEADER]: Becoming Leader. State: Replica: 8ab9d894f2c140f58b793c802bc03d82, State: Running, Role: LEADER
I20260808 02:36:04.130703 22883 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ab9d894f2c140f58b793c802bc03d82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ab9d894f2c140f58b793c802bc03d82" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42975 } }
I20260808 02:36:04.131433 22878 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ab9d894f2c140f58b793c802bc03d82 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:36:04.133757 22886 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ab9d894f2c140f58b793c802bc03d82 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ab9d894f2c140f58b793c802bc03d82. Latest consensus state: current_term: 1 leader_uuid: "8ab9d894f2c140f58b793c802bc03d82" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ab9d894f2c140f58b793c802bc03d82" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42975 } } }
I20260808 02:36:04.134228 22886 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ab9d894f2c140f58b793c802bc03d82 [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:04.136601 22884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ab9d894f2c140f58b793c802bc03d82 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ab9d894f2c140f58b793c802bc03d82" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ab9d894f2c140f58b793c802bc03d82" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 42975 } } }
I20260808 02:36:04.137319 22884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ab9d894f2c140f58b793c802bc03d82 [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:04.138626 22895 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:36:04.143407 22895 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:36:04.152477 22895 catalog_manager.cc:1347] Generated new cluster ID: 0db2f89660e74adb9bad41bf970fbc43
I20260808 02:36:04.152630 22895 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:36:04.166471 22895 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:36:04.168502 22895 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:36:04.175407 22895 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8ab9d894f2c140f58b793c802bc03d82: Generated new TSK 0
I20260808 02:36:04.176520 22895 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.116.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
Entry for principal kudu/127.24.116.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab.
I20260808 02:36:04.260928 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:42975
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:44957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:36:04.626780 22917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:04.627094 22917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:04.627193 22917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:04.634757 22917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:04.634874 22917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:04.634987 22917 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:36:04.645618 22917 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:44957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.193.keytab
--principal=kudu/127.24.116.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:42975
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:04.647166 22917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:04.648605 22917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:04.662457 22924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:04.662420 22925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:04.662508 22927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:04.663410 22917 server_base.cc:1034] running on GCE node
I20260808 02:36:04.664036 22917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:04.665072 22917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:04.666306 22917 hybrid_clock.cc:648] HybridClock initialized: now 1786156564666241 us; error 49 us; skew 500 ppm
I20260808 02:36:04.666633 22917 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:04 dist-test-slave-45dx krb5kdc[22759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156564, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:04.669885 22917 init.cc:377] Logged in from keytab as kudu/127.24.116.193@KRBTEST.COM (short username kudu)
I20260808 02:36:04.671403 22917 webserver.cc:460] Webserver started at http://127.24.116.193:38653/ using document root <none> and password file <none>
I20260808 02:36:04.672084 22917 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:04.672242 22917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:04.672600 22917 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:04.675590 22917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "11b73cf370a041fb8111062d585b3435"
format_stamp: "Formatted at 2026-08-08 02:36:04 on dist-test-slave-45dx"
server_key: "c3666b932cca46b3836406ed44b33cf5"
server_key_iv: "952e0260ee4d1208b131a311352722b4"
server_key_version: "encryptionkey@0"
I20260808 02:36:04.676555 22917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "11b73cf370a041fb8111062d585b3435"
format_stamp: "Formatted at 2026-08-08 02:36:04 on dist-test-slave-45dx"
server_key: "c3666b932cca46b3836406ed44b33cf5"
server_key_iv: "952e0260ee4d1208b131a311352722b4"
server_key_version: "encryptionkey@0"
I20260808 02:36:04.681692 22917 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 02:36:04.685256 22938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:04.686596 22917 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 02:36:04.686781 22917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "11b73cf370a041fb8111062d585b3435"
format_stamp: "Formatted at 2026-08-08 02:36:04 on dist-test-slave-45dx"
server_key: "c3666b932cca46b3836406ed44b33cf5"
server_key_iv: "952e0260ee4d1208b131a311352722b4"
server_key_version: "encryptionkey@0"
I20260808 02:36:04.686986 22917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:04.709017 22917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:04.713212 22917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:04.713526 22917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:04.714543 22917 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:36:04.715951 22917 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:36:04.716061 22917 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:04.716209 22917 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:36:04.716284 22917 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:04.751710 22917 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:40489
I20260808 02:36:04.751755 23108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:40489 every 8 connection(s)
I20260808 02:36:04.753098 22917 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:36:04.761696 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 22917
I20260808 02:36:04.761919 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:36:04.762369 25043 external_mini_cluster.cc:1428] Setting key e94c41b906e06c99a94e2cc76e9916df
Aug 08 02:36:04 dist-test-slave-45dx krb5kdc[22759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156564, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.193@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:36:04.775456 23111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:04.755910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:33643 (local address 127.24.116.254:42975)
0808 02:36:04.756476 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:04.756482 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:04.757423 (+ 941us) server_negotiation.cc:407] Connection header received
0808 02:36:04.759456 (+ 2033us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:04.759464 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:04.759578 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:04.759714 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:04.761469 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:04.762448 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:04.764479 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:04.764935 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:04.765096 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:04.769093 (+ 3997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:04.769098 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:04.769101 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:04.769134 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:04.771720 (+ 2586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:04.772861 (+ 1141us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:04.772866 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:04.772868 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:04.773003 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:04.773507 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:04.773511 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:04.773514 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:04.773815 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:04.773987 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:04.774749 (+ 762us) server_negotiation.cc:299] Negotiation successful
0808 02:36:04.775035 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":282,"threads_started":1}
I20260808 02:36:04.776644 23112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:04.756467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:42975 (local address 127.24.116.193:33643)
0808 02:36:04.757226 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:04.757282 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:04.759156 (+ 1874us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:04.759975 (+ 819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:04.759984 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:04.760641 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:36:04.761264 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:04.761283 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:04.762616 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:04.762627 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:04.764271 (+ 1644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:04.764285 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:04.765194 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:04.765205 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:04.765472 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:04.766330 (+ 858us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:36:04.766354 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:36:04.768849 (+ 2495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:36:04.772055 (+ 3206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:04.772067 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:04.772086 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:04.772674 (+ 588us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:04.773127 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:04.773132 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:04.773136 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:04.773365 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:04.773957 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:36:04.773966 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:36:04.774331 (+ 365us) client_negotiation.cc:769] Sending connection context
0808 02:36:04.774617 (+ 286us) client_negotiation.cc:240] Negotiation successful
0808 02:36:04.775232 (+ 615us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":302,"threads_started":1}
I20260808 02:36:04.778401 23109 heartbeater.cc:347] Connected to a master server at 127.24.116.254:42975
I20260808 02:36:04.778769 23109 heartbeater.cc:464] Registering TS with master...
I20260808 02:36:04.779706 23109 heartbeater.cc:511] Master 127.24.116.254:42975 requested a full tablet report, sending...
I20260808 02:36:04.782043 22821 ts_manager.cc:194] Registered new tserver with Master: 11b73cf370a041fb8111062d585b3435 (127.24.116.193:40489)
I20260808 02:36:04.783524 22821 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.193@KRBTEST.COM'} at 127.24.116.193:33643
WARNING: no policy specified for kudu/127.24.116.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
Entry for principal kudu/127.24.116.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab.
I20260808 02:36:04.839619 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:42975
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:44957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:36:05.187717 23115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:05.187988 23115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:05.188082 23115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:05.195544 23115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:05.195658 23115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:05.195772 23115 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:36:05.205731 23115 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:44957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.194.keytab
--principal=kudu/127.24.116.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:42975
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:05.207027 23115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:05.208411 23115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:05.221684 23122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:05.221717 23125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:05.221812 23123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:05.222595 23115 server_base.cc:1034] running on GCE node
I20260808 02:36:05.223202 23115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:05.224107 23115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:05.225310 23115 hybrid_clock.cc:648] HybridClock initialized: now 1786156565225262 us; error 34 us; skew 500 ppm
I20260808 02:36:05.225641 23115 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:05 dist-test-slave-45dx krb5kdc[22759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156565, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:05.228788 23115 init.cc:377] Logged in from keytab as kudu/127.24.116.194@KRBTEST.COM (short username kudu)
I20260808 02:36:05.230223 23115 webserver.cc:460] Webserver started at http://127.24.116.194:43863/ using document root <none> and password file <none>
I20260808 02:36:05.230952 23115 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:05.231127 23115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:05.231459 23115 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:05.234496 23115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "df4500c2a7fb4a5ea4e67c9a0163a181"
format_stamp: "Formatted at 2026-08-08 02:36:05 on dist-test-slave-45dx"
server_key: "aeb2e7fefe135ac5891f521e92d37aad"
server_key_iv: "576e3efedfceba53a10f7168cf720740"
server_key_version: "encryptionkey@0"
I20260808 02:36:05.235267 23115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "df4500c2a7fb4a5ea4e67c9a0163a181"
format_stamp: "Formatted at 2026-08-08 02:36:05 on dist-test-slave-45dx"
server_key: "aeb2e7fefe135ac5891f521e92d37aad"
server_key_iv: "576e3efedfceba53a10f7168cf720740"
server_key_version: "encryptionkey@0"
I20260808 02:36:05.240662 23115 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260808 02:36:05.244081 23134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:05.245519 23115 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:36:05.245700 23115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "df4500c2a7fb4a5ea4e67c9a0163a181"
format_stamp: "Formatted at 2026-08-08 02:36:05 on dist-test-slave-45dx"
server_key: "aeb2e7fefe135ac5891f521e92d37aad"
server_key_iv: "576e3efedfceba53a10f7168cf720740"
server_key_version: "encryptionkey@0"
I20260808 02:36:05.245914 23115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:05.261050 23115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:05.265337 23115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:05.265589 23115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:05.266546 23115 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:36:05.267839 23115 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:36:05.267915 23115 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:05.267999 23115 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:36:05.268049 23115 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:05.303301 23115 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:41231
I20260808 02:36:05.303437 23315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:41231 every 8 connection(s)
I20260808 02:36:05.304828 23115 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:36:05.313879 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 23115
I20260808 02:36:05.314073 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:36:05.314553 25043 external_mini_cluster.cc:1428] Setting key 8498cdd4d43970efa3357834b8f95087
Aug 08 02:36:05 dist-test-slave-45dx krb5kdc[22759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156565, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.194@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:36:05.327596 23321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:05.307586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:34947 (local address 127.24.116.254:42975)
0808 02:36:05.308089 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:05.308096 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:05.309103 (+ 1007us) server_negotiation.cc:407] Connection header received
0808 02:36:05.310897 (+ 1794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:05.310901 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:05.310970 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:05.311069 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:05.312646 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:05.313388 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:05.315161 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:05.315763 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:05.315872 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:05.320187 (+ 4315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:05.320196 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:05.320203 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:05.320250 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:05.323948 (+ 3698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:05.324782 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:05.324790 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:05.324795 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:05.324971 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:05.325431 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:05.325439 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:05.325444 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:05.325854 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:05.326028 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:05.326772 (+ 744us) server_negotiation.cc:299] Negotiation successful
0808 02:36:05.327085 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":240,"threads_started":1}
I20260808 02:36:05.328397 23322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:05.308127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:42975 (local address 127.24.116.194:34947)
0808 02:36:05.308930 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:05.308976 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:05.310647 (+ 1671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:05.311268 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:05.311275 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:05.311802 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:36:05.312474 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:05.312494 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:05.313556 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:05.313560 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:05.314985 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:05.314998 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:05.316004 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:05.316011 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:05.316276 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:05.317115 (+ 839us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:36:05.317145 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:36:05.319939 (+ 2794us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:36:05.324103 (+ 4164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:05.324111 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:05.324126 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:05.324642 (+ 516us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:05.325088 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:05.325092 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:05.325094 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:05.325293 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:05.325993 (+ 700us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:36:05.325999 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:36:05.326375 (+ 376us) client_negotiation.cc:769] Sending connection context
0808 02:36:05.326616 (+ 241us) client_negotiation.cc:240] Negotiation successful
0808 02:36:05.327078 (+ 462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":350,"threads_started":1}
I20260808 02:36:05.330080 23318 heartbeater.cc:347] Connected to a master server at 127.24.116.254:42975
I20260808 02:36:05.330467 23318 heartbeater.cc:464] Registering TS with master...
I20260808 02:36:05.331453 23318 heartbeater.cc:511] Master 127.24.116.254:42975 requested a full tablet report, sending...
I20260808 02:36:05.333299 22821 ts_manager.cc:194] Registered new tserver with Master: df4500c2a7fb4a5ea4e67c9a0163a181 (127.24.116.194:41231)
I20260808 02:36:05.334638 22821 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.194@KRBTEST.COM'} at 127.24.116.194:34947
WARNING: no policy specified for kudu/127.24.116.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
Entry for principal kudu/127.24.116.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab.
I20260808 02:36:05.393903 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:42975
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:44957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:36:05.747802 23325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:05.748061 23325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:05.748155 23325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:05.758102 23325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:05.758211 23325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:05.758328 23325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:36:05.768054 23325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:44957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.195.keytab
--principal=kudu/127.24.116.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:42975
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:05.769344 23325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:05.770673 23325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:05.784422 23334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:05.784454 23337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:05.784207 23335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:05.785499 23325 server_base.cc:1034] running on GCE node
I20260808 02:36:05.786164 23325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:05.786748 23109 heartbeater.cc:503] Master 127.24.116.254:42975 was elected leader, sending a full tablet report...
I20260808 02:36:05.787454 23325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:05.788703 23325 hybrid_clock.cc:648] HybridClock initialized: now 1786156565788650 us; error 38 us; skew 500 ppm
I20260808 02:36:05.789067 23325 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:05 dist-test-slave-45dx krb5kdc[22759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156565, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:05.793404 23325 init.cc:377] Logged in from keytab as kudu/127.24.116.195@KRBTEST.COM (short username kudu)
I20260808 02:36:05.794926 23325 webserver.cc:460] Webserver started at http://127.24.116.195:45267/ using document root <none> and password file <none>
I20260808 02:36:05.795647 23325 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:05.795802 23325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:05.796145 23325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:05.799247 23325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "fc6871dfa9194f18b89786e92d6975d1"
format_stamp: "Formatted at 2026-08-08 02:36:05 on dist-test-slave-45dx"
server_key: "f6741f53262c56cd5409b1502336506e"
server_key_iv: "8e9ffd43957abd4a1c752d20e7fbf47b"
server_key_version: "encryptionkey@0"
I20260808 02:36:05.800052 23325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "fc6871dfa9194f18b89786e92d6975d1"
format_stamp: "Formatted at 2026-08-08 02:36:05 on dist-test-slave-45dx"
server_key: "f6741f53262c56cd5409b1502336506e"
server_key_iv: "8e9ffd43957abd4a1c752d20e7fbf47b"
server_key_version: "encryptionkey@0"
I20260808 02:36:05.805389 23325 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 02:36:05.809260 23345 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:05.810562 23325 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 02:36:05.810736 23325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "fc6871dfa9194f18b89786e92d6975d1"
format_stamp: "Formatted at 2026-08-08 02:36:05 on dist-test-slave-45dx"
server_key: "f6741f53262c56cd5409b1502336506e"
server_key_iv: "8e9ffd43957abd4a1c752d20e7fbf47b"
server_key_version: "encryptionkey@0"
I20260808 02:36:05.810950 23325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:05.826745 23325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:05.830811 23325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:05.831113 23325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:05.832159 23325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:36:05.833611 23325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:36:05.833725 23325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:05.833882 23325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:36:05.833972 23325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:05.869040 23325 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:44601
I20260808 02:36:05.869089 23511 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:44601 every 8 connection(s)
I20260808 02:36:05.870419 23325 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:36:05.879175 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 23325
I20260808 02:36:05.879415 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:36:05.879894 25043 external_mini_cluster.cc:1428] Setting key dc5e35790c067ce77e239b7a091c7a44
Aug 08 02:36:05 dist-test-slave-45dx krb5kdc[22759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156565, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.195@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:36:05.891031 23515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:05.873263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:37903 (local address 127.24.116.254:42975)
0808 02:36:05.873710 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:05.873715 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:05.874697 (+ 982us) server_negotiation.cc:407] Connection header received
0808 02:36:05.876673 (+ 1976us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:05.876679 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:05.876771 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:05.876899 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:05.878449 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:05.879248 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:05.881122 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:05.881552 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:05.881691 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:05.885265 (+ 3574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:05.885270 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:05.885274 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:05.885307 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:05.887758 (+ 2451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:05.888568 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:05.888576 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:05.888584 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:05.888703 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:05.889154 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:05.889158 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:05.889161 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:05.889430 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:05.889605 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:05.890362 (+ 757us) server_negotiation.cc:299] Negotiation successful
0808 02:36:05.890600 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":214,"threads_started":1}
I20260808 02:36:05.891978 23516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:05.873781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:42975 (local address 127.24.116.195:37903)
0808 02:36:05.874519 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:05.874567 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:05.876368 (+ 1801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:05.877151 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:05.877160 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:05.877678 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:36:05.878256 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:05.878273 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:05.879420 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:05.879431 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:05.880975 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:05.880988 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:05.881803 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:05.881812 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:05.882079 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:05.882787 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:36:05.882810 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:36:05.885043 (+ 2233us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:36:05.887930 (+ 2887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:05.887939 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:05.887960 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:05.888444 (+ 484us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:05.888816 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:05.888821 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:05.888825 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:05.889023 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:05.889572 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:36:05.889580 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:36:05.889995 (+ 415us) client_negotiation.cc:769] Sending connection context
0808 02:36:05.890260 (+ 265us) client_negotiation.cc:240] Negotiation successful
0808 02:36:05.890806 (+ 546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":280,"threads_started":1}
I20260808 02:36:05.893527 23512 heartbeater.cc:347] Connected to a master server at 127.24.116.254:42975
I20260808 02:36:05.893826 23512 heartbeater.cc:464] Registering TS with master...
I20260808 02:36:05.894563 23512 heartbeater.cc:511] Master 127.24.116.254:42975 requested a full tablet report, sending...
I20260808 02:36:05.895977 22821 ts_manager.cc:194] Registered new tserver with Master: fc6871dfa9194f18b89786e92d6975d1 (127.24.116.195:44601)
I20260808 02:36:05.896881 22821 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.116.195@KRBTEST.COM'} at 127.24.116.195:37903
I20260808 02:36:05.907521 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:36:05.925787 23515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:05.912127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52114 (local address 127.24.116.254:42975)
0808 02:36:05.912382 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:05.912387 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:05.912861 (+ 474us) server_negotiation.cc:407] Connection header received
0808 02:36:05.912984 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:05.912988 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:05.913061 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:05.913158 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:05.914881 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:05.915730 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:05.917231 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:05.917636 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:05.917735 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:05.920439 (+ 2704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:05.920444 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:05.920447 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:05.920480 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:05.923181 (+ 2701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:05.923892 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:05.923896 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:05.923898 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:05.924023 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:05.924413 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:05.924417 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:05.924419 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:05.924770 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:05.924958 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:05.925322 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 02:36:05.925509 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 02:36:05.930006 22821 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52114:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:36:05.937860 22821 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:36:05.973552 23533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:05.951363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:41231 (local address 127.0.0.1:44444)
0808 02:36:05.964461 (+ 13098us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:05.964577 (+ 116us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:05.964928 (+ 351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:05.966201 (+ 1273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:05.966221 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:05.966263 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:36:05.966758 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:05.966773 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:05.968867 (+ 2094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:05.968874 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:05.970783 (+ 1909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:05.970798 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:05.972162 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:05.972169 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:05.972540 (+ 371us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:05.972612 (+ 72us) client_negotiation.cc:769] Sending connection context
0808 02:36:05.972786 (+ 174us) client_negotiation.cc:240] Negotiation successful
0808 02:36:05.973023 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12750,"mutex_wait_us":57,"spinlock_wait_cycles":9984,"thread_start_us":12595,"threads_started":1}
I20260808 02:36:05.974625 23534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:05.951407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44444 (local address 127.24.116.194:41231)
0808 02:36:05.963589 (+ 12182us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:05.963599 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:05.964728 (+ 1129us) server_negotiation.cc:407] Connection header received
0808 02:36:05.965233 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:05.965259 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:05.965586 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:05.965781 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:36:05.966952 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:05.968722 (+ 1770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:05.970974 (+ 2252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:05.971941 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:05.972119 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:05.972393 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:05.974064 (+ 1671us) server_negotiation.cc:299] Negotiation successful
0808 02:36:05.974264 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11967,"thread_start_us":12195,"threads_started":1}
I20260808 02:36:05.975180 23539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:05.953656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55348 (local address 127.24.116.193:40489)
0808 02:36:05.965413 (+ 11757us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:05.965426 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:05.966540 (+ 1114us) server_negotiation.cc:407] Connection header received
0808 02:36:05.966738 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:05.966756 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:05.966979 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:05.967645 (+ 666us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:36:05.968496 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:05.970104 (+ 1608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:05.972169 (+ 2065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:05.974040 (+ 1871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:05.974279 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:05.974447 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:05.974691 (+ 244us) server_negotiation.cc:299] Negotiation successful
0808 02:36:05.974849 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11548,"thread_start_us":11364,"threads_started":1}
I20260808 02:36:05.975220 23536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:05.952044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:40489 (local address 127.0.0.1:55348)
0808 02:36:05.966379 (+ 14335us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:05.966403 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:05.966533 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:05.967443 (+ 910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:05.967449 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:05.967480 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:36:05.968203 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:05.968219 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:05.970290 (+ 2071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:05.970296 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:05.971954 (+ 1658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:05.971967 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:05.974287 (+ 2320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:05.974294 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:05.974507 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:05.974540 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 02:36:05.974642 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 02:36:05.974777 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14185,"mutex_wait_us":1,"thread_start_us":12125,"threads_started":1}
I20260808 02:36:05.977742 23537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:05.951580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:44601 (local address 127.0.0.1:35086)
0808 02:36:05.964461 (+ 12881us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:05.966158 (+ 1697us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:05.966316 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:05.967114 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:05.967122 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:05.967153 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:36:05.968119 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:05.968135 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:05.972167 (+ 4032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:05.972172 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:05.974697 (+ 2525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:05.974716 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:05.976924 (+ 2208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:05.976933 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:05.977107 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:05.977149 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 02:36:05.977261 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 02:36:05.977390 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12758,"mutex_wait_us":30,"thread_start_us":14473,"threads_started":1}
I20260808 02:36:05.977885 23538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:05.952938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35086 (local address 127.24.116.195:44601)
0808 02:36:05.966060 (+ 13122us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:05.966071 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:05.966505 (+ 434us) server_negotiation.cc:407] Connection header received
0808 02:36:05.966631 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:05.966641 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:05.966885 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:05.967117 (+ 232us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:36:05.968405 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:05.970104 (+ 1699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:05.974917 (+ 4813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:05.976698 (+ 1781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:05.976921 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:05.977117 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:05.977320 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 02:36:05.977514 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12914,"thread_start_us":12712,"threads_started":1}
I20260808 02:36:05.979302 23213 tablet_service.cc:1467] Processing CreateTablet for tablet f515b0d6b59d4ae69e60627c090d0e59 (DEFAULT_TABLE table=test-table [id=86e7cdccb8b44cc6b3b7348b964a23fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:36:05.979470 23006 tablet_service.cc:1467] Processing CreateTablet for tablet f515b0d6b59d4ae69e60627c090d0e59 (DEFAULT_TABLE table=test-table [id=86e7cdccb8b44cc6b3b7348b964a23fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:36:05.980623 23213 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f515b0d6b59d4ae69e60627c090d0e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:05.981020 23006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f515b0d6b59d4ae69e60627c090d0e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:05.988328 23420 tablet_service.cc:1467] Processing CreateTablet for tablet f515b0d6b59d4ae69e60627c090d0e59 (DEFAULT_TABLE table=test-table [id=86e7cdccb8b44cc6b3b7348b964a23fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:36:05.989946 23420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f515b0d6b59d4ae69e60627c090d0e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:05.993917 23540 tablet_bootstrap.cc:492] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435: Bootstrap starting.
I20260808 02:36:05.997159 23541 tablet_bootstrap.cc:492] T f515b0d6b59d4ae69e60627c090d0e59 P df4500c2a7fb4a5ea4e67c9a0163a181: Bootstrap starting.
I20260808 02:36:05.999373 23540 tablet_bootstrap.cc:654] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:06.000900 23540 log.cc:824] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:06.001123 23541 tablet_bootstrap.cc:654] T f515b0d6b59d4ae69e60627c090d0e59 P df4500c2a7fb4a5ea4e67c9a0163a181: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:06.002353 23541 log.cc:824] T f515b0d6b59d4ae69e60627c090d0e59 P df4500c2a7fb4a5ea4e67c9a0163a181: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:06.004556 23540 tablet_bootstrap.cc:492] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435: No bootstrap required, opened a new log
I20260808 02:36:06.004684 23546 tablet_bootstrap.cc:492] T f515b0d6b59d4ae69e60627c090d0e59 P fc6871dfa9194f18b89786e92d6975d1: Bootstrap starting.
I20260808 02:36:06.004940 23540 ts_tablet_manager.cc:1397] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260808 02:36:06.005779 23541 tablet_bootstrap.cc:492] T f515b0d6b59d4ae69e60627c090d0e59 P df4500c2a7fb4a5ea4e67c9a0163a181: No bootstrap required, opened a new log
I20260808 02:36:06.006064 23541 ts_tablet_manager.cc:1397] T f515b0d6b59d4ae69e60627c090d0e59 P df4500c2a7fb4a5ea4e67c9a0163a181: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260808 02:36:06.007653 23546 tablet_bootstrap.cc:654] T f515b0d6b59d4ae69e60627c090d0e59 P fc6871dfa9194f18b89786e92d6975d1: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:06.008776 23546 log.cc:824] T f515b0d6b59d4ae69e60627c090d0e59 P fc6871dfa9194f18b89786e92d6975d1: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:06.011946 23546 tablet_bootstrap.cc:492] T f515b0d6b59d4ae69e60627c090d0e59 P fc6871dfa9194f18b89786e92d6975d1: No bootstrap required, opened a new log
I20260808 02:36:06.012248 23546 ts_tablet_manager.cc:1397] T f515b0d6b59d4ae69e60627c090d0e59 P fc6871dfa9194f18b89786e92d6975d1: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260808 02:36:06.015358 23540 raft_consensus.cc:348] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4500c2a7fb4a5ea4e67c9a0163a181" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 41231 } } peers { permanent_uuid: "fc6871dfa9194f18b89786e92d6975d1" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 44601 } } peers { permanent_uuid: "11b73cf370a041fb8111062d585b3435" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40489 } }
I20260808 02:36:06.015849 23540 raft_consensus.cc:374] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:06.015969 23540 raft_consensus.cc:729] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11b73cf370a041fb8111062d585b3435, State: Initialized, Role: FOLLOWER
I20260808 02:36:06.016693 23540 consensus_queue.cc:260] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4500c2a7fb4a5ea4e67c9a0163a181" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 41231 } } peers { permanent_uuid: "fc6871dfa9194f18b89786e92d6975d1" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 44601 } } peers { permanent_uuid: "11b73cf370a041fb8111062d585b3435" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40489 } }
I20260808 02:36:06.018203 23541 raft_consensus.cc:348] T f515b0d6b59d4ae69e60627c090d0e59 P df4500c2a7fb4a5ea4e67c9a0163a181 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4500c2a7fb4a5ea4e67c9a0163a181" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 41231 } } peers { permanent_uuid: "fc6871dfa9194f18b89786e92d6975d1" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 44601 } } peers { permanent_uuid: "11b73cf370a041fb8111062d585b3435" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40489 } }
I20260808 02:36:06.018719 23541 raft_consensus.cc:374] T f515b0d6b59d4ae69e60627c090d0e59 P df4500c2a7fb4a5ea4e67c9a0163a181 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:06.018859 23541 raft_consensus.cc:729] T f515b0d6b59d4ae69e60627c090d0e59 P df4500c2a7fb4a5ea4e67c9a0163a181 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4500c2a7fb4a5ea4e67c9a0163a181, State: Initialized, Role: FOLLOWER
I20260808 02:36:06.018989 23540 ts_tablet_manager.cc:1428] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20260808 02:36:06.019635 23541 consensus_queue.cc:260] T f515b0d6b59d4ae69e60627c090d0e59 P df4500c2a7fb4a5ea4e67c9a0163a181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4500c2a7fb4a5ea4e67c9a0163a181" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 41231 } } peers { permanent_uuid: "fc6871dfa9194f18b89786e92d6975d1" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 44601 } } peers { permanent_uuid: "11b73cf370a041fb8111062d585b3435" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40489 } }
I20260808 02:36:06.020943 23318 heartbeater.cc:503] Master 127.24.116.254:42975 was elected leader, sending a full tablet report...
I20260808 02:36:06.021466 23541 ts_tablet_manager.cc:1428] T f515b0d6b59d4ae69e60627c090d0e59 P df4500c2a7fb4a5ea4e67c9a0163a181: Time spent starting tablet: real 0.015s user 0.013s sys 0.001s
I20260808 02:36:06.023913 23546 raft_consensus.cc:348] T f515b0d6b59d4ae69e60627c090d0e59 P fc6871dfa9194f18b89786e92d6975d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4500c2a7fb4a5ea4e67c9a0163a181" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 41231 } } peers { permanent_uuid: "fc6871dfa9194f18b89786e92d6975d1" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 44601 } } peers { permanent_uuid: "11b73cf370a041fb8111062d585b3435" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40489 } }
I20260808 02:36:06.024452 23546 raft_consensus.cc:374] T f515b0d6b59d4ae69e60627c090d0e59 P fc6871dfa9194f18b89786e92d6975d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:06.024570 23546 raft_consensus.cc:729] T f515b0d6b59d4ae69e60627c090d0e59 P fc6871dfa9194f18b89786e92d6975d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6871dfa9194f18b89786e92d6975d1, State: Initialized, Role: FOLLOWER
I20260808 02:36:06.025027 23548 raft_consensus.cc:482] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:36:06.025207 23546 consensus_queue.cc:260] T f515b0d6b59d4ae69e60627c090d0e59 P fc6871dfa9194f18b89786e92d6975d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4500c2a7fb4a5ea4e67c9a0163a181" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 41231 } } peers { permanent_uuid: "fc6871dfa9194f18b89786e92d6975d1" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 44601 } } peers { permanent_uuid: "11b73cf370a041fb8111062d585b3435" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40489 } }
I20260808 02:36:06.025327 23548 raft_consensus.cc:504] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4500c2a7fb4a5ea4e67c9a0163a181" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 41231 } } peers { permanent_uuid: "fc6871dfa9194f18b89786e92d6975d1" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 44601 } } peers { permanent_uuid: "11b73cf370a041fb8111062d585b3435" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40489 } }
I20260808 02:36:06.027266 23512 heartbeater.cc:503] Master 127.24.116.254:42975 was elected leader, sending a full tablet report...
I20260808 02:36:06.027550 23546 ts_tablet_manager.cc:1428] T f515b0d6b59d4ae69e60627c090d0e59 P fc6871dfa9194f18b89786e92d6975d1: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260808 02:36:06.027571 23548 leader_election.cc:288] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df4500c2a7fb4a5ea4e67c9a0163a181 (127.24.116.194:41231), fc6871dfa9194f18b89786e92d6975d1 (127.24.116.195:44601)
I20260808 02:36:06.038494 23534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:06.028496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:58471 (local address 127.24.116.194:41231)
0808 02:36:06.028676 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:06.028680 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:06.031134 (+ 2454us) server_negotiation.cc:407] Connection header received
0808 02:36:06.031228 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:06.031235 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:06.031340 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:06.031440 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:36:06.032374 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:06.033319 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:06.035846 (+ 2527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:06.037334 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:06.037520 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:06.037618 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:06.037979 (+ 361us) server_negotiation.cc:299] Negotiation successful
0808 02:36:06.038147 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 02:36:06.038486 23538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:06.028437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:39017 (local address 127.24.116.195:44601)
0808 02:36:06.028645 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:06.028653 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:06.031763 (+ 3110us) server_negotiation.cc:407] Connection header received
0808 02:36:06.032035 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:06.032042 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:06.032137 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:06.032247 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:36:06.032904 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:06.033749 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:06.036057 (+ 2308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:06.037479 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:06.037636 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:06.037708 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:06.038066 (+ 358us) server_negotiation.cc:299] Negotiation successful
0808 02:36:06.038198 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 02:36:06.038661 23552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:06.027974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:41231 (local address 127.24.116.193:58471)
0808 02:36:06.030934 (+ 2960us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:06.030956 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:06.031107 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:06.031626 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:06.031631 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:06.031662 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:36:06.032144 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:06.032156 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:06.033460 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:06.033464 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:06.035664 (+ 2200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:06.035678 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:06.037561 (+ 1883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:06.037567 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:06.037767 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:06.037805 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 02:36:06.037906 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 02:36:06.038057 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2801,"mutex_wait_us":1,"thread_start_us":2601,"threads_started":1}
I20260808 02:36:06.038980 23553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:06.028156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:44601 (local address 127.24.116.193:39017)
0808 02:36:06.031634 (+ 3478us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:06.031657 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:06.031848 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:06.032281 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:06.032288 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:06.032339 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:36:06.032705 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:06.032717 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:06.033899 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:06.033904 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:06.035908 (+ 2004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:06.035918 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:06.037689 (+ 1771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:06.037696 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:06.037849 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:06.037892 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 02:36:06.038014 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 02:36:06.038111 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3351,"mutex_wait_us":1,"thread_start_us":3183,"threads_started":1}
I20260808 02:36:06.040066 23246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f515b0d6b59d4ae69e60627c090d0e59" candidate_uuid: "11b73cf370a041fb8111062d585b3435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4500c2a7fb4a5ea4e67c9a0163a181" is_pre_election: true
I20260808 02:36:06.040503 23443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f515b0d6b59d4ae69e60627c090d0e59" candidate_uuid: "11b73cf370a041fb8111062d585b3435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6871dfa9194f18b89786e92d6975d1" is_pre_election: true
I20260808 02:36:06.040674 23246 raft_consensus.cc:2454] T f515b0d6b59d4ae69e60627c090d0e59 P df4500c2a7fb4a5ea4e67c9a0163a181 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11b73cf370a041fb8111062d585b3435 in term 0.
I20260808 02:36:06.041043 23443 raft_consensus.cc:2454] T f515b0d6b59d4ae69e60627c090d0e59 P fc6871dfa9194f18b89786e92d6975d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11b73cf370a041fb8111062d585b3435 in term 0.
I20260808 02:36:06.041402 22942 leader_election.cc:302] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b73cf370a041fb8111062d585b3435, df4500c2a7fb4a5ea4e67c9a0163a181; no voters:
I20260808 02:36:06.041844 23548 raft_consensus.cc:2781] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:36:06.041981 23548 raft_consensus.cc:482] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:36:06.042073 23548 raft_consensus.cc:3037] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:06.044551 23548 raft_consensus.cc:504] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4500c2a7fb4a5ea4e67c9a0163a181" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 41231 } } peers { permanent_uuid: "fc6871dfa9194f18b89786e92d6975d1" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 44601 } } peers { permanent_uuid: "11b73cf370a041fb8111062d585b3435" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40489 } }
I20260808 02:36:06.045271 23548 leader_election.cc:288] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435 [CANDIDATE]: Term 1 election: Requested vote from peers df4500c2a7fb4a5ea4e67c9a0163a181 (127.24.116.194:41231), fc6871dfa9194f18b89786e92d6975d1 (127.24.116.195:44601)
I20260808 02:36:06.045774 23246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f515b0d6b59d4ae69e60627c090d0e59" candidate_uuid: "11b73cf370a041fb8111062d585b3435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4500c2a7fb4a5ea4e67c9a0163a181"
I20260808 02:36:06.045827 23443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f515b0d6b59d4ae69e60627c090d0e59" candidate_uuid: "11b73cf370a041fb8111062d585b3435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6871dfa9194f18b89786e92d6975d1"
I20260808 02:36:06.046015 23246 raft_consensus.cc:3037] T f515b0d6b59d4ae69e60627c090d0e59 P df4500c2a7fb4a5ea4e67c9a0163a181 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:06.046087 23443 raft_consensus.cc:3037] T f515b0d6b59d4ae69e60627c090d0e59 P fc6871dfa9194f18b89786e92d6975d1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:06.048612 23246 raft_consensus.cc:2454] T f515b0d6b59d4ae69e60627c090d0e59 P df4500c2a7fb4a5ea4e67c9a0163a181 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11b73cf370a041fb8111062d585b3435 in term 1.
I20260808 02:36:06.048870 23443 raft_consensus.cc:2454] T f515b0d6b59d4ae69e60627c090d0e59 P fc6871dfa9194f18b89786e92d6975d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11b73cf370a041fb8111062d585b3435 in term 1.
I20260808 02:36:06.049127 22942 leader_election.cc:302] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b73cf370a041fb8111062d585b3435, df4500c2a7fb4a5ea4e67c9a0163a181; no voters:
I20260808 02:36:06.049471 23548 raft_consensus.cc:2781] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:36:06.049989 23548 raft_consensus.cc:686] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435 [term 1 LEADER]: Becoming Leader. State: Replica: 11b73cf370a041fb8111062d585b3435, State: Running, Role: LEADER
I20260808 02:36:06.050558 23548 consensus_queue.cc:237] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4500c2a7fb4a5ea4e67c9a0163a181" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 41231 } } peers { permanent_uuid: "fc6871dfa9194f18b89786e92d6975d1" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 44601 } } peers { permanent_uuid: "11b73cf370a041fb8111062d585b3435" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40489 } }
I20260808 02:36:06.056119 22819 catalog_manager.cc:5495] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11b73cf370a041fb8111062d585b3435 (127.24.116.193). New cstate: current_term: 1 leader_uuid: "11b73cf370a041fb8111062d585b3435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4500c2a7fb4a5ea4e67c9a0163a181" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 41231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc6871dfa9194f18b89786e92d6975d1" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 44601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11b73cf370a041fb8111062d585b3435" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 40489 } health_report { overall_health: HEALTHY } } }
W20260808 02:36:06.057054 23320 tablet.cc:2369] T f515b0d6b59d4ae69e60627c090d0e59 P df4500c2a7fb4a5ea4e67c9a0163a181: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:36:06.098735 23539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:06.092059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55360 (local address 127.24.116.193:40489)
0808 02:36:06.092297 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:06.092353 (+ 56us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:06.092377 (+ 24us) server_negotiation.cc:407] Connection header received
0808 02:36:06.092568 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:06.092572 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:06.092659 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:06.092803 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:36:06.093308 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:06.094186 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:06.096269 (+ 2083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:06.096875 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:06.096986 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:06.097545 (+ 559us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:36:06.098116 (+ 571us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:36:06.098228 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:06.098357 (+ 129us) server_negotiation.cc:299] Negotiation successful
0808 02:36:06.098431 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 02:36:06.108016 23246 raft_consensus.cc:1261] T f515b0d6b59d4ae69e60627c090d0e59 P df4500c2a7fb4a5ea4e67c9a0163a181 [term 1 FOLLOWER]: Refusing update from remote peer 11b73cf370a041fb8111062d585b3435: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:36:06.108012 23443 raft_consensus.cc:1261] T f515b0d6b59d4ae69e60627c090d0e59 P fc6871dfa9194f18b89786e92d6975d1 [term 1 FOLLOWER]: Refusing update from remote peer 11b73cf370a041fb8111062d585b3435: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:36:06.109218 23554 consensus_queue.cc:1035] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4500c2a7fb4a5ea4e67c9a0163a181" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 41231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:36:06.109622 23548 consensus_queue.cc:1035] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6871dfa9194f18b89786e92d6975d1" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 44601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 02:36:06.122671 23513 tablet.cc:2369] T f515b0d6b59d4ae69e60627c090d0e59 P fc6871dfa9194f18b89786e92d6975d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:36:06.139392 22820 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52114:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:36:06.139750 22820 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52114:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:36:06.143950 22820 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8ab9d894f2c140f58b793c802bc03d82: Sending DeleteTablet for 3 replicas of tablet f515b0d6b59d4ae69e60627c090d0e59
I20260808 02:36:06.145328 23006 tablet_service.cc:1514] Processing DeleteTablet for tablet f515b0d6b59d4ae69e60627c090d0e59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:36:06 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:55348
I20260808 02:36:06.145323 23420 tablet_service.cc:1514] Processing DeleteTablet for tablet f515b0d6b59d4ae69e60627c090d0e59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:36:06 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:35086
I20260808 02:36:06.145336 23213 tablet_service.cc:1514] Processing DeleteTablet for tablet f515b0d6b59d4ae69e60627c090d0e59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:36:06 UTC) from {username='kudu', principal='kudu/127.24.116.254@KRBTEST.COM'} at 127.0.0.1:44444
I20260808 02:36:06.151247 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 22917
I20260808 02:36:06.156927 23571 tablet_replica.cc:330] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435: stopping tablet replica
I20260808 02:36:06.157774 23571 raft_consensus.cc:2229] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:36:06.158740 23577 tablet_replica.cc:330] T f515b0d6b59d4ae69e60627c090d0e59 P fc6871dfa9194f18b89786e92d6975d1: stopping tablet replica
I20260808 02:36:06.159585 23571 raft_consensus.cc:2258] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:36:06.160162 23577 raft_consensus.cc:2229] T f515b0d6b59d4ae69e60627c090d0e59 P fc6871dfa9194f18b89786e92d6975d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:36:06.160760 23577 raft_consensus.cc:2258] T f515b0d6b59d4ae69e60627c090d0e59 P fc6871dfa9194f18b89786e92d6975d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:36:06.161654 23570 tablet_replica.cc:330] T f515b0d6b59d4ae69e60627c090d0e59 P df4500c2a7fb4a5ea4e67c9a0163a181: stopping tablet replica
I20260808 02:36:06.162458 23570 raft_consensus.cc:2229] T f515b0d6b59d4ae69e60627c090d0e59 P df4500c2a7fb4a5ea4e67c9a0163a181 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:36:06.163007 23570 raft_consensus.cc:2258] T f515b0d6b59d4ae69e60627c090d0e59 P df4500c2a7fb4a5ea4e67c9a0163a181 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:36:06.163398 23571 ts_tablet_manager.cc:1905] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:36:06.165350 23577 ts_tablet_manager.cc:1905] T f515b0d6b59d4ae69e60627c090d0e59 P fc6871dfa9194f18b89786e92d6975d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:36:06.165638 23570 ts_tablet_manager.cc:1905] T f515b0d6b59d4ae69e60627c090d0e59 P df4500c2a7fb4a5ea4e67c9a0163a181: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 02:36:06 dist-test-slave-45dx krb5kdc[22759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.193@KRBTEST.COM
I20260808 02:36:06.173601 23570 ts_tablet_manager.cc:1918] T f515b0d6b59d4ae69e60627c090d0e59 P df4500c2a7fb4a5ea4e67c9a0163a181: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:36:06.173895 23570 log.cc:1196] T f515b0d6b59d4ae69e60627c090d0e59 P df4500c2a7fb4a5ea4e67c9a0163a181: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/f515b0d6b59d4ae69e60627c090d0e59
I20260808 02:36:06.174576 23570 ts_tablet_manager.cc:1939] T f515b0d6b59d4ae69e60627c090d0e59 P df4500c2a7fb4a5ea4e67c9a0163a181: Deleting consensus metadata
I20260808 02:36:06.175930 23571 ts_tablet_manager.cc:1918] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:36:06.176143 23571 log.cc:1196] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/f515b0d6b59d4ae69e60627c090d0e59
I20260808 02:36:06.176759 23571 ts_tablet_manager.cc:1939] T f515b0d6b59d4ae69e60627c090d0e59 P 11b73cf370a041fb8111062d585b3435: Deleting consensus metadata
I20260808 02:36:06.176807 22799 catalog_manager.cc:4841] TS df4500c2a7fb4a5ea4e67c9a0163a181 (127.24.116.194:41231): tablet f515b0d6b59d4ae69e60627c090d0e59 (table test-table [id=86e7cdccb8b44cc6b3b7348b964a23fc]) successfully deleted
I20260808 02:36:06.176918 23577 ts_tablet_manager.cc:1918] T f515b0d6b59d4ae69e60627c090d0e59 P fc6871dfa9194f18b89786e92d6975d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:36:06.177078 23577 log.cc:1196] T f515b0d6b59d4ae69e60627c090d0e59 P fc6871dfa9194f18b89786e92d6975d1: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/f515b0d6b59d4ae69e60627c090d0e59
I20260808 02:36:06.177623 23577 ts_tablet_manager.cc:1939] T f515b0d6b59d4ae69e60627c090d0e59 P fc6871dfa9194f18b89786e92d6975d1: Deleting consensus metadata
I20260808 02:36:06.178654 22794 catalog_manager.cc:4841] TS 11b73cf370a041fb8111062d585b3435 (127.24.116.193:40489): tablet f515b0d6b59d4ae69e60627c090d0e59 (table test-table [id=86e7cdccb8b44cc6b3b7348b964a23fc]) successfully deleted
I20260808 02:36:06.179479 22798 catalog_manager.cc:4841] TS fc6871dfa9194f18b89786e92d6975d1 (127.24.116.195:44601): tablet f515b0d6b59d4ae69e60627c090d0e59 (table test-table [id=86e7cdccb8b44cc6b3b7348b964a23fc]) successfully deleted
I20260808 02:36:06.180428 23539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:06.152746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55368 (local address 127.24.116.193:40489)
0808 02:36:06.152983 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:06.152991 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:06.155131 (+ 2140us) server_negotiation.cc:407] Connection header received
0808 02:36:06.155346 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:06.155355 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:06.155468 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:06.155587 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:06.157993 (+ 2406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:06.159251 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:06.162025 (+ 2774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:06.162776 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:06.162920 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:06.168647 (+ 5727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:06.168661 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:06.168678 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:06.168727 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:06.175357 (+ 6630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:06.177518 (+ 2161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:06.177528 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:06.177532 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:06.177784 (+ 252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:06.178528 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:06.178535 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:06.178540 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:06.179030 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:06.179368 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:06.179770 (+ 402us) server_negotiation.cc:299] Negotiation successful
0808 02:36:06.180020 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 02:36:06.181157 23100 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:36:06.283692 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 22917
I20260808 02:36:06.313660 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 23115
Aug 08 02:36:06 dist-test-slave-45dx krb5kdc[22759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.194@KRBTEST.COM
I20260808 02:36:06.330670 23534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:06.314541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44460 (local address 127.24.116.194:41231)
0808 02:36:06.314716 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:06.314722 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:06.314800 (+ 78us) server_negotiation.cc:407] Connection header received
0808 02:36:06.314994 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:06.314999 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:06.315085 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:06.315187 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:06.316704 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:06.317876 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:06.319363 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:06.320004 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:06.320127 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:06.324727 (+ 4600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:06.324740 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:06.324754 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:06.324787 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:06.327706 (+ 2919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:06.328527 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:06.328535 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:06.328537 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:06.328663 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:06.329065 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:06.329068 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:06.329070 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:06.329482 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:06.329716 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:06.330100 (+ 384us) server_negotiation.cc:299] Negotiation successful
0808 02:36:06.330267 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 02:36:06.331387 23304 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:36:06.423642 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 23115
I20260808 02:36:06.451167 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 23325
Aug 08 02:36:06 dist-test-slave-45dx krb5kdc[22759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.195@KRBTEST.COM
I20260808 02:36:06.467031 23538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:06.452147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35096 (local address 127.24.116.195:44601)
0808 02:36:06.452388 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:06.452392 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:06.452415 (+ 23us) server_negotiation.cc:407] Connection header received
0808 02:36:06.452602 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:06.452606 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:06.452672 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:06.452756 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:06.454107 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:06.454850 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:06.456030 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:06.456630 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:06.456727 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:06.461284 (+ 4557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:06.461299 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:06.461317 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:06.461359 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:06.464082 (+ 2723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:06.464885 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:06.464892 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:06.464895 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:06.465039 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:06.465446 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:06.465450 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:06.465452 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:06.465809 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:06.466123 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:06.466480 (+ 357us) server_negotiation.cc:299] Negotiation successful
0808 02:36:06.466716 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 02:36:06.467707 23505 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:36:06.558373 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 23325
I20260808 02:36:06.583267 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 22774
I20260808 02:36:06.584507 22872 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:36:06.697386 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 22774
2026-08-08T02:36:06Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4832 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T02:36:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:36:06Z Disabled control of system clock
I20260808 02:36:06.807164 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:37285
--webserver_interface=127.24.116.254
--webserver_port=0
--builtin_ntp_servers=127.24.116.212:42119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:37285
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 02:36:07.165949 23592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:07.166246 23592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:07.166328 23592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:07.173614 23592 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:36:07.173727 23592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:07.173765 23592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:07.173816 23592 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:36:07.173862 23592 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:36:07.183194 23592 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:42119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:37285
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:37285
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:07.184571 23592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:07.186411 23592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:07.198602 23601 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:07.198712 23605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:07.198743 23602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:07.199774 23592 server_base.cc:1034] running on GCE node
I20260808 02:36:07.200765 23592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:07.202353 23592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:07.203614 23592 hybrid_clock.cc:648] HybridClock initialized: now 1786156567203556 us; error 40 us; skew 500 ppm
I20260808 02:36:07.204047 23592 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:36:07.206652 23592 webserver.cc:460] Webserver started at http://127.24.116.254:38633/ using document root <none> and password file <none>
I20260808 02:36:07.207415 23592 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:07.207559 23592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:07.207912 23592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:07.211186 23592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "2d69a176d4264d7c82f1eb9c3d23a8d5"
format_stamp: "Formatted at 2026-08-08 02:36:07 on dist-test-slave-45dx"
server_key: "8bfefabcedb4b9d652e89fb16adf9143"
server_key_iv: "fa95c56492a610c52b7358e245b83c0c"
server_key_version: "encryptionkey@0"
I20260808 02:36:07.212042 23592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "2d69a176d4264d7c82f1eb9c3d23a8d5"
format_stamp: "Formatted at 2026-08-08 02:36:07 on dist-test-slave-45dx"
server_key: "8bfefabcedb4b9d652e89fb16adf9143"
server_key_iv: "fa95c56492a610c52b7358e245b83c0c"
server_key_version: "encryptionkey@0"
I20260808 02:36:07.217427 23592 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260808 02:36:07.220944 23615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:07.222369 23592 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:36:07.222519 23592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "2d69a176d4264d7c82f1eb9c3d23a8d5"
format_stamp: "Formatted at 2026-08-08 02:36:07 on dist-test-slave-45dx"
server_key: "8bfefabcedb4b9d652e89fb16adf9143"
server_key_iv: "fa95c56492a610c52b7358e245b83c0c"
server_key_version: "encryptionkey@0"
I20260808 02:36:07.222693 23592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:07.257966 23592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:07.258791 23592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:07.259056 23592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:07.289462 23592 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:37285
I20260808 02:36:07.289511 23695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:37285 every 8 connection(s)
I20260808 02:36:07.291471 23592 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:36:07.292949 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 23592
I20260808 02:36:07.293145 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:36:07.293793 25043 external_mini_cluster.cc:1428] Setting key a1d4d096c79e93fc78c2b59b40f5bb69
I20260808 02:36:07.300201 23696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:07.310456 23700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:07.296063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50012 (local address 127.24.116.254:37285)
0808 02:36:07.298359 (+ 2296us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:07.298379 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:07.298423 (+ 44us) server_negotiation.cc:407] Connection header received
0808 02:36:07.300089 (+ 1666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:07.300111 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:07.300639 (+ 528us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:07.301027 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:07.301574 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:07.302921 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:07.305056 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:07.306151 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:07.306371 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:07.307501 (+ 1130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:07.307512 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:07.307530 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:07.308226 (+ 696us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:07.308384 (+ 158us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:07.308411 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:07.308493 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:07.308803 (+ 310us) server_negotiation.cc:299] Negotiation successful
0808 02:36:07.309132 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1879,"thread_start_us":1659,"threads_started":1}
I20260808 02:36:07.314111 23696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d69a176d4264d7c82f1eb9c3d23a8d5: Bootstrap starting.
I20260808 02:36:07.317312 23696 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d69a176d4264d7c82f1eb9c3d23a8d5: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:07.318341 23696 log.cc:824] T 00000000000000000000000000000000 P 2d69a176d4264d7c82f1eb9c3d23a8d5: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:07.321090 23696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d69a176d4264d7c82f1eb9c3d23a8d5: No bootstrap required, opened a new log
I20260808 02:36:07.328991 23696 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2d69a176d4264d7c82f1eb9c3d23a8d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d69a176d4264d7c82f1eb9c3d23a8d5" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 37285 } }
I20260808 02:36:07.329476 23696 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2d69a176d4264d7c82f1eb9c3d23a8d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:07.329653 23696 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2d69a176d4264d7c82f1eb9c3d23a8d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d69a176d4264d7c82f1eb9c3d23a8d5, State: Initialized, Role: FOLLOWER
I20260808 02:36:07.330288 23696 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d69a176d4264d7c82f1eb9c3d23a8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d69a176d4264d7c82f1eb9c3d23a8d5" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 37285 } }
I20260808 02:36:07.330529 23696 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2d69a176d4264d7c82f1eb9c3d23a8d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:36:07.330696 23696 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2d69a176d4264d7c82f1eb9c3d23a8d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:36:07.330883 23696 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2d69a176d4264d7c82f1eb9c3d23a8d5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:07.333237 23696 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2d69a176d4264d7c82f1eb9c3d23a8d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d69a176d4264d7c82f1eb9c3d23a8d5" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 37285 } }
I20260808 02:36:07.333763 23696 leader_election.cc:302] T 00000000000000000000000000000000 P 2d69a176d4264d7c82f1eb9c3d23a8d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2d69a176d4264d7c82f1eb9c3d23a8d5; no voters:
I20260808 02:36:07.334405 23696 leader_election.cc:288] T 00000000000000000000000000000000 P 2d69a176d4264d7c82f1eb9c3d23a8d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:36:07.334589 23702 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2d69a176d4264d7c82f1eb9c3d23a8d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:36:07.335386 23702 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2d69a176d4264d7c82f1eb9c3d23a8d5 [term 1 LEADER]: Becoming Leader. State: Replica: 2d69a176d4264d7c82f1eb9c3d23a8d5, State: Running, Role: LEADER
I20260808 02:36:07.335971 23702 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d69a176d4264d7c82f1eb9c3d23a8d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d69a176d4264d7c82f1eb9c3d23a8d5" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 37285 } }
I20260808 02:36:07.336694 23696 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2d69a176d4264d7c82f1eb9c3d23a8d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:36:07.338891 23704 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d69a176d4264d7c82f1eb9c3d23a8d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d69a176d4264d7c82f1eb9c3d23a8d5. Latest consensus state: current_term: 1 leader_uuid: "2d69a176d4264d7c82f1eb9c3d23a8d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d69a176d4264d7c82f1eb9c3d23a8d5" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 37285 } } }
I20260808 02:36:07.339398 23704 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d69a176d4264d7c82f1eb9c3d23a8d5 [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:07.339481 23703 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d69a176d4264d7c82f1eb9c3d23a8d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2d69a176d4264d7c82f1eb9c3d23a8d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d69a176d4264d7c82f1eb9c3d23a8d5" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 37285 } } }
I20260808 02:36:07.339814 23703 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d69a176d4264d7c82f1eb9c3d23a8d5 [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:07.342000 23710 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:36:07.346746 23710 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:36:07.354776 23710 catalog_manager.cc:1347] Generated new cluster ID: 617fd896f58f48ab98491e4a8da0a486
I20260808 02:36:07.354897 23710 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:36:07.372059 23710 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:36:07.373396 23710 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:36:07.380579 23710 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2d69a176d4264d7c82f1eb9c3d23a8d5: Generated new TSK 0
I20260808 02:36:07.381556 23710 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:36:07.398420 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.193:0
--local_ip_for_outbound_sockets=127.24.116.193
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:37285
--builtin_ntp_servers=127.24.116.212:42119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 02:36:07.803920 23722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:07.804247 23722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:07.804421 23722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:07.812111 23722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:07.812247 23722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:07.812451 23722 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.193
I20260808 02:36:07.822711 23722 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:42119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.116.193
--webserver_port=0
--tserver_master_addrs=127.24.116.254:37285
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.193
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:07.824462 23722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:07.826782 23722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:07.843048 23727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:07.843022 23730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:07.842854 23733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:07.844281 23722 server_base.cc:1034] running on GCE node
I20260808 02:36:07.845089 23722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:07.846047 23722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:07.847280 23722 hybrid_clock.cc:648] HybridClock initialized: now 1786156567847223 us; error 54 us; skew 500 ppm
I20260808 02:36:07.847674 23722 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:36:07.850071 23722 webserver.cc:460] Webserver started at http://127.24.116.193:36673/ using document root <none> and password file <none>
I20260808 02:36:07.850719 23722 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:07.850805 23722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:07.851167 23722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:07.854071 23722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-0/data/instance:
uuid: "6f7ca60a7ec04c9bad73d4806f01d712"
format_stamp: "Formatted at 2026-08-08 02:36:07 on dist-test-slave-45dx"
server_key: "24a520fe3137a828d94c3d32264a7378"
server_key_iv: "2f9ba1787cd5d06992eca48e0203d789"
server_key_version: "encryptionkey@0"
I20260808 02:36:07.854938 23722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance:
uuid: "6f7ca60a7ec04c9bad73d4806f01d712"
format_stamp: "Formatted at 2026-08-08 02:36:07 on dist-test-slave-45dx"
server_key: "24a520fe3137a828d94c3d32264a7378"
server_key_iv: "2f9ba1787cd5d06992eca48e0203d789"
server_key_version: "encryptionkey@0"
I20260808 02:36:07.860381 23722 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 02:36:07.864087 23741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:07.865612 23722 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:36:07.865798 23722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-0/wal
uuid: "6f7ca60a7ec04c9bad73d4806f01d712"
format_stamp: "Formatted at 2026-08-08 02:36:07 on dist-test-slave-45dx"
server_key: "24a520fe3137a828d94c3d32264a7378"
server_key_iv: "2f9ba1787cd5d06992eca48e0203d789"
server_key_version: "encryptionkey@0"
I20260808 02:36:07.866035 23722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:07.878345 23722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:07.879166 23722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:07.879477 23722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:07.880612 23722 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:36:07.882146 23722 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:36:07.882234 23722 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:07.882390 23722 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:36:07.882483 23722 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:07.919787 23722 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.193:41443
I20260808 02:36:07.919828 23920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.193:41443 every 8 connection(s)
I20260808 02:36:07.921268 23722 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-0/data/info.pb
I20260808 02:36:07.926672 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 23722
I20260808 02:36:07.926874 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-0/wal/instance
I20260808 02:36:07.927465 25043 external_mini_cluster.cc:1428] Setting key 0e8f0ad41b1d8202f36617180c605952
I20260808 02:36:07.930910 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.194:0
--local_ip_for_outbound_sockets=127.24.116.194
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:37285
--builtin_ntp_servers=127.24.116.212:42119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 02:36:07.937053 23930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:07.924422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:35215 (local address 127.24.116.254:37285)
0808 02:36:07.925000 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:07.925008 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:07.928391 (+ 3383us) server_negotiation.cc:407] Connection header received
0808 02:36:07.928766 (+ 375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:07.928771 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:07.928863 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:07.929006 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:07.930174 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:07.931508 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:07.934086 (+ 2578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:07.934476 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:07.934578 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:07.936198 (+ 1620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:07.936203 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:07.936206 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:07.936224 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:07.936264 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:07.936276 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:07.936408 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:07.936661 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 02:36:07.936771 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":402,"thread_start_us":258,"threads_started":1}
I20260808 02:36:07.938402 23931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:07.924998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:37285 (local address 127.24.116.193:35215)
0808 02:36:07.926108 (+ 1110us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:07.926155 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:07.928504 (+ 2349us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:07.929270 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:07.929279 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:07.929369 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:36:07.929966 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:07.929990 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:07.931723 (+ 1733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:07.931732 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:07.933914 (+ 2182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:07.933932 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:07.934712 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:07.934722 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:07.935058 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:07.935841 (+ 783us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:36:07.935847 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:36:07.935907 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:36:07.936006 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:36:07.936408 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:36:07.936423 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:36:07.936433 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 02:36:07.936627 (+ 194us) client_negotiation.cc:240] Negotiation successful
0808 02:36:07.937038 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":380,"threads_started":1}
I20260808 02:36:07.939921 23927 heartbeater.cc:347] Connected to a master server at 127.24.116.254:37285
I20260808 02:36:07.940222 23927 heartbeater.cc:464] Registering TS with master...
I20260808 02:36:07.940963 23927 heartbeater.cc:511] Master 127.24.116.254:37285 requested a full tablet report, sending...
I20260808 02:36:07.943044 23636 ts_manager.cc:194] Registered new tserver with Master: 6f7ca60a7ec04c9bad73d4806f01d712 (127.24.116.193:41443)
I20260808 02:36:07.944612 23636 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.116.193:35215
W20260808 02:36:08.283938 23932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:08.284233 23932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:08.284420 23932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:08.291761 23932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:08.291895 23932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:08.292069 23932 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.194
I20260808 02:36:08.301283 23932 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:42119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.116.194
--webserver_port=0
--tserver_master_addrs=127.24.116.254:37285
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.194
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:08.302534 23932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:08.304287 23932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:08.317528 23941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:08.317574 23946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:08.317615 23942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:08.319909 23932 server_base.cc:1034] running on GCE node
I20260808 02:36:08.320649 23932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:08.321659 23932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:08.322886 23932 hybrid_clock.cc:648] HybridClock initialized: now 1786156568322815 us; error 63 us; skew 500 ppm
I20260808 02:36:08.323220 23932 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:36:08.325827 23932 webserver.cc:460] Webserver started at http://127.24.116.194:37319/ using document root <none> and password file <none>
I20260808 02:36:08.326673 23932 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:08.326771 23932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:08.327097 23932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:08.330181 23932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-1/data/instance:
uuid: "cad45f12b5674b4c9c1532711c70f6ea"
format_stamp: "Formatted at 2026-08-08 02:36:08 on dist-test-slave-45dx"
server_key: "9766c8327c86faa6dd742e7d2f8dcdc9"
server_key_iv: "39b64ced0eb3eb485090aa3fc90f87d2"
server_key_version: "encryptionkey@0"
I20260808 02:36:08.331012 23932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance:
uuid: "cad45f12b5674b4c9c1532711c70f6ea"
format_stamp: "Formatted at 2026-08-08 02:36:08 on dist-test-slave-45dx"
server_key: "9766c8327c86faa6dd742e7d2f8dcdc9"
server_key_iv: "39b64ced0eb3eb485090aa3fc90f87d2"
server_key_version: "encryptionkey@0"
I20260808 02:36:08.336370 23932 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 02:36:08.340269 23953 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:08.341760 23932 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 02:36:08.341972 23932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-1/wal
uuid: "cad45f12b5674b4c9c1532711c70f6ea"
format_stamp: "Formatted at 2026-08-08 02:36:08 on dist-test-slave-45dx"
server_key: "9766c8327c86faa6dd742e7d2f8dcdc9"
server_key_iv: "39b64ced0eb3eb485090aa3fc90f87d2"
server_key_version: "encryptionkey@0"
I20260808 02:36:08.342211 23932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:08.360730 23932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:08.361536 23932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:08.361869 23932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:08.362843 23932 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:36:08.364262 23932 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:36:08.364373 23932 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:08.364540 23932 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:36:08.364624 23932 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:08.398715 23932 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.194:45857
I20260808 02:36:08.398793 24129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.194:45857 every 8 connection(s)
I20260808 02:36:08.400092 23932 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-1/data/info.pb
I20260808 02:36:08.406773 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 23932
I20260808 02:36:08.406982 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-1/wal/instance
I20260808 02:36:08.407562 25043 external_mini_cluster.cc:1428] Setting key bd4ce21856acd08cf75e045705a7e7e3
I20260808 02:36:08.410846 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.116.195:0
--local_ip_for_outbound_sockets=127.24.116.195
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:37285
--builtin_ntp_servers=127.24.116.212:42119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 02:36:08.414445 23930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:08.402893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.194:37777 (local address 127.24.116.254:37285)
0808 02:36:08.403089 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:08.403094 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:08.404511 (+ 1417us) server_negotiation.cc:407] Connection header received
0808 02:36:08.406296 (+ 1785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:08.406301 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:08.406378 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:08.406468 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:08.407915 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:08.408849 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:08.411110 (+ 2261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:08.411841 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:08.411960 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:08.413494 (+ 1534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:08.413503 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:08.413510 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:08.413535 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:08.413579 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:08.413598 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:08.413702 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:08.413906 (+ 204us) server_negotiation.cc:299] Negotiation successful
0808 02:36:08.414014 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 02:36:08.415246 24134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:08.403434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:37285 (local address 127.24.116.194:37777)
0808 02:36:08.404357 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:08.404414 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:08.406045 (+ 1631us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:08.406742 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:08.406784 (+ 42us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:08.406904 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:36:08.407709 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:08.407736 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:08.409008 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:08.409013 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:08.410913 (+ 1900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:08.410932 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:08.412141 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:08.412147 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:08.412418 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:08.413152 (+ 734us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:36:08.413154 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:36:08.413194 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:36:08.413275 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:36:08.413705 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:36:08.413714 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:36:08.413720 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 02:36:08.413861 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 02:36:08.414150 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":279,"threads_started":1}
I20260808 02:36:08.416749 24131 heartbeater.cc:347] Connected to a master server at 127.24.116.254:37285
I20260808 02:36:08.417076 24131 heartbeater.cc:464] Registering TS with master...
I20260808 02:36:08.417837 24131 heartbeater.cc:511] Master 127.24.116.254:37285 requested a full tablet report, sending...
I20260808 02:36:08.419294 23636 ts_manager.cc:194] Registered new tserver with Master: cad45f12b5674b4c9c1532711c70f6ea (127.24.116.194:45857)
I20260808 02:36:08.420173 23636 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.116.194:37777
W20260808 02:36:08.760573 24135 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:08.760855 24135 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:08.761020 24135 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:08.768391 24135 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:08.768488 24135 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:08.768676 24135 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.116.195
I20260808 02:36:08.778061 24135 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:42119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.116.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.116.195
--webserver_port=0
--tserver_master_addrs=127.24.116.254:37285
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.116.195
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:08.779484 24135 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:08.781358 24135 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:08.794404 24144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:08.794438 24146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:08.794569 24148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:08.795675 24135 server_base.cc:1034] running on GCE node
I20260808 02:36:08.796406 24135 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:08.797353 24135 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:08.798576 24135 hybrid_clock.cc:648] HybridClock initialized: now 1786156568798532 us; error 33 us; skew 500 ppm
I20260808 02:36:08.798919 24135 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:36:08.801651 24135 webserver.cc:460] Webserver started at http://127.24.116.195:44565/ using document root <none> and password file <none>
I20260808 02:36:08.802693 24135 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:08.802860 24135 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:08.803298 24135 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:08.806641 24135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-2/data/instance:
uuid: "6f2614d475e84d73950e17bec1fd7e0b"
format_stamp: "Formatted at 2026-08-08 02:36:08 on dist-test-slave-45dx"
server_key: "e82d0fc51d66feca226e8cfe8e73d243"
server_key_iv: "366f9453459d707a56c9e4a5977fe64c"
server_key_version: "encryptionkey@0"
I20260808 02:36:08.807422 24135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance:
uuid: "6f2614d475e84d73950e17bec1fd7e0b"
format_stamp: "Formatted at 2026-08-08 02:36:08 on dist-test-slave-45dx"
server_key: "e82d0fc51d66feca226e8cfe8e73d243"
server_key_iv: "366f9453459d707a56c9e4a5977fe64c"
server_key_version: "encryptionkey@0"
I20260808 02:36:08.812810 24135 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 02:36:08.816538 24157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:08.817878 24135 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:36:08.818058 24135 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-2/wal
uuid: "6f2614d475e84d73950e17bec1fd7e0b"
format_stamp: "Formatted at 2026-08-08 02:36:08 on dist-test-slave-45dx"
server_key: "e82d0fc51d66feca226e8cfe8e73d243"
server_key_iv: "366f9453459d707a56c9e4a5977fe64c"
server_key_version: "encryptionkey@0"
I20260808 02:36:08.818286 24135 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:08.847925 24135 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:08.848850 24135 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:08.849193 24135 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:08.850232 24135 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:36:08.851766 24135 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:36:08.851873 24135 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:08.852039 24135 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:36:08.852140 24135 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:08.887204 24135 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.195:39349
I20260808 02:36:08.887306 24332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.195:39349 every 8 connection(s)
I20260808 02:36:08.888669 24135 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-2/data/info.pb
I20260808 02:36:08.896595 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 24135
I20260808 02:36:08.896792 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-2/wal/instance
I20260808 02:36:08.897236 25043 external_mini_cluster.cc:1428] Setting key c20725ef374cd4e00844a6d4a459f869
I20260808 02:36:08.902522 23930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:08.891400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.195:32951 (local address 127.24.116.254:37285)
0808 02:36:08.891591 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:08.891595 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:08.893062 (+ 1467us) server_negotiation.cc:407] Connection header received
0808 02:36:08.894909 (+ 1847us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:08.894914 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:08.894991 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:08.895087 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:08.896165 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:08.897213 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:08.899448 (+ 2235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:08.900040 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:08.900201 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:08.901703 (+ 1502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:08.901708 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:08.901711 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:08.901745 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:08.901796 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:08.901811 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:08.901893 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:08.902158 (+ 265us) server_negotiation.cc:299] Negotiation successful
0808 02:36:08.902258 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 02:36:08.903538 24337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:08.891871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:37285 (local address 127.24.116.195:32951)
0808 02:36:08.892862 (+ 991us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:08.892904 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:08.894582 (+ 1678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:08.895298 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:08.895305 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:08.895392 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:36:08.895995 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:08.896017 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:08.897391 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:08.897396 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:08.899299 (+ 1903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:08.899314 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:08.900281 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:08.900287 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:08.900630 (+ 343us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:08.901356 (+ 726us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:36:08.901359 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:36:08.901406 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:36:08.901487 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:36:08.901926 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:36:08.901938 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:36:08.901948 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 02:36:08.902123 (+ 175us) client_negotiation.cc:240] Negotiation successful
0808 02:36:08.902437 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":368,"threads_started":1}
I20260808 02:36:08.904943 24333 heartbeater.cc:347] Connected to a master server at 127.24.116.254:37285
I20260808 02:36:08.905222 24333 heartbeater.cc:464] Registering TS with master...
I20260808 02:36:08.905951 24333 heartbeater.cc:511] Master 127.24.116.254:37285 requested a full tablet report, sending...
I20260808 02:36:08.907334 23636 ts_manager.cc:194] Registered new tserver with Master: 6f2614d475e84d73950e17bec1fd7e0b (127.24.116.195:39349)
I20260808 02:36:08.908075 23636 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.116.195:32951
I20260808 02:36:08.912792 25043 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:36:08.928224 23930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:08.921546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50022 (local address 127.24.116.254:37285)
0808 02:36:08.921811 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:08.921818 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:08.922303 (+ 485us) server_negotiation.cc:407] Connection header received
0808 02:36:08.922515 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:08.922521 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:08.922596 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:08.922705 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:08.923284 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:08.924390 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:08.925880 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:08.926364 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:08.926460 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:08.927551 (+ 1091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:08.927556 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:08.927559 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:08.927575 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:08.927608 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:08.927620 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:08.927693 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:08.927914 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 02:36:08.927987 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 02:36:08.932112 23636 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50022:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:36:08.939006 23636 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:36:08.947950 23927 heartbeater.cc:503] Master 127.24.116.254:37285 was elected leader, sending a full tablet report...
I20260808 02:36:08.981310 24353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:08.952434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:45857 (local address 127.0.0.1:60964)
0808 02:36:08.969088 (+ 16654us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:08.969147 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:08.969610 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:08.971152 (+ 1542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:08.971163 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:08.971206 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:36:08.971760 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:08.971777 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:08.974482 (+ 2705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:08.974491 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:08.977894 (+ 3403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:08.977919 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:08.980270 (+ 2351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:08.980277 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:08.980549 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:08.980618 (+ 69us) client_negotiation.cc:769] Sending connection context
0808 02:36:08.980747 (+ 129us) client_negotiation.cc:240] Negotiation successful
0808 02:36:08.980951 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16271,"thread_start_us":16078,"threads_started":1}
I20260808 02:36:08.982295 24354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:08.952611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60964 (local address 127.24.116.194:45857)
0808 02:36:08.968008 (+ 15397us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:08.968030 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:08.969317 (+ 1287us) server_negotiation.cc:407] Connection header received
0808 02:36:08.969993 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:08.970005 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:08.970337 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:08.970629 (+ 292us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:36:08.972032 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:08.974241 (+ 2209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:08.978189 (+ 3948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:08.980074 (+ 1885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:08.980235 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:08.980501 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:08.981789 (+ 1288us) server_negotiation.cc:299] Negotiation successful
0808 02:36:08.981925 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15113,"thread_start_us":15433,"threads_started":1}
I20260808 02:36:08.986886 24358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:08.952704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:39349 (local address 127.0.0.1:56428)
0808 02:36:08.977532 (+ 24828us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:08.977558 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:08.977718 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:08.978869 (+ 1151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:08.978873 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:08.978900 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:36:08.979385 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:08.979398 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:08.982080 (+ 2682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:08.982086 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:08.983870 (+ 1784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:08.983889 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:08.986112 (+ 2223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:08.986119 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:08.986284 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:08.986320 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 02:36:08.986425 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 02:36:08.986569 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24600,"thread_start_us":26874,"threads_started":1}
I20260808 02:36:08.987084 24357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:08.952921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56428 (local address 127.24.116.195:39349)
0808 02:36:08.978375 (+ 25454us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:08.978381 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:08.978409 (+ 28us) server_negotiation.cc:407] Connection header received
0808 02:36:08.978493 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:08.978499 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:08.978677 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:08.978883 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:36:08.979629 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:08.981924 (+ 2295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:08.984115 (+ 2191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:08.985540 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:08.985729 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:08.985966 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:08.986501 (+ 535us) server_negotiation.cc:299] Negotiation successful
0808 02:36:08.986685 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25287,"thread_start_us":25138,"threads_started":1}
I20260808 02:36:08.986515 24030 tablet_service.cc:1467] Processing CreateTablet for tablet f4793ac3e0f1408ebea22a73c024619e (DEFAULT_TABLE table=test-table [id=63d00afe13be43c782348cfe672c507a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:36:08.987808 24356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:08.953327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.193:41443 (local address 127.0.0.1:54936)
0808 02:36:08.979880 (+ 26553us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:08.979900 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:08.980033 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:08.980962 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:08.980968 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:08.980995 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:36:08.981365 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:08.981377 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:08.983326 (+ 1949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:08.983333 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:08.985043 (+ 1710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:08.985059 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:08.987058 (+ 1999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:08.987065 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:08.987260 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:08.987295 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 02:36:08.987386 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 02:36:08.987535 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26426,"thread_start_us":25902,"threads_started":1}
I20260808 02:36:08.988131 24359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:08.954001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54936 (local address 127.24.116.193:41443)
0808 02:36:08.976768 (+ 22767us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:08.976779 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:08.980039 (+ 3260us) server_negotiation.cc:407] Connection header received
0808 02:36:08.980184 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:08.980192 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:08.980485 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:08.980702 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:36:08.981568 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:08.983153 (+ 1585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:08.985263 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:08.986524 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:08.986721 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:08.986925 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:08.987569 (+ 644us) server_negotiation.cc:299] Negotiation successful
0808 02:36:08.987759 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22567,"thread_start_us":22783,"threads_started":1}
I20260808 02:36:08.988130 24030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4793ac3e0f1408ebea22a73c024619e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:08.990818 24231 tablet_service.cc:1467] Processing CreateTablet for tablet f4793ac3e0f1408ebea22a73c024619e (DEFAULT_TABLE table=test-table [id=63d00afe13be43c782348cfe672c507a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:36:08.992650 24231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4793ac3e0f1408ebea22a73c024619e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:08.992519 23820 tablet_service.cc:1467] Processing CreateTablet for tablet f4793ac3e0f1408ebea22a73c024619e (DEFAULT_TABLE table=test-table [id=63d00afe13be43c782348cfe672c507a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:36:08.993944 23820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4793ac3e0f1408ebea22a73c024619e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:09.003244 24360 tablet_bootstrap.cc:492] T f4793ac3e0f1408ebea22a73c024619e P cad45f12b5674b4c9c1532711c70f6ea: Bootstrap starting.
I20260808 02:36:09.008353 24360 tablet_bootstrap.cc:654] T f4793ac3e0f1408ebea22a73c024619e P cad45f12b5674b4c9c1532711c70f6ea: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:09.009346 24361 tablet_bootstrap.cc:492] T f4793ac3e0f1408ebea22a73c024619e P 6f2614d475e84d73950e17bec1fd7e0b: Bootstrap starting.
I20260808 02:36:09.010000 24360 log.cc:824] T f4793ac3e0f1408ebea22a73c024619e P cad45f12b5674b4c9c1532711c70f6ea: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:09.011548 24363 tablet_bootstrap.cc:492] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712: Bootstrap starting.
I20260808 02:36:09.013661 24361 tablet_bootstrap.cc:654] T f4793ac3e0f1408ebea22a73c024619e P 6f2614d475e84d73950e17bec1fd7e0b: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:09.014056 24360 tablet_bootstrap.cc:492] T f4793ac3e0f1408ebea22a73c024619e P cad45f12b5674b4c9c1532711c70f6ea: No bootstrap required, opened a new log
I20260808 02:36:09.014369 24360 ts_tablet_manager.cc:1397] T f4793ac3e0f1408ebea22a73c024619e P cad45f12b5674b4c9c1532711c70f6ea: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260808 02:36:09.014824 24363 tablet_bootstrap.cc:654] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:09.015002 24361 log.cc:824] T f4793ac3e0f1408ebea22a73c024619e P 6f2614d475e84d73950e17bec1fd7e0b: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:09.015944 24363 log.cc:824] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:09.018271 24361 tablet_bootstrap.cc:492] T f4793ac3e0f1408ebea22a73c024619e P 6f2614d475e84d73950e17bec1fd7e0b: No bootstrap required, opened a new log
I20260808 02:36:09.018589 24361 ts_tablet_manager.cc:1397] T f4793ac3e0f1408ebea22a73c024619e P 6f2614d475e84d73950e17bec1fd7e0b: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260808 02:36:09.019030 24363 tablet_bootstrap.cc:492] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712: No bootstrap required, opened a new log
I20260808 02:36:09.019361 24363 ts_tablet_manager.cc:1397] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260808 02:36:09.023484 24360 raft_consensus.cc:348] T f4793ac3e0f1408ebea22a73c024619e P cad45f12b5674b4c9c1532711c70f6ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad45f12b5674b4c9c1532711c70f6ea" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 45857 } } peers { permanent_uuid: "6f2614d475e84d73950e17bec1fd7e0b" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39349 } } peers { permanent_uuid: "6f7ca60a7ec04c9bad73d4806f01d712" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41443 } }
I20260808 02:36:09.023874 24360 raft_consensus.cc:374] T f4793ac3e0f1408ebea22a73c024619e P cad45f12b5674b4c9c1532711c70f6ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:09.023979 24360 raft_consensus.cc:729] T f4793ac3e0f1408ebea22a73c024619e P cad45f12b5674b4c9c1532711c70f6ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cad45f12b5674b4c9c1532711c70f6ea, State: Initialized, Role: FOLLOWER
I20260808 02:36:09.024655 24360 consensus_queue.cc:260] T f4793ac3e0f1408ebea22a73c024619e P cad45f12b5674b4c9c1532711c70f6ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad45f12b5674b4c9c1532711c70f6ea" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 45857 } } peers { permanent_uuid: "6f2614d475e84d73950e17bec1fd7e0b" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39349 } } peers { permanent_uuid: "6f7ca60a7ec04c9bad73d4806f01d712" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41443 } }
I20260808 02:36:09.025811 24131 heartbeater.cc:503] Master 127.24.116.254:37285 was elected leader, sending a full tablet report...
I20260808 02:36:09.026479 24360 ts_tablet_manager.cc:1428] T f4793ac3e0f1408ebea22a73c024619e P cad45f12b5674b4c9c1532711c70f6ea: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260808 02:36:09.028792 24361 raft_consensus.cc:348] T f4793ac3e0f1408ebea22a73c024619e P 6f2614d475e84d73950e17bec1fd7e0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad45f12b5674b4c9c1532711c70f6ea" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 45857 } } peers { permanent_uuid: "6f2614d475e84d73950e17bec1fd7e0b" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39349 } } peers { permanent_uuid: "6f7ca60a7ec04c9bad73d4806f01d712" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41443 } }
I20260808 02:36:09.029160 24361 raft_consensus.cc:374] T f4793ac3e0f1408ebea22a73c024619e P 6f2614d475e84d73950e17bec1fd7e0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:09.029286 24361 raft_consensus.cc:729] T f4793ac3e0f1408ebea22a73c024619e P 6f2614d475e84d73950e17bec1fd7e0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f2614d475e84d73950e17bec1fd7e0b, State: Initialized, Role: FOLLOWER
I20260808 02:36:09.029903 24361 consensus_queue.cc:260] T f4793ac3e0f1408ebea22a73c024619e P 6f2614d475e84d73950e17bec1fd7e0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad45f12b5674b4c9c1532711c70f6ea" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 45857 } } peers { permanent_uuid: "6f2614d475e84d73950e17bec1fd7e0b" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39349 } } peers { permanent_uuid: "6f7ca60a7ec04c9bad73d4806f01d712" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41443 } }
I20260808 02:36:09.030815 24363 raft_consensus.cc:348] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad45f12b5674b4c9c1532711c70f6ea" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 45857 } } peers { permanent_uuid: "6f2614d475e84d73950e17bec1fd7e0b" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39349 } } peers { permanent_uuid: "6f7ca60a7ec04c9bad73d4806f01d712" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41443 } }
I20260808 02:36:09.031255 24363 raft_consensus.cc:374] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:09.031381 24363 raft_consensus.cc:729] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f7ca60a7ec04c9bad73d4806f01d712, State: Initialized, Role: FOLLOWER
I20260808 02:36:09.032086 24363 consensus_queue.cc:260] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad45f12b5674b4c9c1532711c70f6ea" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 45857 } } peers { permanent_uuid: "6f2614d475e84d73950e17bec1fd7e0b" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39349 } } peers { permanent_uuid: "6f7ca60a7ec04c9bad73d4806f01d712" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41443 } }
I20260808 02:36:09.033669 24333 heartbeater.cc:503] Master 127.24.116.254:37285 was elected leader, sending a full tablet report...
I20260808 02:36:09.033898 24363 ts_tablet_manager.cc:1428] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20260808 02:36:09.034276 24361 ts_tablet_manager.cc:1428] T f4793ac3e0f1408ebea22a73c024619e P 6f2614d475e84d73950e17bec1fd7e0b: Time spent starting tablet: real 0.016s user 0.015s sys 0.000s
W20260808 02:36:09.140559 24336 tablet.cc:2369] T f4793ac3e0f1408ebea22a73c024619e P 6f2614d475e84d73950e17bec1fd7e0b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:36:09.152468 24132 tablet.cc:2369] T f4793ac3e0f1408ebea22a73c024619e P cad45f12b5674b4c9c1532711c70f6ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:36:09.173988 23929 tablet.cc:2369] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:36:09.185860 24372 raft_consensus.cc:482] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:36:09.186180 24372 raft_consensus.cc:504] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad45f12b5674b4c9c1532711c70f6ea" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 45857 } } peers { permanent_uuid: "6f2614d475e84d73950e17bec1fd7e0b" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39349 } } peers { permanent_uuid: "6f7ca60a7ec04c9bad73d4806f01d712" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41443 } }
I20260808 02:36:09.187988 24372 leader_election.cc:288] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cad45f12b5674b4c9c1532711c70f6ea (127.24.116.194:45857), 6f2614d475e84d73950e17bec1fd7e0b (127.24.116.195:39349)
I20260808 02:36:09.195353 24354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:09.188374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:60997 (local address 127.24.116.194:45857)
0808 02:36:09.188599 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:09.188605 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:09.189431 (+ 826us) server_negotiation.cc:407] Connection header received
0808 02:36:09.189686 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:09.189693 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:09.189790 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:09.189893 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:36:09.190652 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:09.191441 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:09.193504 (+ 2063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:09.194305 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:09.194449 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:09.194498 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:09.194912 (+ 414us) server_negotiation.cc:299] Negotiation successful
0808 02:36:09.195057 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 02:36:09.195372 24374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:09.188344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.194:45857 (local address 127.24.116.193:60997)
0808 02:36:09.189271 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:09.189297 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:09.189505 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:09.189965 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:09.189972 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:09.190008 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:36:09.190491 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:09.190503 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:09.191588 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:09.191593 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:09.193286 (+ 1693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:09.193299 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:09.194512 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:09.194520 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:09.194694 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:09.194757 (+ 63us) client_negotiation.cc:769] Sending connection context
0808 02:36:09.194843 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 02:36:09.194934 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":752,"mutex_wait_us":4,"thread_start_us":469,"threads_started":1}
I20260808 02:36:09.195565 24357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:09.188643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.116.193:59385 (local address 127.24.116.195:39349)
0808 02:36:09.188906 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:09.188913 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:09.189925 (+ 1012us) server_negotiation.cc:407] Connection header received
0808 02:36:09.190064 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:09.190072 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:09.190159 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:09.190268 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:36:09.190931 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:09.191734 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:09.193693 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:09.194509 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:09.194665 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:09.194732 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:09.195130 (+ 398us) server_negotiation.cc:299] Negotiation successful
0808 02:36:09.195283 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260808 02:36:09.195608 24375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:09.188496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.195:39349 (local address 127.24.116.193:59385)
0808 02:36:09.189761 (+ 1265us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:09.189779 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:09.189929 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:09.190287 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:09.190290 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:09.190310 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:36:09.190706 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:09.190721 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:09.191895 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:09.191899 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:09.193502 (+ 1603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:09.193516 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:09.194693 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:09.194698 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:09.194940 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:09.194972 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 02:36:09.195062 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 02:36:09.195215 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1147,"mutex_wait_us":39,"thread_start_us":900,"threads_started":1}
I20260808 02:36:09.196574 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4793ac3e0f1408ebea22a73c024619e" candidate_uuid: "6f7ca60a7ec04c9bad73d4806f01d712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cad45f12b5674b4c9c1532711c70f6ea" is_pre_election: true
I20260808 02:36:09.196795 24260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4793ac3e0f1408ebea22a73c024619e" candidate_uuid: "6f7ca60a7ec04c9bad73d4806f01d712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f2614d475e84d73950e17bec1fd7e0b" is_pre_election: true
I20260808 02:36:09.197140 24055 raft_consensus.cc:2454] T f4793ac3e0f1408ebea22a73c024619e P cad45f12b5674b4c9c1532711c70f6ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f7ca60a7ec04c9bad73d4806f01d712 in term 0.
I20260808 02:36:09.197383 24260 raft_consensus.cc:2454] T f4793ac3e0f1408ebea22a73c024619e P 6f2614d475e84d73950e17bec1fd7e0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f7ca60a7ec04c9bad73d4806f01d712 in term 0.
I20260808 02:36:09.197953 23744 leader_election.cc:302] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f7ca60a7ec04c9bad73d4806f01d712, cad45f12b5674b4c9c1532711c70f6ea; no voters:
I20260808 02:36:09.198416 24372 raft_consensus.cc:2781] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:36:09.198576 24372 raft_consensus.cc:482] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:36:09.198678 24372 raft_consensus.cc:3037] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:09.201059 24372 raft_consensus.cc:504] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad45f12b5674b4c9c1532711c70f6ea" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 45857 } } peers { permanent_uuid: "6f2614d475e84d73950e17bec1fd7e0b" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39349 } } peers { permanent_uuid: "6f7ca60a7ec04c9bad73d4806f01d712" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41443 } }
I20260808 02:36:09.201676 24372 leader_election.cc:288] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712 [CANDIDATE]: Term 1 election: Requested vote from peers cad45f12b5674b4c9c1532711c70f6ea (127.24.116.194:45857), 6f2614d475e84d73950e17bec1fd7e0b (127.24.116.195:39349)
I20260808 02:36:09.202176 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4793ac3e0f1408ebea22a73c024619e" candidate_uuid: "6f7ca60a7ec04c9bad73d4806f01d712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cad45f12b5674b4c9c1532711c70f6ea"
I20260808 02:36:09.202200 24260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4793ac3e0f1408ebea22a73c024619e" candidate_uuid: "6f7ca60a7ec04c9bad73d4806f01d712" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f2614d475e84d73950e17bec1fd7e0b"
I20260808 02:36:09.202392 24055 raft_consensus.cc:3037] T f4793ac3e0f1408ebea22a73c024619e P cad45f12b5674b4c9c1532711c70f6ea [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:09.202404 24260 raft_consensus.cc:3037] T f4793ac3e0f1408ebea22a73c024619e P 6f2614d475e84d73950e17bec1fd7e0b [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:09.204679 24055 raft_consensus.cc:2454] T f4793ac3e0f1408ebea22a73c024619e P cad45f12b5674b4c9c1532711c70f6ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f7ca60a7ec04c9bad73d4806f01d712 in term 1.
I20260808 02:36:09.204679 24260 raft_consensus.cc:2454] T f4793ac3e0f1408ebea22a73c024619e P 6f2614d475e84d73950e17bec1fd7e0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f7ca60a7ec04c9bad73d4806f01d712 in term 1.
I20260808 02:36:09.205157 23747 leader_election.cc:302] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f2614d475e84d73950e17bec1fd7e0b, 6f7ca60a7ec04c9bad73d4806f01d712; no voters:
I20260808 02:36:09.205785 24372 raft_consensus.cc:2781] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:36:09.206363 24372 raft_consensus.cc:686] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712 [term 1 LEADER]: Becoming Leader. State: Replica: 6f7ca60a7ec04c9bad73d4806f01d712, State: Running, Role: LEADER
I20260808 02:36:09.206990 24372 consensus_queue.cc:237] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad45f12b5674b4c9c1532711c70f6ea" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 45857 } } peers { permanent_uuid: "6f2614d475e84d73950e17bec1fd7e0b" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39349 } } peers { permanent_uuid: "6f7ca60a7ec04c9bad73d4806f01d712" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41443 } }
I20260808 02:36:09.211889 23635 catalog_manager.cc:5495] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f7ca60a7ec04c9bad73d4806f01d712 (127.24.116.193). New cstate: current_term: 1 leader_uuid: "6f7ca60a7ec04c9bad73d4806f01d712" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad45f12b5674b4c9c1532711c70f6ea" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 45857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f2614d475e84d73950e17bec1fd7e0b" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f7ca60a7ec04c9bad73d4806f01d712" member_type: VOTER last_known_addr { host: "127.24.116.193" port: 41443 } health_report { overall_health: HEALTHY } } }
I20260808 02:36:09.276387 24359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:09.270903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54940 (local address 127.24.116.193:41443)
0808 02:36:09.271120 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:09.271126 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:09.271146 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:36:09.271376 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:09.271380 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:09.271491 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:09.271653 (+ 162us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:36:09.272041 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:09.272762 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:09.274164 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:09.274591 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:09.274727 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:09.275253 (+ 526us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:36:09.275749 (+ 496us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:36:09.275926 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:09.275986 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 02:36:09.276065 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 02:36:09.284762 24055 raft_consensus.cc:1261] T f4793ac3e0f1408ebea22a73c024619e P cad45f12b5674b4c9c1532711c70f6ea [term 1 FOLLOWER]: Refusing update from remote peer 6f7ca60a7ec04c9bad73d4806f01d712: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:36:09.284760 24260 raft_consensus.cc:1261] T f4793ac3e0f1408ebea22a73c024619e P 6f2614d475e84d73950e17bec1fd7e0b [term 1 FOLLOWER]: Refusing update from remote peer 6f7ca60a7ec04c9bad73d4806f01d712: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:36:09.285880 24372 consensus_queue.cc:1035] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cad45f12b5674b4c9c1532711c70f6ea" member_type: VOTER last_known_addr { host: "127.24.116.194" port: 45857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:36:09.286238 24378 consensus_queue.cc:1035] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f2614d475e84d73950e17bec1fd7e0b" member_type: VOTER last_known_addr { host: "127.24.116.195" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:36:09.300261 24384 mvcc.cc:205] Tried to move back new op lower bound from 7316097307779670016 to 7316097307476205568. Current Snapshot: MvccSnapshot[applied={T|T < 7316097307779670016}]
I20260808 02:36:09.309742 24386 mvcc.cc:205] Tried to move back new op lower bound from 7316097307779670016 to 7316097307476205568. Current Snapshot: MvccSnapshot[applied={T|T < 7316097307779670016}]
I20260808 02:36:09.323167 23635 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:36:09.323510 23635 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:36:09.328058 23635 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2d69a176d4264d7c82f1eb9c3d23a8d5: Sending DeleteTablet for 3 replicas of tablet f4793ac3e0f1408ebea22a73c024619e
I20260808 02:36:09.329360 24231 tablet_service.cc:1514] Processing DeleteTablet for tablet f4793ac3e0f1408ebea22a73c024619e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:36:09 UTC) from {username='slave'} at 127.0.0.1:56428
I20260808 02:36:09.330257 24394 tablet_replica.cc:330] T f4793ac3e0f1408ebea22a73c024619e P 6f2614d475e84d73950e17bec1fd7e0b: stopping tablet replica
I20260808 02:36:09.330315 24030 tablet_service.cc:1514] Processing DeleteTablet for tablet f4793ac3e0f1408ebea22a73c024619e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:36:09 UTC) from {username='slave'} at 127.0.0.1:60964
I20260808 02:36:09.330703 24394 raft_consensus.cc:2229] T f4793ac3e0f1408ebea22a73c024619e P 6f2614d475e84d73950e17bec1fd7e0b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:36:09.331238 24397 tablet_replica.cc:330] T f4793ac3e0f1408ebea22a73c024619e P cad45f12b5674b4c9c1532711c70f6ea: stopping tablet replica
I20260808 02:36:09.331287 24394 raft_consensus.cc:2258] T f4793ac3e0f1408ebea22a73c024619e P 6f2614d475e84d73950e17bec1fd7e0b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:36:09.331640 23820 tablet_service.cc:1514] Processing DeleteTablet for tablet f4793ac3e0f1408ebea22a73c024619e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:36:09 UTC) from {username='slave'} at 127.0.0.1:54936
I20260808 02:36:09.331714 24397 raft_consensus.cc:2229] T f4793ac3e0f1408ebea22a73c024619e P cad45f12b5674b4c9c1532711c70f6ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:36:09.332696 24398 tablet_replica.cc:330] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712: stopping tablet replica
I20260808 02:36:09.333170 24398 raft_consensus.cc:2229] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:36:09.333734 24398 raft_consensus.cc:2258] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:36:09.334012 24394 ts_tablet_manager.cc:1905] T f4793ac3e0f1408ebea22a73c024619e P 6f2614d475e84d73950e17bec1fd7e0b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:36:09.334291 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 23722
I20260808 02:36:09.336098 24398 ts_tablet_manager.cc:1905] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:36:09.332150 24397 raft_consensus.cc:2258] T f4793ac3e0f1408ebea22a73c024619e P cad45f12b5674b4c9c1532711c70f6ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:36:09.338479 24397 ts_tablet_manager.cc:1905] T f4793ac3e0f1408ebea22a73c024619e P cad45f12b5674b4c9c1532711c70f6ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:36:09.343184 24394 ts_tablet_manager.cc:1918] T f4793ac3e0f1408ebea22a73c024619e P 6f2614d475e84d73950e17bec1fd7e0b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:36:09.343456 24394 log.cc:1196] T f4793ac3e0f1408ebea22a73c024619e P 6f2614d475e84d73950e17bec1fd7e0b: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-2/wal/wals/f4793ac3e0f1408ebea22a73c024619e
I20260808 02:36:09.343433 24398 ts_tablet_manager.cc:1918] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:36:09.343604 24398 log.cc:1196] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-0/wal/wals/f4793ac3e0f1408ebea22a73c024619e
I20260808 02:36:09.344121 24394 ts_tablet_manager.cc:1939] T f4793ac3e0f1408ebea22a73c024619e P 6f2614d475e84d73950e17bec1fd7e0b: Deleting consensus metadata
I20260808 02:36:09.344228 24398 ts_tablet_manager.cc:1939] T f4793ac3e0f1408ebea22a73c024619e P 6f7ca60a7ec04c9bad73d4806f01d712: Deleting consensus metadata
I20260808 02:36:09.345660 24397 ts_tablet_manager.cc:1918] T f4793ac3e0f1408ebea22a73c024619e P cad45f12b5674b4c9c1532711c70f6ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:36:09.345933 24397 log.cc:1196] T f4793ac3e0f1408ebea22a73c024619e P cad45f12b5674b4c9c1532711c70f6ea: Deleting WAL directory at /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156232048520-25043-0/minicluster-data/ts-1/wal/wals/f4793ac3e0f1408ebea22a73c024619e
I20260808 02:36:09.346236 23619 catalog_manager.cc:4841] TS 6f7ca60a7ec04c9bad73d4806f01d712 (127.24.116.193:41443): tablet f4793ac3e0f1408ebea22a73c024619e (table test-table [id=63d00afe13be43c782348cfe672c507a]) successfully deleted
I20260808 02:36:09.346298 23622 catalog_manager.cc:4841] TS 6f2614d475e84d73950e17bec1fd7e0b (127.24.116.195:39349): tablet f4793ac3e0f1408ebea22a73c024619e (table test-table [id=63d00afe13be43c782348cfe672c507a]) successfully deleted
I20260808 02:36:09.346797 24397 ts_tablet_manager.cc:1939] T f4793ac3e0f1408ebea22a73c024619e P cad45f12b5674b4c9c1532711c70f6ea: Deleting consensus metadata
I20260808 02:36:09.348721 23618 catalog_manager.cc:4841] TS cad45f12b5674b4c9c1532711c70f6ea (127.24.116.194:45857): tablet f4793ac3e0f1408ebea22a73c024619e (table test-table [id=63d00afe13be43c782348cfe672c507a]) successfully deleted
I20260808 02:36:09.361243 24359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:09.335568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54948 (local address 127.24.116.193:41443)
0808 02:36:09.335728 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:09.335735 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:09.347562 (+ 11827us) server_negotiation.cc:407] Connection header received
0808 02:36:09.347718 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:09.347725 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:09.347851 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:09.347969 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:09.348574 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:09.349807 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:09.351739 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:09.352245 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:09.352438 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:09.359616 (+ 7178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:09.359630 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:09.359646 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:09.360286 (+ 640us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:09.360411 (+ 125us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:09.360441 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:09.360531 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:09.360753 (+ 222us) server_negotiation.cc:299] Negotiation successful
0808 02:36:09.360873 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 02:36:09.362022 23914 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:36:09.463749 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 23722
I20260808 02:36:09.495292 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 23932
I20260808 02:36:09.502640 24354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:09.496144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60978 (local address 127.24.116.194:45857)
0808 02:36:09.496395 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:09.496403 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:09.496424 (+ 21us) server_negotiation.cc:407] Connection header received
0808 02:36:09.496648 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:09.496653 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:09.496774 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:09.496938 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:09.497357 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:09.498154 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:09.499471 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:09.499909 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:09.500053 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:09.501215 (+ 1162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:09.501224 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:09.501239 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:09.501849 (+ 610us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:09.501898 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:09.501925 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:09.502054 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:09.502193 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 02:36:09.502293 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 02:36:09.503357 24124 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:36:09.592921 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 23932
I20260808 02:36:09.618880 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 24135
I20260808 02:36:09.626006 24357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:09.619748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56444 (local address 127.24.116.195:39349)
0808 02:36:09.619933 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:09.619937 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:09.619957 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:36:09.620124 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:09.620128 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:09.620215 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:09.620377 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:09.620737 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:09.621434 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:09.622909 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:09.623397 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:09.623515 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:09.624642 (+ 1127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:09.624652 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:09.624668 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:09.625264 (+ 596us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:09.625314 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:09.625336 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:09.625447 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:09.625532 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 02:36:09.625620 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 02:36:09.626765 24327 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:36:09.715286 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 24135
I20260808 02:36:09.743649 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 23592
I20260808 02:36:09.744876 23680 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:36:09.855309 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 23592
2026-08-08T02:36:09Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3155 ms)
[----------] 6 tests from EncryptionPolicyTest (24415 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:36:09 dist-test-slave-45dx krb5kdc[24409](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:36:09 dist-test-slave-45dx krb5kdc[24409](info): set up 2 sockets
Aug 08 02:36:09 dist-test-slave-45dx krb5kdc[24409](info): commencing operation
krb5kdc: starting...
W20260808 02:36:11.221306 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.312s user 0.000s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:36:11 dist-test-slave-45dx krb5kdc[24409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:36:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:36:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 02:36:11.566211 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42569
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42569
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:36:11.917724 24431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:11.918102 24431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:11.918269 24431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:11.925678 24431 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:36:11.925884 24431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:11.925994 24431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:11.926111 24431 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:36:11.926199 24431 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:36:11.936079 24431 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42569
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:11.937527 24431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:11.938969 24431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:11.951822 24438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:11.951838 24441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:11.952122 24437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:11.952767 24431 server_base.cc:1034] running on GCE node
I20260808 02:36:11.953666 24431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:11.955163 24431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:11.956418 24431 hybrid_clock.cc:648] HybridClock initialized: now 1786156571956368 us; error 55 us; skew 500 ppm
I20260808 02:36:11.956802 24431 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:11 dist-test-slave-45dx krb5kdc[24409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156571, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:11.960069 24431 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 02:36:11.961786 24431 webserver.cc:460] Webserver started at http://127.0.0.1:40663/ using document root <none> and password file <none>
I20260808 02:36:11.962519 24431 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:11.962687 24431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:11.963024 24431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:11.966218 24431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "6f23b954edc942a5ad7ab4ee0e5ccfa5"
format_stamp: "Formatted at 2026-08-08 02:36:11 on dist-test-slave-45dx"
server_key: "338b29e6d4647860037e78b76f410ef5"
server_key_iv: "cf5590ed56253ccdbd39f45ed5829d4c"
server_key_version: "encryptionkey@0"
I20260808 02:36:11.967053 24431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "6f23b954edc942a5ad7ab4ee0e5ccfa5"
format_stamp: "Formatted at 2026-08-08 02:36:11 on dist-test-slave-45dx"
server_key: "338b29e6d4647860037e78b76f410ef5"
server_key_iv: "cf5590ed56253ccdbd39f45ed5829d4c"
server_key_version: "encryptionkey@0"
I20260808 02:36:11.972527 24431 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260808 02:36:11.976039 24456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:11.977690 24431 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:36:11.977910 24431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "6f23b954edc942a5ad7ab4ee0e5ccfa5"
format_stamp: "Formatted at 2026-08-08 02:36:11 on dist-test-slave-45dx"
server_key: "338b29e6d4647860037e78b76f410ef5"
server_key_iv: "cf5590ed56253ccdbd39f45ed5829d4c"
server_key_version: "encryptionkey@0"
I20260808 02:36:11.978201 24431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:12.000659 24431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:12.004981 24431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:12.005295 24431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:12.024984 24431 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42569
I20260808 02:36:12.025072 24542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42569 every 8 connection(s)
I20260808 02:36:12.026427 24431 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:36:12.029327 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 24431
I20260808 02:36:12.029587 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:36:12.030242 25043 external_mini_cluster.cc:1428] Setting key 19a103ccfe4e524a2954529d456b24df
I20260808 02:36:12.030470 24543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:12.045518 24543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f23b954edc942a5ad7ab4ee0e5ccfa5: Bootstrap starting.
Aug 08 02:36:12 dist-test-slave-45dx krb5kdc[24409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 02:36:12.049558 24543 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f23b954edc942a5ad7ab4ee0e5ccfa5: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:12.051025 24543 log.cc:824] T 00000000000000000000000000000000 P 6f23b954edc942a5ad7ab4ee0e5ccfa5: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:12.054600 24543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f23b954edc942a5ad7ab4ee0e5ccfa5: No bootstrap required, opened a new log
I20260808 02:36:12.057206 24546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:12.032517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44269 (local address 127.0.0.1:42569)
0808 02:36:12.033425 (+ 908us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:12.033444 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:12.033496 (+ 52us) server_negotiation.cc:407] Connection header received
0808 02:36:12.035766 (+ 2270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:12.035790 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:12.036208 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:12.036706 (+ 498us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:12.038347 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:12.040259 (+ 1912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:12.041622 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:12.042769 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:12.042982 (+ 213us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:12.047702 (+ 4720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:12.047714 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:12.047733 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:12.047787 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:12.052015 (+ 4228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:12.052999 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:12.053008 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:12.053016 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:12.053235 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:12.053736 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:12.053740 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:12.053743 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:12.054432 (+ 689us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:12.054759 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:12.055442 (+ 683us) server_negotiation.cc:299] Negotiation successful
0808 02:36:12.055782 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":405,"threads_started":1}
I20260808 02:36:12.061358 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:36:12.063839 24543 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f23b954edc942a5ad7ab4ee0e5ccfa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f23b954edc942a5ad7ab4ee0e5ccfa5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42569 } }
I20260808 02:36:12.064240 24543 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f23b954edc942a5ad7ab4ee0e5ccfa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:12.064436 24543 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f23b954edc942a5ad7ab4ee0e5ccfa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f23b954edc942a5ad7ab4ee0e5ccfa5, State: Initialized, Role: FOLLOWER
I20260808 02:36:12.065129 24543 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f23b954edc942a5ad7ab4ee0e5ccfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f23b954edc942a5ad7ab4ee0e5ccfa5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42569 } }
I20260808 02:36:12.065405 24543 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f23b954edc942a5ad7ab4ee0e5ccfa5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:36:12.065554 24543 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f23b954edc942a5ad7ab4ee0e5ccfa5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:36:12.065737 24543 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f23b954edc942a5ad7ab4ee0e5ccfa5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:12.068523 24543 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f23b954edc942a5ad7ab4ee0e5ccfa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f23b954edc942a5ad7ab4ee0e5ccfa5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42569 } }
I20260808 02:36:12.069032 24543 leader_election.cc:302] T 00000000000000000000000000000000 P 6f23b954edc942a5ad7ab4ee0e5ccfa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f23b954edc942a5ad7ab4ee0e5ccfa5; no voters:
I20260808 02:36:12.069751 24543 leader_election.cc:288] T 00000000000000000000000000000000 P 6f23b954edc942a5ad7ab4ee0e5ccfa5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:36:12.069904 24559 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f23b954edc942a5ad7ab4ee0e5ccfa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:36:12.070597 24559 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f23b954edc942a5ad7ab4ee0e5ccfa5 [term 1 LEADER]: Becoming Leader. State: Replica: 6f23b954edc942a5ad7ab4ee0e5ccfa5, State: Running, Role: LEADER
I20260808 02:36:12.071288 24559 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f23b954edc942a5ad7ab4ee0e5ccfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f23b954edc942a5ad7ab4ee0e5ccfa5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42569 } }
I20260808 02:36:12.073163 24559 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f23b954edc942a5ad7ab4ee0e5ccfa5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f23b954edc942a5ad7ab4ee0e5ccfa5. Latest consensus state: current_term: 1 leader_uuid: "6f23b954edc942a5ad7ab4ee0e5ccfa5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f23b954edc942a5ad7ab4ee0e5ccfa5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42569 } } }
I20260808 02:36:12.073558 24559 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f23b954edc942a5ad7ab4ee0e5ccfa5 [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:12.074110 24563 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f23b954edc942a5ad7ab4ee0e5ccfa5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f23b954edc942a5ad7ab4ee0e5ccfa5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f23b954edc942a5ad7ab4ee0e5ccfa5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42569 } } }
I20260808 02:36:12.074488 24563 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f23b954edc942a5ad7ab4ee0e5ccfa5 [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:12.077550 24543 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f23b954edc942a5ad7ab4ee0e5ccfa5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:36:12.082156 24566 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:36:12.088336 24546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:12.066452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38043 (local address 127.0.0.1:42569)
0808 02:36:12.066649 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:12.066655 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:12.067191 (+ 536us) server_negotiation.cc:407] Connection header received
0808 02:36:12.067317 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:12.067323 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:12.067410 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:12.067517 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:12.069171 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:12.070563 (+ 1392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:12.073165 (+ 2602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:12.074192 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:12.074360 (+ 168us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:12.078267 (+ 3907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:12.078277 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:12.078285 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:12.078341 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:12.083456 (+ 5115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:12.084456 (+ 1000us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:12.084463 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:12.084469 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:12.084675 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:12.085497 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:12.085506 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:12.085510 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:12.085957 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:12.087519 (+ 1562us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:12.087712 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 02:36:12.087937 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 02:36:12.089465 24566 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:36:12.102769 24566 catalog_manager.cc:1347] Generated new cluster ID: 857bbf5e6f9843c3970789871df45166
I20260808 02:36:12.102923 24566 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:36:12.118633 24566 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:36:12.120581 24566 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:36:12.134227 24566 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6f23b954edc942a5ad7ab4ee0e5ccfa5: Generated new TSK 0
I20260808 02:36:12.135274 24566 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:36:12.141505 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 24431
I20260808 02:36:12.143222 24535 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:36:12.234889 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 24431
W20260808 02:36:12.259511 24407 connection.cc:535] client connection to 127.0.0.1:42569 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42569): Connection reset by peer (error 104)
2026-08-08T02:36:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2370 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:36:12 dist-test-slave-45dx krb5kdc[24597](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:36:12 dist-test-slave-45dx krb5kdc[24597](info): set up 2 sockets
Aug 08 02:36:12 dist-test-slave-45dx krb5kdc[24597](info): commencing operation
krb5kdc: starting...
W20260808 02:36:13.620170 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.341s user 0.001s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:36:13 dist-test-slave-45dx krb5kdc[24597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156573, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:36:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:36:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 02:36:13.975443 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41989
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41989
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:36:14.331971 24614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:14.332266 24614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:14.332461 24614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:14.339730 24614 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:36:14.339844 24614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:14.340009 24614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:14.340126 24614 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:36:14.340190 24614 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:36:14.350118 24614 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41989
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41989
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:14.351495 24614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:14.352872 24614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:14.364854 24621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:14.364918 24622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:14.364943 24624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:14.365938 24614 server_base.cc:1034] running on GCE node
I20260808 02:36:14.366753 24614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:14.368158 24614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:14.369393 24614 hybrid_clock.cc:648] HybridClock initialized: now 1786156574369347 us; error 54 us; skew 500 ppm
I20260808 02:36:14.369740 24614 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:14 dist-test-slave-45dx krb5kdc[24597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156574, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:14.378214 24614 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 02:36:14.379715 24614 webserver.cc:460] Webserver started at http://127.0.0.1:32931/ using document root <none> and password file <none>
I20260808 02:36:14.380451 24614 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:14.380565 24614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:14.380823 24614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:14.383790 24614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "61ee9b2db929452daa9aa05914385b6f"
format_stamp: "Formatted at 2026-08-08 02:36:14 on dist-test-slave-45dx"
server_key: "ad9d022bf71dfc8296a30506cd728104"
server_key_iv: "c402f1d0e4111bbdd81c9946b12ac1c1"
server_key_version: "encryptionkey@0"
I20260808 02:36:14.384616 24614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "61ee9b2db929452daa9aa05914385b6f"
format_stamp: "Formatted at 2026-08-08 02:36:14 on dist-test-slave-45dx"
server_key: "ad9d022bf71dfc8296a30506cd728104"
server_key_iv: "c402f1d0e4111bbdd81c9946b12ac1c1"
server_key_version: "encryptionkey@0"
I20260808 02:36:14.389936 24614 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 02:36:14.393872 24637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:14.395223 24614 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 02:36:14.395388 24614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "61ee9b2db929452daa9aa05914385b6f"
format_stamp: "Formatted at 2026-08-08 02:36:14 on dist-test-slave-45dx"
server_key: "ad9d022bf71dfc8296a30506cd728104"
server_key_iv: "c402f1d0e4111bbdd81c9946b12ac1c1"
server_key_version: "encryptionkey@0"
I20260808 02:36:14.395592 24614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:14.422399 24614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:14.426980 24614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:14.427294 24614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:14.447768 24614 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41989
I20260808 02:36:14.447815 24710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41989 every 8 connection(s)
I20260808 02:36:14.449407 24614 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:36:14.453258 24712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:14.459614 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 24614
I20260808 02:36:14.459828 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:36:14.460289 25043 external_mini_cluster.cc:1428] Setting key 87b72801dd37d6a8bc892f2ce758ab2e
I20260808 02:36:14.464026 24712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61ee9b2db929452daa9aa05914385b6f: Bootstrap starting.
I20260808 02:36:14.467525 24712 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 61ee9b2db929452daa9aa05914385b6f: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:14.469043 24712 log.cc:824] T 00000000000000000000000000000000 P 61ee9b2db929452daa9aa05914385b6f: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:14.472637 24712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61ee9b2db929452daa9aa05914385b6f: No bootstrap required, opened a new log
I20260808 02:36:14.475014 24715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:14.462360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42091 (local address 127.0.0.1:41989)
0808 02:36:14.463183 (+ 823us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:14.463194 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:14.463238 (+ 44us) server_negotiation.cc:407] Connection header received
0808 02:36:14.465060 (+ 1822us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:14.465084 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:14.465464 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:14.465808 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:14.466442 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:14.467799 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:14.469964 (+ 2165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:14.470841 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:14.470987 (+ 146us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:14.472495 (+ 1508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:14.472503 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:14.472517 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:14.473162 (+ 645us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:14.473245 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:14.473272 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:14.473406 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:14.473728 (+ 322us) server_negotiation.cc:299] Negotiation successful
0808 02:36:14.473959 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":381,"threads_started":1}
I20260808 02:36:14.479071 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:36:14.481748 24712 raft_consensus.cc:348] T 00000000000000000000000000000000 P 61ee9b2db929452daa9aa05914385b6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ee9b2db929452daa9aa05914385b6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41989 } }
I20260808 02:36:14.482198 24712 raft_consensus.cc:374] T 00000000000000000000000000000000 P 61ee9b2db929452daa9aa05914385b6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:14.482329 24712 raft_consensus.cc:729] T 00000000000000000000000000000000 P 61ee9b2db929452daa9aa05914385b6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61ee9b2db929452daa9aa05914385b6f, State: Initialized, Role: FOLLOWER
I20260808 02:36:14.482973 24712 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61ee9b2db929452daa9aa05914385b6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ee9b2db929452daa9aa05914385b6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41989 } }
I20260808 02:36:14.483235 24712 raft_consensus.cc:388] T 00000000000000000000000000000000 P 61ee9b2db929452daa9aa05914385b6f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:36:14.483404 24712 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61ee9b2db929452daa9aa05914385b6f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:36:14.483608 24712 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61ee9b2db929452daa9aa05914385b6f [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:14.486857 24712 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61ee9b2db929452daa9aa05914385b6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ee9b2db929452daa9aa05914385b6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41989 } }
I20260808 02:36:14.487367 24712 leader_election.cc:302] T 00000000000000000000000000000000 P 61ee9b2db929452daa9aa05914385b6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61ee9b2db929452daa9aa05914385b6f; no voters:
I20260808 02:36:14.488131 24712 leader_election.cc:288] T 00000000000000000000000000000000 P 61ee9b2db929452daa9aa05914385b6f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:36:14.488260 24722 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 61ee9b2db929452daa9aa05914385b6f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:36:14.490087 24722 raft_consensus.cc:686] T 00000000000000000000000000000000 P 61ee9b2db929452daa9aa05914385b6f [term 1 LEADER]: Becoming Leader. State: Replica: 61ee9b2db929452daa9aa05914385b6f, State: Running, Role: LEADER
I20260808 02:36:14.490917 24722 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61ee9b2db929452daa9aa05914385b6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ee9b2db929452daa9aa05914385b6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41989 } }
I20260808 02:36:14.491114 24712 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61ee9b2db929452daa9aa05914385b6f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:36:14.491626 24715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:14.483731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34087 (local address 127.0.0.1:41989)
0808 02:36:14.483924 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:14.483934 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:14.484365 (+ 431us) server_negotiation.cc:407] Connection header received
0808 02:36:14.484579 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:14.484585 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:14.484676 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:14.484797 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:14.485294 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:14.486449 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:14.487987 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:14.488917 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:14.489072 (+ 155us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:14.490583 (+ 1511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:14.490588 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:14.490591 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:14.490608 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:14.490806 (+ 198us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:14.490840 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:14.490952 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:14.491215 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 02:36:14.491277 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 02:36:14.500612 24725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61ee9b2db929452daa9aa05914385b6f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61ee9b2db929452daa9aa05914385b6f. Latest consensus state: current_term: 1 leader_uuid: "61ee9b2db929452daa9aa05914385b6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ee9b2db929452daa9aa05914385b6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41989 } } }
I20260808 02:36:14.501216 24725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61ee9b2db929452daa9aa05914385b6f [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:14.500605 24723 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61ee9b2db929452daa9aa05914385b6f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "61ee9b2db929452daa9aa05914385b6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ee9b2db929452daa9aa05914385b6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41989 } } }
I20260808 02:36:14.501505 24723 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61ee9b2db929452daa9aa05914385b6f [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:14.503082 24741 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:36:14.508386 24741 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:36:14.516733 24741 catalog_manager.cc:1347] Generated new cluster ID: 295e6fb5c7eb4f098bdac7336ef13e12
I20260808 02:36:14.516858 24741 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:36:14.529958 24741 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:36:14.531283 24741 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:36:14.537789 24741 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 61ee9b2db929452daa9aa05914385b6f: Generated new TSK 0
I20260808 02:36:14.538657 24741 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:36:14.547991 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 24614
W20260808 02:36:14.549254 24705 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:42091
W20260808 02:36:14.550066 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 24614: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:36:14.550266 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 24614
W20260808 02:36:14.580327 24591 connection.cc:535] client connection to 127.0.0.1:41989 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41989): Connection reset by peer (error 104)
2026-08-08T02:36:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2320 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:36:14 dist-test-slave-45dx krb5kdc[24752](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:36:14 dist-test-slave-45dx krb5kdc[24752](info): set up 2 sockets
Aug 08 02:36:14 dist-test-slave-45dx krb5kdc[24752](info): commencing operation
krb5kdc: starting...
W20260808 02:36:15.920542 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.321s user 0.002s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:36:16 dist-test-slave-45dx krb5kdc[24752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:36:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:36:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 02:36:16.267952 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40621
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40621
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:36:16.634145 24779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:16.634490 24779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:16.634665 24779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:16.641835 24779 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:36:16.641986 24779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:16.642093 24779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:16.642206 24779 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:36:16.642292 24779 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:36:16.651978 24779 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40621
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:16.653355 24779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:16.654683 24779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:16.666723 24788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:16.666859 24787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:16.666859 24793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:16.668149 24779 server_base.cc:1034] running on GCE node
I20260808 02:36:16.669013 24779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:16.670508 24779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:16.671715 24779 hybrid_clock.cc:648] HybridClock initialized: now 1786156576671672 us; error 39 us; skew 500 ppm
I20260808 02:36:16.672114 24779 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:16 dist-test-slave-45dx krb5kdc[24752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156576, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:16.675374 24779 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 02:36:16.677064 24779 webserver.cc:460] Webserver started at http://127.0.0.1:42673/ using document root <none> and password file <none>
I20260808 02:36:16.677743 24779 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:16.677906 24779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:16.678237 24779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:16.681309 24779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "3d3fe6dd789a4123b7a6b30bb573701a"
format_stamp: "Formatted at 2026-08-08 02:36:16 on dist-test-slave-45dx"
server_key: "dce275e49f130c79f0dd7f486f70573e"
server_key_iv: "9797c26e7cc04c1b60fcf006beecbcb6"
server_key_version: "encryptionkey@0"
I20260808 02:36:16.682107 24779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "3d3fe6dd789a4123b7a6b30bb573701a"
format_stamp: "Formatted at 2026-08-08 02:36:16 on dist-test-slave-45dx"
server_key: "dce275e49f130c79f0dd7f486f70573e"
server_key_iv: "9797c26e7cc04c1b60fcf006beecbcb6"
server_key_version: "encryptionkey@0"
I20260808 02:36:16.687258 24779 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260808 02:36:16.690842 24809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:16.692185 24779 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 02:36:16.692405 24779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "3d3fe6dd789a4123b7a6b30bb573701a"
format_stamp: "Formatted at 2026-08-08 02:36:16 on dist-test-slave-45dx"
server_key: "dce275e49f130c79f0dd7f486f70573e"
server_key_iv: "9797c26e7cc04c1b60fcf006beecbcb6"
server_key_version: "encryptionkey@0"
I20260808 02:36:16.692636 24779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:16.698378 24779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:16.702546 24779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:16.702862 24779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:16.722501 24779 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40621
I20260808 02:36:16.722590 24884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40621 every 8 connection(s)
I20260808 02:36:16.723938 24779 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:36:16.727833 24886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:16.733767 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 24779
I20260808 02:36:16.733982 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:36:16.734592 25043 external_mini_cluster.cc:1428] Setting key f6c85fceb5392653daf75562455a7d14
I20260808 02:36:16.740402 24886 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d3fe6dd789a4123b7a6b30bb573701a: Bootstrap starting.
I20260808 02:36:16.742653 24889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:16.736600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55175 (local address 127.0.0.1:40621)
0808 02:36:16.737408 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:16.737419 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:16.737463 (+ 44us) server_negotiation.cc:407] Connection header received
0808 02:36:16.739221 (+ 1758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:16.739244 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:16.739556 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:16.739960 (+ 404us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:16.741081 (+ 1121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:16.741087 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:16.741099 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:16.741113 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:16.741164 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:16.741187 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:16.741418 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:16.741557 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 02:36:16.741746 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":592,"thread_start_us":356,"threads_started":1}
I20260808 02:36:16.743952 24886 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d3fe6dd789a4123b7a6b30bb573701a: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:16.745262 24886 log.cc:824] T 00000000000000000000000000000000 P 3d3fe6dd789a4123b7a6b30bb573701a: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:16.746369 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:36:16.748420 24886 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d3fe6dd789a4123b7a6b30bb573701a: No bootstrap required, opened a new log
I20260808 02:36:16.753832 24889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:16.751069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56661 (local address 127.0.0.1:40621)
0808 02:36:16.751284 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:16.751292 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:16.751591 (+ 299us) server_negotiation.cc:407] Connection header received
0808 02:36:16.751806 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:16.751811 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:16.751875 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:16.751986 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:16.753104 (+ 1118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:16.753110 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:16.753115 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:16.753139 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:16.753184 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:16.753200 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:16.753335 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:16.753487 (+ 152us) server_negotiation.cc:299] Negotiation successful
0808 02:36:16.753553 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 02:36:16.757712 24886 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d3fe6dd789a4123b7a6b30bb573701a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d3fe6dd789a4123b7a6b30bb573701a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40621 } }
I20260808 02:36:16.758150 24886 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d3fe6dd789a4123b7a6b30bb573701a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:16.758280 24886 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d3fe6dd789a4123b7a6b30bb573701a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3fe6dd789a4123b7a6b30bb573701a, State: Initialized, Role: FOLLOWER
I20260808 02:36:16.758941 24886 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d3fe6dd789a4123b7a6b30bb573701a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d3fe6dd789a4123b7a6b30bb573701a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40621 } }
I20260808 02:36:16.759213 24886 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3d3fe6dd789a4123b7a6b30bb573701a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:36:16.759383 24886 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d3fe6dd789a4123b7a6b30bb573701a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:36:16.759591 24886 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d3fe6dd789a4123b7a6b30bb573701a [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:16.762504 24886 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d3fe6dd789a4123b7a6b30bb573701a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d3fe6dd789a4123b7a6b30bb573701a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40621 } }
I20260808 02:36:16.763025 24886 leader_election.cc:302] T 00000000000000000000000000000000 P 3d3fe6dd789a4123b7a6b30bb573701a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d3fe6dd789a4123b7a6b30bb573701a; no voters:
I20260808 02:36:16.763602 24886 leader_election.cc:288] T 00000000000000000000000000000000 P 3d3fe6dd789a4123b7a6b30bb573701a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:36:16.763757 24897 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d3fe6dd789a4123b7a6b30bb573701a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:36:16.764528 24897 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d3fe6dd789a4123b7a6b30bb573701a [term 1 LEADER]: Becoming Leader. State: Replica: 3d3fe6dd789a4123b7a6b30bb573701a, State: Running, Role: LEADER
I20260808 02:36:16.765147 24897 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d3fe6dd789a4123b7a6b30bb573701a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d3fe6dd789a4123b7a6b30bb573701a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40621 } }
I20260808 02:36:16.766096 24886 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d3fe6dd789a4123b7a6b30bb573701a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:36:16.768106 24900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3fe6dd789a4123b7a6b30bb573701a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d3fe6dd789a4123b7a6b30bb573701a. Latest consensus state: current_term: 1 leader_uuid: "3d3fe6dd789a4123b7a6b30bb573701a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d3fe6dd789a4123b7a6b30bb573701a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40621 } } }
I20260808 02:36:16.768566 24900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3fe6dd789a4123b7a6b30bb573701a [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:16.768723 24898 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3fe6dd789a4123b7a6b30bb573701a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d3fe6dd789a4123b7a6b30bb573701a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d3fe6dd789a4123b7a6b30bb573701a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40621 } } }
I20260808 02:36:16.769136 24898 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3fe6dd789a4123b7a6b30bb573701a [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:16.771080 24907 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:36:16.776633 24907 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:36:16.784874 24907 catalog_manager.cc:1347] Generated new cluster ID: 2bbd07629ba4442c8fdd4d794b64a11d
I20260808 02:36:16.784994 24907 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:36:16.806867 24907 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:36:16.807411 24907 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:36:16.836658 24907 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3d3fe6dd789a4123b7a6b30bb573701a: Generated new TSK 0
I20260808 02:36:16.837847 24907 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:36:16.853479 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 24779
W20260808 02:36:16.854671 24880 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:55175
W20260808 02:36:16.855389 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 24779: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:36:16.855542 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 24779
2026-08-08T02:36:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2305 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:36:16 dist-test-slave-45dx krb5kdc[24936](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:36:16 dist-test-slave-45dx krb5kdc[24936](info): set up 2 sockets
Aug 08 02:36:16 dist-test-slave-45dx krb5kdc[24936](info): commencing operation
krb5kdc: starting...
W20260808 02:36:18.214645 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.309s user 0.001s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:36:18 dist-test-slave-45dx krb5kdc[24936](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156578, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:36:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:36:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 02:36:18.569797 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42635
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42635
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:36:18.928829 24956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:18.929188 24956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:18.929368 24956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:18.936767 24956 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:36:18.936920 24956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:18.937027 24956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:18.937144 24956 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:36:18.937235 24956 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:36:18.947310 24956 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42635
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42635
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:18.948868 24956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:18.950248 24956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:18.963017 24964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:18.962927 24966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:18.962955 24968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:18.963889 24956 server_base.cc:1034] running on GCE node
I20260808 02:36:18.964910 24956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:18.966503 24956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:18.967768 24956 hybrid_clock.cc:648] HybridClock initialized: now 1786156578967729 us; error 57 us; skew 500 ppm
I20260808 02:36:18.968214 24956 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:18 dist-test-slave-45dx krb5kdc[24936](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156578, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:18.971771 24956 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 02:36:18.973394 24956 webserver.cc:460] Webserver started at http://127.0.0.1:42789/ using document root <none> and password file <none>
I20260808 02:36:18.974133 24956 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:18.974248 24956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:18.974538 24956 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:18.978030 24956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "4e573edd276d442ea989e09beff649d8"
format_stamp: "Formatted at 2026-08-08 02:36:18 on dist-test-slave-45dx"
server_key: "6cf8336274a740950299652d5199e9ee"
server_key_iv: "f7ec53eb770c8024a826928744fe2b42"
server_key_version: "encryptionkey@0"
I20260808 02:36:18.978863 24956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "4e573edd276d442ea989e09beff649d8"
format_stamp: "Formatted at 2026-08-08 02:36:18 on dist-test-slave-45dx"
server_key: "6cf8336274a740950299652d5199e9ee"
server_key_iv: "f7ec53eb770c8024a826928744fe2b42"
server_key_version: "encryptionkey@0"
I20260808 02:36:18.984731 24956 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 02:36:18.988534 24980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:18.990000 24956 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:36:18.990224 24956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "4e573edd276d442ea989e09beff649d8"
format_stamp: "Formatted at 2026-08-08 02:36:18 on dist-test-slave-45dx"
server_key: "6cf8336274a740950299652d5199e9ee"
server_key_iv: "f7ec53eb770c8024a826928744fe2b42"
server_key_version: "encryptionkey@0"
I20260808 02:36:18.990463 24956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:19.008725 24956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:19.013197 24956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:19.013527 24956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:19.033931 24956 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42635
I20260808 02:36:19.033967 25076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42635 every 8 connection(s)
I20260808 02:36:19.035475 24956 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:36:19.035748 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 24956
I20260808 02:36:19.035956 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:36:19.036677 25043 external_mini_cluster.cc:1428] Setting key 46d219485e8d6abf28b34f077bb3c3c4
I20260808 02:36:19.041491 25077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 02:36:19 dist-test-slave-45dx krb5kdc[24936](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156578, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 02:36:19.054584 25077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e573edd276d442ea989e09beff649d8: Bootstrap starting.
I20260808 02:36:19.058804 25077 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e573edd276d442ea989e09beff649d8: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:19.060191 25077 log.cc:824] T 00000000000000000000000000000000 P 4e573edd276d442ea989e09beff649d8: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:19.062112 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:19.038444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48441 (local address 127.0.0.1:42635)
0808 02:36:19.039330 (+ 886us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:19.039349 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:19.039403 (+ 54us) server_negotiation.cc:407] Connection header received
0808 02:36:19.041823 (+ 2420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:19.041854 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:19.042367 (+ 513us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:19.042813 (+ 446us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:19.044189 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:19.046281 (+ 2092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:19.047552 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:19.048645 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:19.048808 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:19.053085 (+ 4277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:19.053098 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:19.053116 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:19.053160 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:19.057270 (+ 4110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:19.057984 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:19.057994 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:19.058006 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:19.058213 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:19.058698 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:19.058703 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:19.058728 (+ 25us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:19.059484 (+ 756us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:19.059777 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:19.060290 (+ 513us) server_negotiation.cc:299] Negotiation successful
0808 02:36:19.060813 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":638,"thread_start_us":367,"threads_started":1}
I20260808 02:36:19.063573 25077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e573edd276d442ea989e09beff649d8: No bootstrap required, opened a new log
I20260808 02:36:19.066181 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:36:19.072098 25077 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e573edd276d442ea989e09beff649d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e573edd276d442ea989e09beff649d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42635 } }
I20260808 02:36:19.072606 25077 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e573edd276d442ea989e09beff649d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:19.072718 25077 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e573edd276d442ea989e09beff649d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e573edd276d442ea989e09beff649d8, State: Initialized, Role: FOLLOWER
I20260808 02:36:19.073369 25077 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e573edd276d442ea989e09beff649d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e573edd276d442ea989e09beff649d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42635 } }
I20260808 02:36:19.073688 25077 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e573edd276d442ea989e09beff649d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:36:19.073881 25077 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e573edd276d442ea989e09beff649d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:36:19.074115 25077 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e573edd276d442ea989e09beff649d8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:19.077194 25077 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e573edd276d442ea989e09beff649d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e573edd276d442ea989e09beff649d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42635 } }
I20260808 02:36:19.077859 25077 leader_election.cc:302] T 00000000000000000000000000000000 P 4e573edd276d442ea989e09beff649d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e573edd276d442ea989e09beff649d8; no voters:
I20260808 02:36:19.078562 25077 leader_election.cc:288] T 00000000000000000000000000000000 P 4e573edd276d442ea989e09beff649d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:36:19.078682 25091 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e573edd276d442ea989e09beff649d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:36:19.080392 25091 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e573edd276d442ea989e09beff649d8 [term 1 LEADER]: Becoming Leader. State: Replica: 4e573edd276d442ea989e09beff649d8, State: Running, Role: LEADER
I20260808 02:36:19.081192 25077 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e573edd276d442ea989e09beff649d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:36:19.081053 25091 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e573edd276d442ea989e09beff649d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e573edd276d442ea989e09beff649d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42635 } }
I20260808 02:36:19.084450 25094 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e573edd276d442ea989e09beff649d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e573edd276d442ea989e09beff649d8. Latest consensus state: current_term: 1 leader_uuid: "4e573edd276d442ea989e09beff649d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e573edd276d442ea989e09beff649d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42635 } } }
I20260808 02:36:19.085006 25094 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e573edd276d442ea989e09beff649d8 [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:19.085002 25092 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e573edd276d442ea989e09beff649d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e573edd276d442ea989e09beff649d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e573edd276d442ea989e09beff649d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42635 } } }
I20260808 02:36:19.086352 25092 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e573edd276d442ea989e09beff649d8 [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:19.087908 25099 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:36:19.091470 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:19.070770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59379 (local address 127.0.0.1:42635)
0808 02:36:19.071017 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:19.071026 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:19.071425 (+ 399us) server_negotiation.cc:407] Connection header received
0808 02:36:19.071594 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:19.071598 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:19.071656 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:19.071736 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:19.073873 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:19.074851 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:19.076674 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:19.077164 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:19.077279 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:19.080724 (+ 3445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:19.080729 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:19.080734 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:19.080773 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:19.086147 (+ 5374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:19.088057 (+ 1910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:19.088067 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:19.088073 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:19.088395 (+ 322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:19.089030 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:19.089038 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:19.089041 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:19.089657 (+ 616us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:19.090002 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:19.090388 (+ 386us) server_negotiation.cc:299] Negotiation successful
0808 02:36:19.090738 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 02:36:19.096225 25099 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:36:19.106666 25099 catalog_manager.cc:1347] Generated new cluster ID: 02baa0d1e68048509f2f399ce8377c6d
I20260808 02:36:19.106788 25099 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:36:19.131711 25099 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:36:19.133613 25099 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:36:19.143443 25099 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4e573edd276d442ea989e09beff649d8: Generated new TSK 0
I20260808 02:36:19.144820 25099 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:36:19.161154 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 24956
I20260808 02:36:19.162478 25067 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:36:19.256735 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 24956
2026-08-08T02:36:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2398 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:36:19 dist-test-slave-45dx krb5kdc[25128](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:36:19 dist-test-slave-45dx krb5kdc[25128](info): set up 2 sockets
Aug 08 02:36:19 dist-test-slave-45dx krb5kdc[25128](info): commencing operation
krb5kdc: starting...
W20260808 02:36:20.612051 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.308s user 0.003s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:36:20 dist-test-slave-45dx krb5kdc[25128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:36:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:36:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 02:36:20.960475 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44923
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44923
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:36:21.313900 25156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:21.314198 25156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:21.314360 25156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:21.321632 25156 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:36:21.321763 25156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:21.321908 25156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:21.322024 25156 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:36:21.322090 25156 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:36:21.331884 25156 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44923
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:21.333242 25156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:21.334627 25156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:21.346889 25166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:21.347024 25168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:21.347780 25164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:21.347827 25156 server_base.cc:1034] running on GCE node
I20260808 02:36:21.348798 25156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:21.350215 25156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:21.351464 25156 hybrid_clock.cc:648] HybridClock initialized: now 1786156581351421 us; error 63 us; skew 500 ppm
I20260808 02:36:21.351838 25156 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:21 dist-test-slave-45dx krb5kdc[25128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156581, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:21.360000 25156 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 02:36:21.361611 25156 webserver.cc:460] Webserver started at http://127.0.0.1:41939/ using document root <none> and password file <none>
I20260808 02:36:21.362286 25156 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:21.362403 25156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:21.362668 25156 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:21.365721 25156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "ed4a9e8ab1b4419483177ee2dbfe3ccc"
format_stamp: "Formatted at 2026-08-08 02:36:21 on dist-test-slave-45dx"
server_key: "33e59dc72c56b88518b37b850d596d77"
server_key_iv: "2a2de4d52a54617a1761cc4e51e75e07"
server_key_version: "encryptionkey@0"
I20260808 02:36:21.366466 25156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "ed4a9e8ab1b4419483177ee2dbfe3ccc"
format_stamp: "Formatted at 2026-08-08 02:36:21 on dist-test-slave-45dx"
server_key: "33e59dc72c56b88518b37b850d596d77"
server_key_iv: "2a2de4d52a54617a1761cc4e51e75e07"
server_key_version: "encryptionkey@0"
I20260808 02:36:21.371598 25156 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 02:36:21.375082 25177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:21.376466 25156 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 02:36:21.376602 25156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "ed4a9e8ab1b4419483177ee2dbfe3ccc"
format_stamp: "Formatted at 2026-08-08 02:36:21 on dist-test-slave-45dx"
server_key: "33e59dc72c56b88518b37b850d596d77"
server_key_iv: "2a2de4d52a54617a1761cc4e51e75e07"
server_key_version: "encryptionkey@0"
I20260808 02:36:21.376766 25156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:21.396076 25156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:21.400241 25156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:21.400573 25156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:21.419569 25156 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44923
I20260808 02:36:21.419610 25259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44923 every 8 connection(s)
I20260808 02:36:21.421104 25156 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:36:21.424877 25260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:21.425619 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 25156
I20260808 02:36:21.425823 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:36:21.426299 25043 external_mini_cluster.cc:1428] Setting key 19cfb7ed067c92af329951af2773475d
I20260808 02:36:21.440660 25260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed4a9e8ab1b4419483177ee2dbfe3ccc: Bootstrap starting.
I20260808 02:36:21.441780 25266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:21.428253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56699 (local address 127.0.0.1:44923)
0808 02:36:21.429137 (+ 884us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:21.429153 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:21.429205 (+ 52us) server_negotiation.cc:407] Connection header received
0808 02:36:21.431324 (+ 2119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:21.431355 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:21.431885 (+ 530us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:21.432366 (+ 481us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:21.432904 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:21.434873 (+ 1969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:21.436434 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:21.437530 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:21.437728 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:21.438929 (+ 1201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:21.438940 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:21.438958 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:21.439691 (+ 733us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:21.439786 (+ 95us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:21.439817 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:21.439942 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:21.440160 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 02:36:21.440463 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":318,"threads_started":1}
I20260808 02:36:21.444752 25260 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed4a9e8ab1b4419483177ee2dbfe3ccc: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:21.446219 25260 log.cc:824] T 00000000000000000000000000000000 P ed4a9e8ab1b4419483177ee2dbfe3ccc: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:21.446379 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:36:21.449527 25260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed4a9e8ab1b4419483177ee2dbfe3ccc: No bootstrap required, opened a new log
I20260808 02:36:21.458714 25266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:21.451492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51567 (local address 127.0.0.1:44923)
0808 02:36:21.451750 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:21.451774 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:21.452370 (+ 596us) server_negotiation.cc:407] Connection header received
0808 02:36:21.452596 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:21.452604 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:21.452690 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:21.452800 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:21.453361 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:21.454481 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:21.455870 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:21.456606 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:21.456739 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:21.457942 (+ 1203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:21.457949 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:21.457954 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:21.457975 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:21.458029 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:21.458051 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:21.458155 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:21.458276 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 02:36:21.458373 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 02:36:21.459224 25260 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed4a9e8ab1b4419483177ee2dbfe3ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed4a9e8ab1b4419483177ee2dbfe3ccc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44923 } }
I20260808 02:36:21.459774 25260 raft_consensus.cc:374] T 00000000000000000000000000000000 P ed4a9e8ab1b4419483177ee2dbfe3ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:21.459884 25260 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed4a9e8ab1b4419483177ee2dbfe3ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4a9e8ab1b4419483177ee2dbfe3ccc, State: Initialized, Role: FOLLOWER
I20260808 02:36:21.460630 25260 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed4a9e8ab1b4419483177ee2dbfe3ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed4a9e8ab1b4419483177ee2dbfe3ccc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44923 } }
I20260808 02:36:21.460857 25260 raft_consensus.cc:388] T 00000000000000000000000000000000 P ed4a9e8ab1b4419483177ee2dbfe3ccc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:36:21.460968 25260 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed4a9e8ab1b4419483177ee2dbfe3ccc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:36:21.461091 25260 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed4a9e8ab1b4419483177ee2dbfe3ccc [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:21.463284 25260 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed4a9e8ab1b4419483177ee2dbfe3ccc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed4a9e8ab1b4419483177ee2dbfe3ccc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44923 } }
I20260808 02:36:21.463794 25260 leader_election.cc:302] T 00000000000000000000000000000000 P ed4a9e8ab1b4419483177ee2dbfe3ccc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed4a9e8ab1b4419483177ee2dbfe3ccc; no voters:
I20260808 02:36:21.464407 25260 leader_election.cc:288] T 00000000000000000000000000000000 P ed4a9e8ab1b4419483177ee2dbfe3ccc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:36:21.464553 25275 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed4a9e8ab1b4419483177ee2dbfe3ccc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:36:21.466137 25275 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed4a9e8ab1b4419483177ee2dbfe3ccc [term 1 LEADER]: Becoming Leader. State: Replica: ed4a9e8ab1b4419483177ee2dbfe3ccc, State: Running, Role: LEADER
I20260808 02:36:21.466805 25260 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed4a9e8ab1b4419483177ee2dbfe3ccc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:36:21.466753 25275 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed4a9e8ab1b4419483177ee2dbfe3ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed4a9e8ab1b4419483177ee2dbfe3ccc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44923 } }
I20260808 02:36:21.470002 25280 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed4a9e8ab1b4419483177ee2dbfe3ccc [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed4a9e8ab1b4419483177ee2dbfe3ccc. Latest consensus state: current_term: 1 leader_uuid: "ed4a9e8ab1b4419483177ee2dbfe3ccc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed4a9e8ab1b4419483177ee2dbfe3ccc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44923 } } }
I20260808 02:36:21.470124 25278 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed4a9e8ab1b4419483177ee2dbfe3ccc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ed4a9e8ab1b4419483177ee2dbfe3ccc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed4a9e8ab1b4419483177ee2dbfe3ccc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44923 } } }
I20260808 02:36:21.470448 25280 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed4a9e8ab1b4419483177ee2dbfe3ccc [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:21.470448 25278 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed4a9e8ab1b4419483177ee2dbfe3ccc [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:21.472919 25288 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:36:21.478428 25288 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:36:21.487159 25288 catalog_manager.cc:1347] Generated new cluster ID: e3593bd4b1a6400f97a468a2c366350d
I20260808 02:36:21.487293 25288 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:36:21.504698 25288 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:36:21.506079 25288 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:36:21.518035 25288 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ed4a9e8ab1b4419483177ee2dbfe3ccc: Generated new TSK 0
I20260808 02:36:21.518890 25288 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:36:21.527873 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 25156
W20260808 02:36:21.528996 25255 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:56699
W20260808 02:36:21.529793 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 25156: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:36:21.529963 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 25156
2026-08-08T02:36:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2274 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:36:21 dist-test-slave-45dx krb5kdc[25310](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:36:21 dist-test-slave-45dx krb5kdc[25310](info): set up 2 sockets
Aug 08 02:36:21 dist-test-slave-45dx krb5kdc[25310](info): commencing operation
krb5kdc: starting...
W20260808 02:36:22.909353 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.330s user 0.000s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:36:23 dist-test-slave-45dx krb5kdc[25310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:36:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:36:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 02:36:23.267535 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34699
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34699
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:36:23.628722 25329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:23.629036 25329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:23.629215 25329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:23.636430 25329 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:36:23.636539 25329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:23.636636 25329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:23.636758 25329 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:36:23.636821 25329 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:36:23.647337 25329 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34699
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:23.648708 25329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:23.650032 25329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:23.662051 25335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:23.662047 25338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:23.662400 25336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:23.662994 25329 server_base.cc:1034] running on GCE node
I20260808 02:36:23.663838 25329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:23.665349 25329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:23.666599 25329 hybrid_clock.cc:648] HybridClock initialized: now 1786156583666541 us; error 50 us; skew 500 ppm
I20260808 02:36:23.666967 25329 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:23 dist-test-slave-45dx krb5kdc[25310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156583, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:23.670298 25329 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 02:36:23.671881 25329 webserver.cc:460] Webserver started at http://127.0.0.1:34335/ using document root <none> and password file <none>
I20260808 02:36:23.672670 25329 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:23.672832 25329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:23.673171 25329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:23.676404 25329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "05ae23416aa94c23b6075fcbfffbfc8d"
format_stamp: "Formatted at 2026-08-08 02:36:23 on dist-test-slave-45dx"
server_key: "dff08dec4df6ffb3a6f3082e90935964"
server_key_iv: "08f5840e62e39b79f15a6df75d9785e5"
server_key_version: "encryptionkey@0"
I20260808 02:36:23.677261 25329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "05ae23416aa94c23b6075fcbfffbfc8d"
format_stamp: "Formatted at 2026-08-08 02:36:23 on dist-test-slave-45dx"
server_key: "dff08dec4df6ffb3a6f3082e90935964"
server_key_iv: "08f5840e62e39b79f15a6df75d9785e5"
server_key_version: "encryptionkey@0"
I20260808 02:36:23.682802 25329 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 02:36:23.686547 25348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:23.687875 25329 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 02:36:23.688081 25329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "05ae23416aa94c23b6075fcbfffbfc8d"
format_stamp: "Formatted at 2026-08-08 02:36:23 on dist-test-slave-45dx"
server_key: "dff08dec4df6ffb3a6f3082e90935964"
server_key_iv: "08f5840e62e39b79f15a6df75d9785e5"
server_key_version: "encryptionkey@0"
I20260808 02:36:23.688294 25329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:23.695305 25329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:23.699510 25329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:23.699820 25329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:23.719202 25329 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34699
I20260808 02:36:23.719290 25423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34699 every 8 connection(s)
I20260808 02:36:23.720710 25329 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:36:23.722648 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 25329
I20260808 02:36:23.722872 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:36:23.723325 25043 external_mini_cluster.cc:1428] Setting key f5daa7c667dcd5998cd92204bab9734e
I20260808 02:36:23.725063 25424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:23.732010 25427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:23.725173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39899 (local address 127.0.0.1:34699)
0808 02:36:23.726040 (+ 867us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:23.726058 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:23.726109 (+ 51us) server_negotiation.cc:407] Connection header received
0808 02:36:23.728191 (+ 2082us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:23.728218 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:23.728693 (+ 475us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:23.729122 (+ 429us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:23.730105 (+ 983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:23.730114 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:23.730137 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:23.730153 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:23.730252 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:23.730277 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:23.730494 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:23.730637 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 02:36:23.730822 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":615,"thread_start_us":376,"threads_started":1}
I20260808 02:36:23.735673 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:36:23.738873 25424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05ae23416aa94c23b6075fcbfffbfc8d: Bootstrap starting.
I20260808 02:36:23.742436 25424 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05ae23416aa94c23b6075fcbfffbfc8d: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:23.742650 25427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:23.740166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39715 (local address 127.0.0.1:34699)
0808 02:36:23.740383 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:23.740391 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:23.740687 (+ 296us) server_negotiation.cc:407] Connection header received
0808 02:36:23.740818 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:23.740822 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:23.740877 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:23.740994 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:23.741929 (+ 935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:23.741935 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:23.741939 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:23.741956 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:23.742004 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:23.742024 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:23.742143 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:23.742245 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 02:36:23.742305 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 02:36:23.743613 25424 log.cc:824] T 00000000000000000000000000000000 P 05ae23416aa94c23b6075fcbfffbfc8d: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:23.746425 25424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05ae23416aa94c23b6075fcbfffbfc8d: No bootstrap required, opened a new log
I20260808 02:36:23.754212 25424 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05ae23416aa94c23b6075fcbfffbfc8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05ae23416aa94c23b6075fcbfffbfc8d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34699 } }
I20260808 02:36:23.754557 25424 raft_consensus.cc:374] T 00000000000000000000000000000000 P 05ae23416aa94c23b6075fcbfffbfc8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:23.754638 25424 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05ae23416aa94c23b6075fcbfffbfc8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05ae23416aa94c23b6075fcbfffbfc8d, State: Initialized, Role: FOLLOWER
I20260808 02:36:23.755125 25424 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05ae23416aa94c23b6075fcbfffbfc8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05ae23416aa94c23b6075fcbfffbfc8d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34699 } }
I20260808 02:36:23.755328 25424 raft_consensus.cc:388] T 00000000000000000000000000000000 P 05ae23416aa94c23b6075fcbfffbfc8d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:36:23.755429 25424 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05ae23416aa94c23b6075fcbfffbfc8d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:36:23.755594 25424 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05ae23416aa94c23b6075fcbfffbfc8d [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:23.758134 25424 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05ae23416aa94c23b6075fcbfffbfc8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05ae23416aa94c23b6075fcbfffbfc8d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34699 } }
I20260808 02:36:23.758589 25424 leader_election.cc:302] T 00000000000000000000000000000000 P 05ae23416aa94c23b6075fcbfffbfc8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05ae23416aa94c23b6075fcbfffbfc8d; no voters:
I20260808 02:36:23.759146 25424 leader_election.cc:288] T 00000000000000000000000000000000 P 05ae23416aa94c23b6075fcbfffbfc8d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:36:23.759307 25436 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05ae23416aa94c23b6075fcbfffbfc8d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:36:23.760022 25436 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05ae23416aa94c23b6075fcbfffbfc8d [term 1 LEADER]: Becoming Leader. State: Replica: 05ae23416aa94c23b6075fcbfffbfc8d, State: Running, Role: LEADER
I20260808 02:36:23.760592 25436 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05ae23416aa94c23b6075fcbfffbfc8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05ae23416aa94c23b6075fcbfffbfc8d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34699 } }
I20260808 02:36:23.761281 25424 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05ae23416aa94c23b6075fcbfffbfc8d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:36:23.763728 25438 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05ae23416aa94c23b6075fcbfffbfc8d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05ae23416aa94c23b6075fcbfffbfc8d. Latest consensus state: current_term: 1 leader_uuid: "05ae23416aa94c23b6075fcbfffbfc8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05ae23416aa94c23b6075fcbfffbfc8d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34699 } } }
I20260808 02:36:23.764245 25438 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05ae23416aa94c23b6075fcbfffbfc8d [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:23.764621 25437 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05ae23416aa94c23b6075fcbfffbfc8d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05ae23416aa94c23b6075fcbfffbfc8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05ae23416aa94c23b6075fcbfffbfc8d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34699 } } }
I20260808 02:36:23.764987 25437 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05ae23416aa94c23b6075fcbfffbfc8d [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:23.766570 25451 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:36:23.771193 25451 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:36:23.780215 25451 catalog_manager.cc:1347] Generated new cluster ID: b16e5bb74b264a59bc1e487b75df9671
I20260808 02:36:23.780362 25451 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:36:23.806071 25451 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:36:23.806562 25451 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:36:23.815029 25451 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 05ae23416aa94c23b6075fcbfffbfc8d: Generated new TSK 0
I20260808 02:36:23.816090 25451 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:36:23.822391 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 25329
W20260808 02:36:23.823576 25419 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:39899
W20260808 02:36:23.824366 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 25329: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:36:23.824527 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 25329
2026-08-08T02:36:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2293 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:36:23 dist-test-slave-45dx krb5kdc[25471](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:36:23 dist-test-slave-45dx krb5kdc[25471](info): set up 2 sockets
Aug 08 02:36:23 dist-test-slave-45dx krb5kdc[25471](info): commencing operation
krb5kdc: starting...
W20260808 02:36:25.194367 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.322s user 0.000s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:36:25 dist-test-slave-45dx krb5kdc[25471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:36:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:36:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 02:36:25.557312 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39989
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39989
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:36:25.910066 25489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:25.910377 25489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:25.910574 25489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:25.917761 25489 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:36:25.917897 25489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:25.917996 25489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:25.918102 25489 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:36:25.918180 25489 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:36:25.927799 25489 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39989
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39989
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:25.929162 25489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:25.930469 25489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:25.942617 25496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:25.942703 25497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:25.942866 25499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:25.943840 25489 server_base.cc:1034] running on GCE node
I20260808 02:36:25.944658 25489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:25.946022 25489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:25.947286 25489 hybrid_clock.cc:648] HybridClock initialized: now 1786156585947222 us; error 54 us; skew 500 ppm
I20260808 02:36:25.947839 25489 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:25 dist-test-slave-45dx krb5kdc[25471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156585, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:25.951264 25489 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 02:36:25.952769 25489 webserver.cc:460] Webserver started at http://127.0.0.1:44203/ using document root <none> and password file <none>
I20260808 02:36:25.953565 25489 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:25.953680 25489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:25.953969 25489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:25.956998 25489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "0e7054c3044a4bc29cf1a7b8c7af7eba"
format_stamp: "Formatted at 2026-08-08 02:36:25 on dist-test-slave-45dx"
server_key: "16bfb98ed94cba5354663d15e44ec97b"
server_key_iv: "495d7ba450d464c13b923e67a39e6759"
server_key_version: "encryptionkey@0"
I20260808 02:36:25.957759 25489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "0e7054c3044a4bc29cf1a7b8c7af7eba"
format_stamp: "Formatted at 2026-08-08 02:36:25 on dist-test-slave-45dx"
server_key: "16bfb98ed94cba5354663d15e44ec97b"
server_key_iv: "495d7ba450d464c13b923e67a39e6759"
server_key_version: "encryptionkey@0"
I20260808 02:36:25.962993 25489 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 02:36:25.966354 25511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:25.967613 25489 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 02:36:25.967797 25489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "0e7054c3044a4bc29cf1a7b8c7af7eba"
format_stamp: "Formatted at 2026-08-08 02:36:25 on dist-test-slave-45dx"
server_key: "16bfb98ed94cba5354663d15e44ec97b"
server_key_iv: "495d7ba450d464c13b923e67a39e6759"
server_key_version: "encryptionkey@0"
I20260808 02:36:25.968015 25489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:26.000881 25489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:26.005120 25489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:26.005491 25489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:26.024602 25489 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39989
I20260808 02:36:26.024652 25586 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39989 every 8 connection(s)
I20260808 02:36:26.026007 25489 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:36:26.029701 25587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:26.031477 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 25489
I20260808 02:36:26.031658 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:36:26.032245 25043 external_mini_cluster.cc:1428] Setting key 3c9593a4f36690797e4c173fce64e351
I20260808 02:36:26.044265 25587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e7054c3044a4bc29cf1a7b8c7af7eba: Bootstrap starting.
Aug 08 02:36:26 dist-test-slave-45dx krb5kdc[25471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 02:36:26.048022 25587 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e7054c3044a4bc29cf1a7b8c7af7eba: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:26.049316 25587 log.cc:824] T 00000000000000000000000000000000 P 0e7054c3044a4bc29cf1a7b8c7af7eba: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:26.052201 25587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e7054c3044a4bc29cf1a7b8c7af7eba: No bootstrap required, opened a new log
I20260808 02:36:26.055997 25592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:26.034221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:57493 (local address 127.0.0.1:39989)
0808 02:36:26.035045 (+ 824us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:26.035060 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:26.035101 (+ 41us) server_negotiation.cc:407] Connection header received
0808 02:36:26.036781 (+ 1680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:26.036805 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:26.037190 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:26.037510 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:26.039297 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:26.040671 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:26.042475 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:26.043106 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:26.043233 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:26.048254 (+ 5021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:26.048264 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:26.048279 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:26.048379 (+ 100us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:26.051565 (+ 3186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:26.052411 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:26.052418 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:26.052424 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:26.052592 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:26.053115 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:26.053125 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:26.053127 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:26.053770 (+ 643us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:26.054143 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:26.054641 (+ 498us) server_negotiation.cc:299] Negotiation successful
0808 02:36:26.055002 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":377,"threads_started":1}
I20260808 02:36:26.060051 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:36:26.060868 25587 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e7054c3044a4bc29cf1a7b8c7af7eba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e7054c3044a4bc29cf1a7b8c7af7eba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39989 } }
I20260808 02:36:26.061331 25587 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0e7054c3044a4bc29cf1a7b8c7af7eba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:26.061421 25587 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e7054c3044a4bc29cf1a7b8c7af7eba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e7054c3044a4bc29cf1a7b8c7af7eba, State: Initialized, Role: FOLLOWER
I20260808 02:36:26.062103 25587 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e7054c3044a4bc29cf1a7b8c7af7eba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e7054c3044a4bc29cf1a7b8c7af7eba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39989 } }
I20260808 02:36:26.062364 25587 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e7054c3044a4bc29cf1a7b8c7af7eba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:36:26.062506 25587 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e7054c3044a4bc29cf1a7b8c7af7eba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:36:26.062683 25587 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e7054c3044a4bc29cf1a7b8c7af7eba [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:26.065341 25587 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e7054c3044a4bc29cf1a7b8c7af7eba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e7054c3044a4bc29cf1a7b8c7af7eba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39989 } }
I20260808 02:36:26.065970 25587 leader_election.cc:302] T 00000000000000000000000000000000 P 0e7054c3044a4bc29cf1a7b8c7af7eba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e7054c3044a4bc29cf1a7b8c7af7eba; no voters:
I20260808 02:36:26.066700 25587 leader_election.cc:288] T 00000000000000000000000000000000 P 0e7054c3044a4bc29cf1a7b8c7af7eba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:36:26.066809 25605 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e7054c3044a4bc29cf1a7b8c7af7eba [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:36:26.068611 25605 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e7054c3044a4bc29cf1a7b8c7af7eba [term 1 LEADER]: Becoming Leader. State: Replica: 0e7054c3044a4bc29cf1a7b8c7af7eba, State: Running, Role: LEADER
I20260808 02:36:26.069393 25587 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e7054c3044a4bc29cf1a7b8c7af7eba [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:36:26.069253 25605 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e7054c3044a4bc29cf1a7b8c7af7eba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e7054c3044a4bc29cf1a7b8c7af7eba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39989 } }
I20260808 02:36:26.072772 25606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e7054c3044a4bc29cf1a7b8c7af7eba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e7054c3044a4bc29cf1a7b8c7af7eba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e7054c3044a4bc29cf1a7b8c7af7eba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39989 } } }
I20260808 02:36:26.072834 25608 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e7054c3044a4bc29cf1a7b8c7af7eba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e7054c3044a4bc29cf1a7b8c7af7eba. Latest consensus state: current_term: 1 leader_uuid: "0e7054c3044a4bc29cf1a7b8c7af7eba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e7054c3044a4bc29cf1a7b8c7af7eba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39989 } } }
I20260808 02:36:26.073163 25606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e7054c3044a4bc29cf1a7b8c7af7eba [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:26.073249 25608 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e7054c3044a4bc29cf1a7b8c7af7eba [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:26.083348 25592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:26.065116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:40253 (local address 127.0.0.1:39989)
0808 02:36:26.065322 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:26.065334 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:26.065856 (+ 522us) server_negotiation.cc:407] Connection header received
0808 02:36:26.066007 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:26.066012 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:26.066094 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:26.066208 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:26.068073 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:26.069192 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:26.070525 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:26.071546 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:26.071722 (+ 176us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:26.076655 (+ 4933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:26.076660 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:26.076663 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:26.076694 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:26.079569 (+ 2875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:26.080415 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:26.080419 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:26.080422 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:26.080536 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:26.081028 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:26.081032 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:26.081034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:26.081324 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:26.082788 (+ 1464us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:26.082956 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 02:36:26.083092 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 02:36:26.089382 25617 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:36:26.094771 25617 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:36:26.104892 25617 catalog_manager.cc:1347] Generated new cluster ID: 88a7da9254a948e38a37e5c9e5381efb
I20260808 02:36:26.105029 25617 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:36:26.129053 25617 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:36:26.130366 25617 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:36:26.138902 25617 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0e7054c3044a4bc29cf1a7b8c7af7eba: Generated new TSK 0
I20260808 02:36:26.139722 25617 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:36:26.151497 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 25489
I20260808 02:36:26.153489 25577 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:36:26.246337 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 25489
W20260808 02:36:26.273278 25468 connection.cc:535] client connection to 127.0.0.1:39989 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39989): Connection reset by peer (error 104)
2026-08-08T02:36:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2420 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:36:26 dist-test-slave-45dx krb5kdc[25634](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:36:26 dist-test-slave-45dx krb5kdc[25634](info): set up 2 sockets
Aug 08 02:36:26 dist-test-slave-45dx krb5kdc[25634](info): commencing operation
krb5kdc: starting...
W20260808 02:36:27.605165 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.312s user 0.000s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:36:27 dist-test-slave-45dx krb5kdc[25634](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:36:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:36:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 02:36:27.968205 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46243
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46243
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:36:28.332993 25652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:28.333335 25652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:28.333506 25652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:28.340729 25652 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:36:28.340894 25652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:28.340981 25652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:28.341076 25652 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:36:28.341161 25652 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:36:28.350966 25652 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46243
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:28.352336 25652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:28.353677 25652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:28.366411 25658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:28.366541 25662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:28.366801 25660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:28.367796 25652 server_base.cc:1034] running on GCE node
I20260808 02:36:28.368737 25652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:28.370257 25652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:28.371542 25652 hybrid_clock.cc:648] HybridClock initialized: now 1786156588371495 us; error 51 us; skew 500 ppm
I20260808 02:36:28.372072 25652 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:28 dist-test-slave-45dx krb5kdc[25634](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156588, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:28.381004 25652 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 02:36:28.382702 25652 webserver.cc:460] Webserver started at http://127.0.0.1:38383/ using document root <none> and password file <none>
I20260808 02:36:28.383443 25652 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:28.383602 25652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:28.383932 25652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:28.387089 25652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "eed99bf4eb0349bcb4a0602245eb3906"
format_stamp: "Formatted at 2026-08-08 02:36:28 on dist-test-slave-45dx"
server_key: "832ee95cb1e756d051907367115fcee9"
server_key_iv: "7171cf86293756c786649fbb88d47992"
server_key_version: "encryptionkey@0"
I20260808 02:36:28.387923 25652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "eed99bf4eb0349bcb4a0602245eb3906"
format_stamp: "Formatted at 2026-08-08 02:36:28 on dist-test-slave-45dx"
server_key: "832ee95cb1e756d051907367115fcee9"
server_key_iv: "7171cf86293756c786649fbb88d47992"
server_key_version: "encryptionkey@0"
I20260808 02:36:28.393404 25652 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 02:36:28.397018 25671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:28.398352 25652 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:36:28.398550 25652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "eed99bf4eb0349bcb4a0602245eb3906"
format_stamp: "Formatted at 2026-08-08 02:36:28 on dist-test-slave-45dx"
server_key: "832ee95cb1e756d051907367115fcee9"
server_key_iv: "7171cf86293756c786649fbb88d47992"
server_key_version: "encryptionkey@0"
I20260808 02:36:28.398756 25652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:28.429230 25652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:28.434047 25652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:28.434376 25652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:28.453886 25652 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46243
I20260808 02:36:28.453938 25742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46243 every 8 connection(s)
I20260808 02:36:28.455387 25652 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:36:28.459335 25743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:28.464733 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 25652
I20260808 02:36:28.464951 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:36:28.465405 25043 external_mini_cluster.cc:1428] Setting key a904c3769bcd7cfa7bba594d3b75e4c3
I20260808 02:36:28.471885 25743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eed99bf4eb0349bcb4a0602245eb3906: Bootstrap starting.
I20260808 02:36:28.476030 25743 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eed99bf4eb0349bcb4a0602245eb3906: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:28.477545 25743 log.cc:824] T 00000000000000000000000000000000 P eed99bf4eb0349bcb4a0602245eb3906: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:28.479939 25749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:28.467349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:52963 (local address 127.0.0.1:46243)
0808 02:36:28.468209 (+ 860us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:28.468221 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:28.468265 (+ 44us) server_negotiation.cc:407] Connection header received
0808 02:36:28.470072 (+ 1807us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:28.470095 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:28.470487 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:28.470793 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:28.471524 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:28.472960 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:28.475096 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:28.475751 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:28.475882 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:28.477431 (+ 1549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:28.477438 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:28.477452 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:28.478073 (+ 621us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:28.478195 (+ 122us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:28.478234 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:28.478446 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:28.478752 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 02:36:28.478952 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":627,"thread_start_us":387,"threads_started":1}
I20260808 02:36:28.480803 25743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eed99bf4eb0349bcb4a0602245eb3906: No bootstrap required, opened a new log
I20260808 02:36:28.484107 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:36:28.489027 25743 raft_consensus.cc:348] T 00000000000000000000000000000000 P eed99bf4eb0349bcb4a0602245eb3906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eed99bf4eb0349bcb4a0602245eb3906" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46243 } }
I20260808 02:36:28.489580 25743 raft_consensus.cc:374] T 00000000000000000000000000000000 P eed99bf4eb0349bcb4a0602245eb3906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:28.489710 25743 raft_consensus.cc:729] T 00000000000000000000000000000000 P eed99bf4eb0349bcb4a0602245eb3906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eed99bf4eb0349bcb4a0602245eb3906, State: Initialized, Role: FOLLOWER
I20260808 02:36:28.490496 25743 consensus_queue.cc:260] T 00000000000000000000000000000000 P eed99bf4eb0349bcb4a0602245eb3906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eed99bf4eb0349bcb4a0602245eb3906" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46243 } }
I20260808 02:36:28.490847 25743 raft_consensus.cc:388] T 00000000000000000000000000000000 P eed99bf4eb0349bcb4a0602245eb3906 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:36:28.491050 25743 raft_consensus.cc:482] T 00000000000000000000000000000000 P eed99bf4eb0349bcb4a0602245eb3906 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:36:28.491256 25743 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eed99bf4eb0349bcb4a0602245eb3906 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:28.494537 25743 raft_consensus.cc:504] T 00000000000000000000000000000000 P eed99bf4eb0349bcb4a0602245eb3906 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eed99bf4eb0349bcb4a0602245eb3906" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46243 } }
I20260808 02:36:28.495205 25743 leader_election.cc:302] T 00000000000000000000000000000000 P eed99bf4eb0349bcb4a0602245eb3906 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eed99bf4eb0349bcb4a0602245eb3906; no voters:
I20260808 02:36:28.495976 25743 leader_election.cc:288] T 00000000000000000000000000000000 P eed99bf4eb0349bcb4a0602245eb3906 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:36:28.496090 25760 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eed99bf4eb0349bcb4a0602245eb3906 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:36:28.496676 25749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:28.488908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:41983 (local address 127.0.0.1:46243)
0808 02:36:28.489171 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:28.489179 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:28.489630 (+ 451us) server_negotiation.cc:407] Connection header received
0808 02:36:28.489830 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:28.489837 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:28.489924 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:28.490008 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:28.490697 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:28.491724 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:28.493697 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:28.494173 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:28.494277 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:28.495560 (+ 1283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:28.495565 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:28.495568 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:28.495585 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:28.495641 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:28.495680 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:28.495889 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:28.496038 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 02:36:28.496166 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 02:36:28.496861 25760 raft_consensus.cc:686] T 00000000000000000000000000000000 P eed99bf4eb0349bcb4a0602245eb3906 [term 1 LEADER]: Becoming Leader. State: Replica: eed99bf4eb0349bcb4a0602245eb3906, State: Running, Role: LEADER
I20260808 02:36:28.497488 25760 consensus_queue.cc:237] T 00000000000000000000000000000000 P eed99bf4eb0349bcb4a0602245eb3906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eed99bf4eb0349bcb4a0602245eb3906" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46243 } }
I20260808 02:36:28.499567 25760 sys_catalog.cc:455] T 00000000000000000000000000000000 P eed99bf4eb0349bcb4a0602245eb3906 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eed99bf4eb0349bcb4a0602245eb3906. Latest consensus state: current_term: 1 leader_uuid: "eed99bf4eb0349bcb4a0602245eb3906" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eed99bf4eb0349bcb4a0602245eb3906" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46243 } } }
I20260808 02:36:28.499873 25760 sys_catalog.cc:458] T 00000000000000000000000000000000 P eed99bf4eb0349bcb4a0602245eb3906 [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:28.500746 25765 sys_catalog.cc:455] T 00000000000000000000000000000000 P eed99bf4eb0349bcb4a0602245eb3906 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eed99bf4eb0349bcb4a0602245eb3906" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eed99bf4eb0349bcb4a0602245eb3906" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46243 } } }
I20260808 02:36:28.501238 25765 sys_catalog.cc:458] T 00000000000000000000000000000000 P eed99bf4eb0349bcb4a0602245eb3906 [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:28.504732 25743 sys_catalog.cc:564] T 00000000000000000000000000000000 P eed99bf4eb0349bcb4a0602245eb3906 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:36:28.509136 25769 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:36:28.515400 25769 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:36:28.525588 25769 catalog_manager.cc:1347] Generated new cluster ID: 0c6773b436e54363b1a02c7f84aed878
I20260808 02:36:28.525740 25769 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:36:28.536592 25769 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:36:28.537949 25769 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:36:28.547688 25769 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eed99bf4eb0349bcb4a0602245eb3906: Generated new TSK 0
I20260808 02:36:28.548723 25769 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:36:28.565179 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 25652
W20260808 02:36:28.566396 25737 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.37:52963
W20260808 02:36:28.567178 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 25652: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:36:28.567329 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 25652
W20260808 02:36:28.592015 25630 connection.cc:535] client connection to 127.0.0.1:46243 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46243): Connection reset by peer (error 104)
2026-08-08T02:36:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2319 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:36:28 dist-test-slave-45dx krb5kdc[25789](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:36:28 dist-test-slave-45dx krb5kdc[25789](info): set up 2 sockets
Aug 08 02:36:28 dist-test-slave-45dx krb5kdc[25789](info): commencing operation
krb5kdc: starting...
W20260808 02:36:29.935547 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.323s user 0.002s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:36:30 dist-test-slave-45dx krb5kdc[25789](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156590, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:36:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:36:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 02:36:30.300252 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37467
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37467
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:36:30.657855 25809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:30.658159 25809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:30.658356 25809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:30.665886 25809 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:36:30.666034 25809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:30.666124 25809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:30.666242 25809 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:36:30.666308 25809 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:36:30.676673 25809 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37467
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:30.678099 25809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:30.679476 25809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:30.692108 25825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:30.692065 25817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:30.692037 25819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:30.693256 25809 server_base.cc:1034] running on GCE node
I20260808 02:36:30.694083 25809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:30.695568 25809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:30.696770 25809 hybrid_clock.cc:648] HybridClock initialized: now 1786156590696732 us; error 23 us; skew 500 ppm
I20260808 02:36:30.697135 25809 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:30 dist-test-slave-45dx krb5kdc[25789](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156590, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:30.700340 25809 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 02:36:30.701797 25809 webserver.cc:460] Webserver started at http://127.0.0.1:33549/ using document root <none> and password file <none>
I20260808 02:36:30.702495 25809 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:30.702633 25809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:30.702962 25809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:30.706149 25809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "0ff0ee3b1cf342c082ba80e3398898fc"
format_stamp: "Formatted at 2026-08-08 02:36:30 on dist-test-slave-45dx"
server_key: "2adc02e420c4e6fc397a28018a635339"
server_key_iv: "980d42173f36ca4a4789c9d04294eb8e"
server_key_version: "encryptionkey@0"
I20260808 02:36:30.707002 25809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "0ff0ee3b1cf342c082ba80e3398898fc"
format_stamp: "Formatted at 2026-08-08 02:36:30 on dist-test-slave-45dx"
server_key: "2adc02e420c4e6fc397a28018a635339"
server_key_iv: "980d42173f36ca4a4789c9d04294eb8e"
server_key_version: "encryptionkey@0"
I20260808 02:36:30.712416 25809 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 02:36:30.715958 25833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:30.717367 25809 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:36:30.717545 25809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "0ff0ee3b1cf342c082ba80e3398898fc"
format_stamp: "Formatted at 2026-08-08 02:36:30 on dist-test-slave-45dx"
server_key: "2adc02e420c4e6fc397a28018a635339"
server_key_iv: "980d42173f36ca4a4789c9d04294eb8e"
server_key_version: "encryptionkey@0"
I20260808 02:36:30.717742 25809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:30.723469 25809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:30.728015 25809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:30.728384 25809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:30.747526 25809 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37467
I20260808 02:36:30.747574 25918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37467 every 8 connection(s)
I20260808 02:36:30.749013 25809 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:36:30.752918 25919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:30.755169 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 25809
I20260808 02:36:30.755367 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:36:30.755947 25043 external_mini_cluster.cc:1428] Setting key 00f628ce0aeeccd61350022ba0497913
I20260808 02:36:30.764979 25923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:30.758123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:33953 (local address 127.0.0.1:37467)
0808 02:36:30.759145 (+ 1022us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:30.759162 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:30.759216 (+ 54us) server_negotiation.cc:407] Connection header received
0808 02:36:30.761129 (+ 1913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:30.761154 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:30.761498 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:30.761872 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:30.763015 (+ 1143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:30.763022 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:30.763039 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:30.763055 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:30.763123 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:30.763151 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:30.763344 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:30.763456 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 02:36:30.763700 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":770,"thread_start_us":477,"threads_started":1}
I20260808 02:36:30.766300 25919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ff0ee3b1cf342c082ba80e3398898fc: Bootstrap starting.
I20260808 02:36:30.769069 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:36:30.770092 25919 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ff0ee3b1cf342c082ba80e3398898fc: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:30.771337 25919 log.cc:824] T 00000000000000000000000000000000 P 0ff0ee3b1cf342c082ba80e3398898fc: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:30.774322 25919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ff0ee3b1cf342c082ba80e3398898fc: No bootstrap required, opened a new log
I20260808 02:36:30.777168 25923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:30.774610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:55661 (local address 127.0.0.1:37467)
0808 02:36:30.774815 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:30.774824 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:30.775160 (+ 336us) server_negotiation.cc:407] Connection header received
0808 02:36:30.775301 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:30.775306 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:30.775365 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:30.775481 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:30.776464 (+ 983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:30.776471 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:30.776476 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:30.776502 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:30.776550 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:30.776577 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:30.776712 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:30.776771 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 02:36:30.776838 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 02:36:30.783200 25919 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ff0ee3b1cf342c082ba80e3398898fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ff0ee3b1cf342c082ba80e3398898fc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37467 } }
I20260808 02:36:30.783679 25919 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ff0ee3b1cf342c082ba80e3398898fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:30.783823 25919 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ff0ee3b1cf342c082ba80e3398898fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ff0ee3b1cf342c082ba80e3398898fc, State: Initialized, Role: FOLLOWER
I20260808 02:36:30.784525 25919 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ff0ee3b1cf342c082ba80e3398898fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ff0ee3b1cf342c082ba80e3398898fc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37467 } }
I20260808 02:36:30.784812 25919 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ff0ee3b1cf342c082ba80e3398898fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:36:30.784988 25919 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ff0ee3b1cf342c082ba80e3398898fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:36:30.785171 25919 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ff0ee3b1cf342c082ba80e3398898fc [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:30.787940 25919 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ff0ee3b1cf342c082ba80e3398898fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ff0ee3b1cf342c082ba80e3398898fc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37467 } }
I20260808 02:36:30.788556 25919 leader_election.cc:302] T 00000000000000000000000000000000 P 0ff0ee3b1cf342c082ba80e3398898fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ff0ee3b1cf342c082ba80e3398898fc; no voters:
I20260808 02:36:30.789203 25919 leader_election.cc:288] T 00000000000000000000000000000000 P 0ff0ee3b1cf342c082ba80e3398898fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:36:30.789359 25932 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ff0ee3b1cf342c082ba80e3398898fc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:36:30.790153 25932 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ff0ee3b1cf342c082ba80e3398898fc [term 1 LEADER]: Becoming Leader. State: Replica: 0ff0ee3b1cf342c082ba80e3398898fc, State: Running, Role: LEADER
I20260808 02:36:30.790735 25932 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ff0ee3b1cf342c082ba80e3398898fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ff0ee3b1cf342c082ba80e3398898fc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37467 } }
I20260808 02:36:30.791685 25919 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ff0ee3b1cf342c082ba80e3398898fc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:36:30.794011 25933 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ff0ee3b1cf342c082ba80e3398898fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ff0ee3b1cf342c082ba80e3398898fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ff0ee3b1cf342c082ba80e3398898fc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37467 } } }
I20260808 02:36:30.793998 25934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ff0ee3b1cf342c082ba80e3398898fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ff0ee3b1cf342c082ba80e3398898fc. Latest consensus state: current_term: 1 leader_uuid: "0ff0ee3b1cf342c082ba80e3398898fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ff0ee3b1cf342c082ba80e3398898fc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37467 } } }
I20260808 02:36:30.795200 25934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ff0ee3b1cf342c082ba80e3398898fc [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:30.795046 25933 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ff0ee3b1cf342c082ba80e3398898fc [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:30.796197 25941 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:36:30.801507 25941 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:36:30.811566 25941 catalog_manager.cc:1347] Generated new cluster ID: 885af637fac04cf39b2b76fe16587552
I20260808 02:36:30.811704 25941 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:36:30.835039 25941 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:36:30.835507 25941 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:36:30.848268 25941 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ff0ee3b1cf342c082ba80e3398898fc: Generated new TSK 0
I20260808 02:36:30.849162 25941 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:36:30.858530 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 25809
W20260808 02:36:30.859756 25912 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.37:33953
W20260808 02:36:30.860543 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 25809: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:36:30.860702 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 25809
2026-08-08T02:36:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2295 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:36:30 dist-test-slave-45dx krb5kdc[25964](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:36:30 dist-test-slave-45dx krb5kdc[25964](info): set up 2 sockets
Aug 08 02:36:30 dist-test-slave-45dx krb5kdc[25964](info): commencing operation
krb5kdc: starting...
W20260808 02:36:32.237174 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.330s user 0.000s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:36:32 dist-test-slave-45dx krb5kdc[25964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156592, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:36:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:36:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 02:36:32.601742 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44371
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44371
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:36:32.958777 25988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:32.959100 25988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:32.959280 25988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:32.966648 25988 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:36:32.966790 25988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:32.966899 25988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:32.966997 25988 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:36:32.967072 25988 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:36:32.977334 25988 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44371
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44371
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:32.978674 25988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:32.980103 25988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:32.992329 25993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:32.992256 25998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:32.992358 25994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:32.993533 25988 server_base.cc:1034] running on GCE node
I20260808 02:36:32.994272 25988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:32.995720 25988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:32.996925 25988 hybrid_clock.cc:648] HybridClock initialized: now 1786156592996884 us; error 30 us; skew 500 ppm
I20260808 02:36:32.997273 25988 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:32 dist-test-slave-45dx krb5kdc[25964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156592, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:33.000417 25988 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 02:36:33.001951 25988 webserver.cc:460] Webserver started at http://127.0.0.1:42867/ using document root <none> and password file <none>
I20260808 02:36:33.002641 25988 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:33.002787 25988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:33.003098 25988 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:33.006135 25988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "5337c8a0dd8a4240bd4f7faae3a94ed7"
format_stamp: "Formatted at 2026-08-08 02:36:32 on dist-test-slave-45dx"
server_key: "a8d17190f69ab2862097cf3eae3cc60b"
server_key_iv: "1a516a416e73e50280fb5641afe4ed55"
server_key_version: "encryptionkey@0"
I20260808 02:36:33.006963 25988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "5337c8a0dd8a4240bd4f7faae3a94ed7"
format_stamp: "Formatted at 2026-08-08 02:36:32 on dist-test-slave-45dx"
server_key: "a8d17190f69ab2862097cf3eae3cc60b"
server_key_iv: "1a516a416e73e50280fb5641afe4ed55"
server_key_version: "encryptionkey@0"
I20260808 02:36:33.012125 25988 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260808 02:36:33.015625 26008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:33.016983 25988 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:36:33.017179 25988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "5337c8a0dd8a4240bd4f7faae3a94ed7"
format_stamp: "Formatted at 2026-08-08 02:36:32 on dist-test-slave-45dx"
server_key: "a8d17190f69ab2862097cf3eae3cc60b"
server_key_iv: "1a516a416e73e50280fb5641afe4ed55"
server_key_version: "encryptionkey@0"
I20260808 02:36:33.017402 25988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:33.048918 25988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:33.053118 25988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:33.053431 25988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:33.073621 25988 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44371
I20260808 02:36:33.073675 26079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44371 every 8 connection(s)
I20260808 02:36:33.075119 25988 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:36:33.076076 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 25988
I20260808 02:36:33.076292 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:36:33.076788 25043 external_mini_cluster.cc:1428] Setting key 82fb5bbadcb098ac0abde5148416ec21
I20260808 02:36:33.079804 26087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 02:36:33 dist-test-slave-45dx krb5kdc[25964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156592, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 02:36:33.092799 26087 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5337c8a0dd8a4240bd4f7faae3a94ed7: Bootstrap starting.
I20260808 02:36:33.097029 26087 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5337c8a0dd8a4240bd4f7faae3a94ed7: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:33.098294 26087 log.cc:824] T 00000000000000000000000000000000 P 5337c8a0dd8a4240bd4f7faae3a94ed7: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:33.102033 26087 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5337c8a0dd8a4240bd4f7faae3a94ed7: No bootstrap required, opened a new log
I20260808 02:36:33.102350 26090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:33.078766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:34961 (local address 127.0.0.1:44371)
0808 02:36:33.079549 (+ 783us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:33.079564 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:33.079618 (+ 54us) server_negotiation.cc:407] Connection header received
0808 02:36:33.082000 (+ 2382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:33.082028 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:33.082512 (+ 484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:33.082973 (+ 461us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:33.084328 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:33.086416 (+ 2088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:33.087779 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:33.088806 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:33.089018 (+ 212us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:33.093451 (+ 4433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:33.093461 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:33.093479 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:33.093521 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:33.097642 (+ 4121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:33.098462 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:33.098472 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:33.098480 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:33.098686 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:33.099298 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:33.099305 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:33.099311 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:33.100114 (+ 803us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:33.100506 (+ 392us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:33.101063 (+ 557us) server_negotiation.cc:299] Negotiation successful
0808 02:36:33.101295 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":309,"threads_started":1}
I20260808 02:36:33.106462 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:36:33.111158 26087 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5337c8a0dd8a4240bd4f7faae3a94ed7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5337c8a0dd8a4240bd4f7faae3a94ed7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44371 } }
I20260808 02:36:33.111586 26087 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5337c8a0dd8a4240bd4f7faae3a94ed7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:33.111714 26087 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5337c8a0dd8a4240bd4f7faae3a94ed7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5337c8a0dd8a4240bd4f7faae3a94ed7, State: Initialized, Role: FOLLOWER
I20260808 02:36:33.112660 26087 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5337c8a0dd8a4240bd4f7faae3a94ed7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5337c8a0dd8a4240bd4f7faae3a94ed7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44371 } }
I20260808 02:36:33.113047 26087 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5337c8a0dd8a4240bd4f7faae3a94ed7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:36:33.113209 26087 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5337c8a0dd8a4240bd4f7faae3a94ed7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:36:33.113421 26087 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5337c8a0dd8a4240bd4f7faae3a94ed7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:33.116645 26087 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5337c8a0dd8a4240bd4f7faae3a94ed7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5337c8a0dd8a4240bd4f7faae3a94ed7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44371 } }
I20260808 02:36:33.117249 26087 leader_election.cc:302] T 00000000000000000000000000000000 P 5337c8a0dd8a4240bd4f7faae3a94ed7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5337c8a0dd8a4240bd4f7faae3a94ed7; no voters:
I20260808 02:36:33.117945 26087 leader_election.cc:288] T 00000000000000000000000000000000 P 5337c8a0dd8a4240bd4f7faae3a94ed7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:36:33.118117 26098 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5337c8a0dd8a4240bd4f7faae3a94ed7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:36:33.119558 26098 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5337c8a0dd8a4240bd4f7faae3a94ed7 [term 1 LEADER]: Becoming Leader. State: Replica: 5337c8a0dd8a4240bd4f7faae3a94ed7, State: Running, Role: LEADER
I20260808 02:36:33.120061 26098 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5337c8a0dd8a4240bd4f7faae3a94ed7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5337c8a0dd8a4240bd4f7faae3a94ed7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44371 } }
I20260808 02:36:33.120676 26087 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5337c8a0dd8a4240bd4f7faae3a94ed7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:36:33.123047 26102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5337c8a0dd8a4240bd4f7faae3a94ed7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5337c8a0dd8a4240bd4f7faae3a94ed7. Latest consensus state: current_term: 1 leader_uuid: "5337c8a0dd8a4240bd4f7faae3a94ed7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5337c8a0dd8a4240bd4f7faae3a94ed7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44371 } } }
I20260808 02:36:33.123476 26102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5337c8a0dd8a4240bd4f7faae3a94ed7 [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:33.124138 26101 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5337c8a0dd8a4240bd4f7faae3a94ed7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5337c8a0dd8a4240bd4f7faae3a94ed7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5337c8a0dd8a4240bd4f7faae3a94ed7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44371 } } }
I20260808 02:36:33.124477 26101 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5337c8a0dd8a4240bd4f7faae3a94ed7 [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:33.131996 26090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:33.111448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:48367 (local address 127.0.0.1:44371)
0808 02:36:33.111705 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:33.111715 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:33.112199 (+ 484us) server_negotiation.cc:407] Connection header received
0808 02:36:33.112495 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:33.112499 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:33.112568 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:33.112663 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:33.114631 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:33.115468 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:33.117377 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:33.118057 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:33.118206 (+ 149us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:33.121808 (+ 3602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:33.121816 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:33.121821 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:33.121873 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:33.126944 (+ 5071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:33.128295 (+ 1351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:33.128325 (+ 30us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:33.128335 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:33.128522 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:33.129311 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:33.129319 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:33.129325 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:33.129819 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:33.130256 (+ 437us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:33.131151 (+ 895us) server_negotiation.cc:299] Negotiation successful
0808 02:36:33.131414 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":80}
I20260808 02:36:33.136740 26105 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:36:33.142043 26105 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:36:33.152024 26105 catalog_manager.cc:1347] Generated new cluster ID: d1c2f34ebede4059aee2ebc76fd5087c
I20260808 02:36:33.152146 26105 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:36:33.170356 26105 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:36:33.171679 26105 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:36:33.179888 26105 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5337c8a0dd8a4240bd4f7faae3a94ed7: Generated new TSK 0
I20260808 02:36:33.181030 26105 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:36:33.198273 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 25988
I20260808 02:36:33.199615 26073 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:36:33.293666 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 25988
W20260808 02:36:33.319705 25962 connection.cc:535] client connection to 127.0.0.1:44371 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44371): Connection reset by peer (error 104)
2026-08-08T02:36:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2436 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:36:33 dist-test-slave-45dx krb5kdc[26132](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:36:33 dist-test-slave-45dx krb5kdc[26132](info): set up 2 sockets
Aug 08 02:36:33 dist-test-slave-45dx krb5kdc[26132](info): commencing operation
krb5kdc: starting...
W20260808 02:36:34.671957 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.328s user 0.000s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:36:34 dist-test-slave-45dx krb5kdc[26132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:36:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:36:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 02:36:35.035615 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43475
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43475
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:36:35.391116 26152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:35.391412 26152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:35.391588 26152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:35.398959 26152 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:36:35.399091 26152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:35.399184 26152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:35.399291 26152 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:36:35.399366 26152 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:36:35.409222 26152 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43475
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:35.410530 26152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:35.411830 26152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:35.424033 26158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:35.424028 26163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:35.424050 26159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:35.425189 26152 server_base.cc:1034] running on GCE node
I20260808 02:36:35.426020 26152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:35.427484 26152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:35.428680 26152 hybrid_clock.cc:648] HybridClock initialized: now 1786156595428636 us; error 30 us; skew 500 ppm
I20260808 02:36:35.429031 26152 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:35 dist-test-slave-45dx krb5kdc[26132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156595, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:35.432255 26152 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 02:36:35.433876 26152 webserver.cc:460] Webserver started at http://127.0.0.1:35737/ using document root <none> and password file <none>
I20260808 02:36:35.434569 26152 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:35.434716 26152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:35.435024 26152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:35.438107 26152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "32d220a5c9b04bd58898687e514284b2"
format_stamp: "Formatted at 2026-08-08 02:36:35 on dist-test-slave-45dx"
server_key: "ac6ec81f6d3106a488336a7c9574ad96"
server_key_iv: "0fd66e8084a9b9ad081ee35e26967872"
server_key_version: "encryptionkey@0"
I20260808 02:36:35.438891 26152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "32d220a5c9b04bd58898687e514284b2"
format_stamp: "Formatted at 2026-08-08 02:36:35 on dist-test-slave-45dx"
server_key: "ac6ec81f6d3106a488336a7c9574ad96"
server_key_iv: "0fd66e8084a9b9ad081ee35e26967872"
server_key_version: "encryptionkey@0"
I20260808 02:36:35.444049 26152 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 02:36:35.447571 26177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:35.449000 26152 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:36:35.449222 26152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "32d220a5c9b04bd58898687e514284b2"
format_stamp: "Formatted at 2026-08-08 02:36:35 on dist-test-slave-45dx"
server_key: "ac6ec81f6d3106a488336a7c9574ad96"
server_key_iv: "0fd66e8084a9b9ad081ee35e26967872"
server_key_version: "encryptionkey@0"
I20260808 02:36:35.449436 26152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:35.479748 26152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:35.484375 26152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:35.484666 26152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:35.504276 26152 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43475
I20260808 02:36:35.504405 26252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43475 every 8 connection(s)
I20260808 02:36:35.505722 26152 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:36:35.509740 26253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:35.511210 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 26152
I20260808 02:36:35.511425 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:36:35.512096 25043 external_mini_cluster.cc:1428] Setting key 8644e235471b2c8ea2194056bf5e87bc
I20260808 02:36:35.524593 26253 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32d220a5c9b04bd58898687e514284b2: Bootstrap starting.
I20260808 02:36:35.526070 26257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:35.514146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:38005 (local address 127.0.0.1:43475)
0808 02:36:35.515010 (+ 864us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:35.515022 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:35.515071 (+ 49us) server_negotiation.cc:407] Connection header received
0808 02:36:35.516837 (+ 1766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:35.516864 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:35.517266 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:35.517594 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:35.518257 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:35.519530 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:35.521527 (+ 1997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:35.522254 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:35.522383 (+ 129us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:35.523700 (+ 1317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:35.523708 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:35.523720 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:35.524268 (+ 548us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:35.524404 (+ 136us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:35.524432 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:35.524553 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:35.524934 (+ 381us) server_negotiation.cc:299] Negotiation successful
0808 02:36:35.525120 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":648,"thread_start_us":349,"threads_started":1}
I20260808 02:36:35.527922 26253 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32d220a5c9b04bd58898687e514284b2: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:35.529171 26253 log.cc:824] T 00000000000000000000000000000000 P 32d220a5c9b04bd58898687e514284b2: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:35.529788 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:36:35.531889 26253 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32d220a5c9b04bd58898687e514284b2: No bootstrap required, opened a new log
I20260808 02:36:35.541600 26257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:35.534328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:47195 (local address 127.0.0.1:43475)
0808 02:36:35.534495 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:35.534499 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:35.534898 (+ 399us) server_negotiation.cc:407] Connection header received
0808 02:36:35.535066 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:35.535069 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:35.535132 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:35.535210 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:35.535875 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:35.536723 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:35.538660 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:35.539123 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:35.539223 (+ 100us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:35.540622 (+ 1399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:35.540628 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:35.540631 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:35.540649 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:35.540712 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:35.540728 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:35.540875 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:35.541198 (+ 323us) server_negotiation.cc:299] Negotiation successful
0808 02:36:35.541267 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 02:36:35.541937 26253 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32d220a5c9b04bd58898687e514284b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32d220a5c9b04bd58898687e514284b2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43475 } }
I20260808 02:36:35.542339 26253 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32d220a5c9b04bd58898687e514284b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:35.542483 26253 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32d220a5c9b04bd58898687e514284b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d220a5c9b04bd58898687e514284b2, State: Initialized, Role: FOLLOWER
I20260808 02:36:35.543098 26253 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32d220a5c9b04bd58898687e514284b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32d220a5c9b04bd58898687e514284b2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43475 } }
I20260808 02:36:35.543371 26253 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32d220a5c9b04bd58898687e514284b2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:36:35.543517 26253 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32d220a5c9b04bd58898687e514284b2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:36:35.543706 26253 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32d220a5c9b04bd58898687e514284b2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:35.546121 26253 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32d220a5c9b04bd58898687e514284b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32d220a5c9b04bd58898687e514284b2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43475 } }
I20260808 02:36:35.546639 26253 leader_election.cc:302] T 00000000000000000000000000000000 P 32d220a5c9b04bd58898687e514284b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32d220a5c9b04bd58898687e514284b2; no voters:
I20260808 02:36:35.547324 26253 leader_election.cc:288] T 00000000000000000000000000000000 P 32d220a5c9b04bd58898687e514284b2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:36:35.547489 26271 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32d220a5c9b04bd58898687e514284b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:36:35.548588 26271 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32d220a5c9b04bd58898687e514284b2 [term 1 LEADER]: Becoming Leader. State: Replica: 32d220a5c9b04bd58898687e514284b2, State: Running, Role: LEADER
I20260808 02:36:35.549213 26271 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32d220a5c9b04bd58898687e514284b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32d220a5c9b04bd58898687e514284b2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43475 } }
I20260808 02:36:35.549674 26253 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32d220a5c9b04bd58898687e514284b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:36:35.552469 26273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32d220a5c9b04bd58898687e514284b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32d220a5c9b04bd58898687e514284b2. Latest consensus state: current_term: 1 leader_uuid: "32d220a5c9b04bd58898687e514284b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32d220a5c9b04bd58898687e514284b2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43475 } } }
I20260808 02:36:35.552959 26273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32d220a5c9b04bd58898687e514284b2 [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:35.553587 26272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32d220a5c9b04bd58898687e514284b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32d220a5c9b04bd58898687e514284b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32d220a5c9b04bd58898687e514284b2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43475 } } }
I20260808 02:36:35.553933 26272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32d220a5c9b04bd58898687e514284b2 [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:35.557447 26278 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:36:35.562283 26278 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:36:35.570781 26278 catalog_manager.cc:1347] Generated new cluster ID: 731cfb77aded454ebe1bd99fa6dbf156
I20260808 02:36:35.570904 26278 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:36:35.580875 26278 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:36:35.582126 26278 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:36:35.591549 26278 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32d220a5c9b04bd58898687e514284b2: Generated new TSK 0
I20260808 02:36:35.592486 26278 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:36:35.599005 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 26152
W20260808 02:36:35.600340 26247 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.37:38005
W20260808 02:36:35.601122 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 26152: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:36:35.601279 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 26152
W20260808 02:36:35.627687 26130 connection.cc:535] client connection to 127.0.0.1:43475 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43475): Connection reset by peer (error 104)
2026-08-08T02:36:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2303 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:36:35 dist-test-slave-45dx krb5kdc[26295](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:36:35 dist-test-slave-45dx krb5kdc[26295](info): set up 2 sockets
Aug 08 02:36:35 dist-test-slave-45dx krb5kdc[26295](info): commencing operation
krb5kdc: starting...
W20260808 02:36:36.963376 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.316s user 0.000s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:36:37 dist-test-slave-45dx krb5kdc[26295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:36:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:36:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 02:36:37.320502 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44495
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44495
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:36:37.681565 26316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:37.681888 26316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:37.681993 26316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:37.689276 26316 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:36:37.689400 26316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:37.689447 26316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:37.689512 26316 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:36:37.689558 26316 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:36:37.699699 26316 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44495
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44495
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:37.701086 26316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:37.702417 26316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:37.714054 26328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:37.714016 26331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:37.714095 26333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:37.715296 26316 server_base.cc:1034] running on GCE node
I20260808 02:36:37.716064 26316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:37.717500 26316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:37.718713 26316 hybrid_clock.cc:648] HybridClock initialized: now 1786156597718679 us; error 29 us; skew 500 ppm
I20260808 02:36:37.719085 26316 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:37 dist-test-slave-45dx krb5kdc[26295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156597, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:37.722407 26316 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 02:36:37.723964 26316 webserver.cc:460] Webserver started at http://127.0.0.1:41975/ using document root <none> and password file <none>
I20260808 02:36:37.724730 26316 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:37.724898 26316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:37.725230 26316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:37.728474 26316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "e7a130f9fea84434a76982936f917241"
format_stamp: "Formatted at 2026-08-08 02:36:37 on dist-test-slave-45dx"
server_key: "6d8ae2e02797fed13bcca183b5718195"
server_key_iv: "d71822f4c67af20d7365d714d77ebb0f"
server_key_version: "encryptionkey@0"
I20260808 02:36:37.729278 26316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "e7a130f9fea84434a76982936f917241"
format_stamp: "Formatted at 2026-08-08 02:36:37 on dist-test-slave-45dx"
server_key: "6d8ae2e02797fed13bcca183b5718195"
server_key_iv: "d71822f4c67af20d7365d714d77ebb0f"
server_key_version: "encryptionkey@0"
I20260808 02:36:37.734503 26316 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260808 02:36:37.737969 26341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:37.739339 26316 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 02:36:37.739516 26316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "e7a130f9fea84434a76982936f917241"
format_stamp: "Formatted at 2026-08-08 02:36:37 on dist-test-slave-45dx"
server_key: "6d8ae2e02797fed13bcca183b5718195"
server_key_iv: "d71822f4c67af20d7365d714d77ebb0f"
server_key_version: "encryptionkey@0"
I20260808 02:36:37.739706 26316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:37.745594 26316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:37.749670 26316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:37.749969 26316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:37.768894 26316 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44495
I20260808 02:36:37.768980 26418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44495 every 8 connection(s)
I20260808 02:36:37.770321 26316 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:36:37.774035 26419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:37.776201 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 26316
I20260808 02:36:37.776424 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:36:37.776881 25043 external_mini_cluster.cc:1428] Setting key 47a0c8ca0dbdd4fb11e68ba99f5babbf
I20260808 02:36:37.784765 26424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:37.778647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:58041 (local address 127.0.0.1:44495)
0808 02:36:37.779441 (+ 794us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:37.779453 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:37.779519 (+ 66us) server_negotiation.cc:407] Connection header received
0808 02:36:37.781262 (+ 1743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:37.781286 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:37.781612 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:37.781947 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:37.783117 (+ 1170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:37.783123 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:37.783135 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:37.783157 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:37.783218 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:37.783240 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:37.783430 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:37.783527 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 02:36:37.783729 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":358,"threads_started":1}
I20260808 02:36:37.786173 26419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7a130f9fea84434a76982936f917241: Bootstrap starting.
I20260808 02:36:37.788354 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:36:37.789734 26419 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e7a130f9fea84434a76982936f917241: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:37.791019 26419 log.cc:824] T 00000000000000000000000000000000 P e7a130f9fea84434a76982936f917241: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:37.793951 26419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7a130f9fea84434a76982936f917241: No bootstrap required, opened a new log
I20260808 02:36:37.796484 26424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:37.793718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:42251 (local address 127.0.0.1:44495)
0808 02:36:37.793933 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:37.793943 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:37.794458 (+ 515us) server_negotiation.cc:407] Connection header received
0808 02:36:37.794631 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:37.794634 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:37.794679 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:37.794759 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:37.795762 (+ 1003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:37.795766 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:37.795769 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:37.795787 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:37.795829 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:37.795843 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:37.795948 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:37.796081 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 02:36:37.796132 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 02:36:37.802551 26419 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7a130f9fea84434a76982936f917241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a130f9fea84434a76982936f917241" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44495 } }
I20260808 02:36:37.803074 26419 raft_consensus.cc:374] T 00000000000000000000000000000000 P e7a130f9fea84434a76982936f917241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:37.803215 26419 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7a130f9fea84434a76982936f917241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7a130f9fea84434a76982936f917241, State: Initialized, Role: FOLLOWER
I20260808 02:36:37.803874 26419 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7a130f9fea84434a76982936f917241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a130f9fea84434a76982936f917241" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44495 } }
I20260808 02:36:37.804140 26419 raft_consensus.cc:388] T 00000000000000000000000000000000 P e7a130f9fea84434a76982936f917241 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:36:37.804294 26419 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7a130f9fea84434a76982936f917241 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:36:37.804545 26419 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7a130f9fea84434a76982936f917241 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:37.806883 26419 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7a130f9fea84434a76982936f917241 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a130f9fea84434a76982936f917241" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44495 } }
I20260808 02:36:37.807523 26419 leader_election.cc:302] T 00000000000000000000000000000000 P e7a130f9fea84434a76982936f917241 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e7a130f9fea84434a76982936f917241; no voters:
I20260808 02:36:37.808142 26419 leader_election.cc:288] T 00000000000000000000000000000000 P e7a130f9fea84434a76982936f917241 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:36:37.808295 26434 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7a130f9fea84434a76982936f917241 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:36:37.809051 26434 raft_consensus.cc:686] T 00000000000000000000000000000000 P e7a130f9fea84434a76982936f917241 [term 1 LEADER]: Becoming Leader. State: Replica: e7a130f9fea84434a76982936f917241, State: Running, Role: LEADER
I20260808 02:36:37.809662 26434 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7a130f9fea84434a76982936f917241 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a130f9fea84434a76982936f917241" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44495 } }
I20260808 02:36:37.810372 26419 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7a130f9fea84434a76982936f917241 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:36:37.812785 26436 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7a130f9fea84434a76982936f917241 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e7a130f9fea84434a76982936f917241" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a130f9fea84434a76982936f917241" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44495 } } }
I20260808 02:36:37.812669 26437 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7a130f9fea84434a76982936f917241 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7a130f9fea84434a76982936f917241. Latest consensus state: current_term: 1 leader_uuid: "e7a130f9fea84434a76982936f917241" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a130f9fea84434a76982936f917241" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44495 } } }
I20260808 02:36:37.813171 26436 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7a130f9fea84434a76982936f917241 [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:37.813201 26437 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7a130f9fea84434a76982936f917241 [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:37.814981 26445 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:36:37.820832 26445 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:36:37.829492 26445 catalog_manager.cc:1347] Generated new cluster ID: d0079e2fa1e0409197961c107f1acc35
I20260808 02:36:37.829629 26445 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:36:37.849090 26445 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:36:37.849541 26445 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:36:37.855904 26445 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e7a130f9fea84434a76982936f917241: Generated new TSK 0
I20260808 02:36:37.856864 26445 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:36:37.866850 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 26316
W20260808 02:36:37.868055 26413 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.37:58041
W20260808 02:36:37.868827 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 26316: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:36:37.868997 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 26316
2026-08-08T02:36:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2273 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:36:38 dist-test-slave-45dx krb5kdc[26461](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:36:38 dist-test-slave-45dx krb5kdc[26461](info): set up 2 sockets
Aug 08 02:36:38 dist-test-slave-45dx krb5kdc[26461](info): commencing operation
krb5kdc: starting...
W20260808 02:36:39.256752 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.336s user 0.006s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:36:39 dist-test-slave-45dx krb5kdc[26461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156599, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:36:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:36:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:36:39.611198 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:34559
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:45469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:34559
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:36:39.966249 26487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:39.966547 26487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:39.966722 26487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:39.974082 26487 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:36:39.974216 26487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:39.974320 26487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:39.974427 26487 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:36:39.974493 26487 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:36:39.984715 26487 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:45469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:34559
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:34559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:39.986092 26487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:39.987475 26487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:39.999719 26498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:39.999948 26503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:39.999982 26501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:40.000967 26487 server_base.cc:1034] running on GCE node
I20260808 02:36:40.001794 26487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:40.003312 26487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:40.004549 26487 hybrid_clock.cc:648] HybridClock initialized: now 1786156600004500 us; error 72 us; skew 500 ppm
I20260808 02:36:40.004917 26487 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:40 dist-test-slave-45dx krb5kdc[26461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156600, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:40.013504 26487 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:36:40.015206 26487 webserver.cc:460] Webserver started at http://127.24.116.254:39275/ using document root <none> and password file <none>
I20260808 02:36:40.015930 26487 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:40.016083 26487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:40.016463 26487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:40.019583 26487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "0ce96ba354504c838c33c838cca80e0e"
format_stamp: "Formatted at 2026-08-08 02:36:40 on dist-test-slave-45dx"
server_key: "3bd6f5b872cc3d4986b245f8ac36dce9"
server_key_iv: "44ae7e70048777a5ba777961aab9ed3b"
server_key_version: "encryptionkey@0"
I20260808 02:36:40.020663 26487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "0ce96ba354504c838c33c838cca80e0e"
format_stamp: "Formatted at 2026-08-08 02:36:40 on dist-test-slave-45dx"
server_key: "3bd6f5b872cc3d4986b245f8ac36dce9"
server_key_iv: "44ae7e70048777a5ba777961aab9ed3b"
server_key_version: "encryptionkey@0"
I20260808 02:36:40.026218 26487 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 02:36:40.029913 26513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:40.031391 26487 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:36:40.031594 26487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "0ce96ba354504c838c33c838cca80e0e"
format_stamp: "Formatted at 2026-08-08 02:36:40 on dist-test-slave-45dx"
server_key: "3bd6f5b872cc3d4986b245f8ac36dce9"
server_key_iv: "44ae7e70048777a5ba777961aab9ed3b"
server_key_version: "encryptionkey@0"
I20260808 02:36:40.031814 26487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:40.044437 26487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:40.049142 26487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:40.049456 26487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:40.068773 26487 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:34559
I20260808 02:36:40.068802 26594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:34559 every 8 connection(s)
I20260808 02:36:40.070201 26487 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:36:40.074013 26595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:40.075346 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 26487
I20260808 02:36:40.075541 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:36:40.076169 25043 external_mini_cluster.cc:1428] Setting key 11fcdf9258e61763ac986fd2861cf6c3
I20260808 02:36:40.087024 26595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ce96ba354504c838c33c838cca80e0e: Bootstrap starting.
Aug 08 02:36:40 dist-test-slave-45dx krb5kdc[26461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156599, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:36:40.090387 26595 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ce96ba354504c838c33c838cca80e0e: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:40.091427 26595 log.cc:824] T 00000000000000000000000000000000 P 0ce96ba354504c838c33c838cca80e0e: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:40.094610 26595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ce96ba354504c838c33c838cca80e0e: No bootstrap required, opened a new log
I20260808 02:36:40.099020 26598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:40.078113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50907 (local address 127.24.116.254:34559)
0808 02:36:40.078918 (+ 805us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:40.078930 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:40.078971 (+ 41us) server_negotiation.cc:407] Connection header received
0808 02:36:40.080674 (+ 1703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:40.080695 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:40.081084 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:40.081477 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:40.082996 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:40.084288 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:40.085783 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:40.086447 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:40.086642 (+ 195us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:40.091245 (+ 4603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:40.091253 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:40.091270 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:40.091309 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:40.094657 (+ 3348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:40.095694 (+ 1037us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:40.095700 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:40.095706 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:40.095878 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:40.096399 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:40.096402 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:40.096404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:40.096914 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:40.097152 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:40.097667 (+ 515us) server_negotiation.cc:299] Negotiation successful
0808 02:36:40.097983 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":366,"threads_started":1}
I20260808 02:36:40.102873 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:36:40.103529 26595 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ce96ba354504c838c33c838cca80e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ce96ba354504c838c33c838cca80e0e" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34559 } }
I20260808 02:36:40.103938 26595 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ce96ba354504c838c33c838cca80e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:40.104045 26595 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ce96ba354504c838c33c838cca80e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce96ba354504c838c33c838cca80e0e, State: Initialized, Role: FOLLOWER
I20260808 02:36:40.104666 26595 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ce96ba354504c838c33c838cca80e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ce96ba354504c838c33c838cca80e0e" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34559 } }
I20260808 02:36:40.104929 26595 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ce96ba354504c838c33c838cca80e0e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:36:40.105057 26595 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ce96ba354504c838c33c838cca80e0e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:36:40.105211 26595 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ce96ba354504c838c33c838cca80e0e [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:40.108518 26595 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ce96ba354504c838c33c838cca80e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ce96ba354504c838c33c838cca80e0e" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34559 } }
I20260808 02:36:40.109125 26595 leader_election.cc:302] T 00000000000000000000000000000000 P 0ce96ba354504c838c33c838cca80e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ce96ba354504c838c33c838cca80e0e; no voters:
I20260808 02:36:40.109849 26595 leader_election.cc:288] T 00000000000000000000000000000000 P 0ce96ba354504c838c33c838cca80e0e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:36:40.110002 26617 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ce96ba354504c838c33c838cca80e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:36:40.111151 26617 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ce96ba354504c838c33c838cca80e0e [term 1 LEADER]: Becoming Leader. State: Replica: 0ce96ba354504c838c33c838cca80e0e, State: Running, Role: LEADER
I20260808 02:36:40.111791 26617 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ce96ba354504c838c33c838cca80e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ce96ba354504c838c33c838cca80e0e" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34559 } }
I20260808 02:36:40.112217 26595 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ce96ba354504c838c33c838cca80e0e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:36:40.114660 26618 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ce96ba354504c838c33c838cca80e0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ce96ba354504c838c33c838cca80e0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ce96ba354504c838c33c838cca80e0e" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34559 } } }
I20260808 02:36:40.115074 26618 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ce96ba354504c838c33c838cca80e0e [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:40.115588 26619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ce96ba354504c838c33c838cca80e0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ce96ba354504c838c33c838cca80e0e. Latest consensus state: current_term: 1 leader_uuid: "0ce96ba354504c838c33c838cca80e0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ce96ba354504c838c33c838cca80e0e" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34559 } } }
I20260808 02:36:40.115877 26619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ce96ba354504c838c33c838cca80e0e [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:40.124949 26625 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:36:40.129295 26598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:40.108178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54521 (local address 127.24.116.254:34559)
0808 02:36:40.108398 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:40.108405 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:40.109025 (+ 620us) server_negotiation.cc:407] Connection header received
0808 02:36:40.109158 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:40.109163 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:40.109251 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:40.109356 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:40.111489 (+ 2133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:40.112754 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:40.114648 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:40.115618 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:40.115772 (+ 154us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:40.119795 (+ 4023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:40.119811 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:40.119819 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:40.119876 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:40.124719 (+ 4843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:40.125733 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:40.125739 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:40.125742 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:40.125915 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:40.126524 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:40.126529 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:40.126532 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:40.127062 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:40.127445 (+ 383us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:40.128726 (+ 1281us) server_negotiation.cc:299] Negotiation successful
0808 02:36:40.128920 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 02:36:40.131678 26625 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:36:40.140738 26625 catalog_manager.cc:1347] Generated new cluster ID: 4cd83bb00a8d43e8b65c106b54a14306
I20260808 02:36:40.140861 26625 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:36:40.167239 26625 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:36:40.168713 26625 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:36:40.177145 26625 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ce96ba354504c838c33c838cca80e0e: Generated new TSK 0
I20260808 02:36:40.177992 26625 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:36:40.187515 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 26487
I20260808 02:36:40.188846 26588 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:36:40.284351 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 26487
W20260808 02:36:40.312686 26457 connection.cc:535] client connection to 127.24.116.254:34559 recv error: Network error: failed to read from TLS socket (remote: 127.24.116.254:34559): Connection reset by peer (error 104)
2026-08-08T02:36:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2410 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:36:40 dist-test-slave-45dx krb5kdc[26652](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:36:40 dist-test-slave-45dx krb5kdc[26652](info): set up 2 sockets
Aug 08 02:36:40 dist-test-slave-45dx krb5kdc[26652](info): commencing operation
krb5kdc: starting...
W20260808 02:36:41.657624 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.326s user 0.005s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:36:41 dist-test-slave-45dx krb5kdc[26652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:36:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:36:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:36:42.017544 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:43959
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:40949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:43959
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:36:42.386449 26671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:42.386759 26671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:42.386996 26671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:42.395217 26671 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:36:42.395323 26671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:42.395431 26671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:42.395543 26671 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:36:42.395630 26671 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:36:42.405800 26671 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:40949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:43959
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:43959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:42.407137 26671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:42.408550 26671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:42.420457 26678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:42.420475 26677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:42.420584 26680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:42.421548 26671 server_base.cc:1034] running on GCE node
I20260808 02:36:42.422282 26671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:42.423635 26671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:42.424844 26671 hybrid_clock.cc:648] HybridClock initialized: now 1786156602424793 us; error 36 us; skew 500 ppm
I20260808 02:36:42.425206 26671 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:42 dist-test-slave-45dx krb5kdc[26652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156602, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:42.432646 26671 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:36:42.434196 26671 webserver.cc:460] Webserver started at http://127.24.116.254:45221/ using document root <none> and password file <none>
I20260808 02:36:42.434890 26671 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:42.435001 26671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:42.435278 26671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:42.438687 26671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "df4462ccd67e449cae0b5c25d104c65f"
format_stamp: "Formatted at 2026-08-08 02:36:42 on dist-test-slave-45dx"
server_key: "1829dfb229173100b009b64a0bc53f2a"
server_key_iv: "09ac0f93dd9b08bc80ffd73215b243cd"
server_key_version: "encryptionkey@0"
I20260808 02:36:42.439417 26671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "df4462ccd67e449cae0b5c25d104c65f"
format_stamp: "Formatted at 2026-08-08 02:36:42 on dist-test-slave-45dx"
server_key: "1829dfb229173100b009b64a0bc53f2a"
server_key_iv: "09ac0f93dd9b08bc80ffd73215b243cd"
server_key_version: "encryptionkey@0"
I20260808 02:36:42.444696 26671 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 02:36:42.448851 26690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:42.450232 26671 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:36:42.450435 26671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "df4462ccd67e449cae0b5c25d104c65f"
format_stamp: "Formatted at 2026-08-08 02:36:42 on dist-test-slave-45dx"
server_key: "1829dfb229173100b009b64a0bc53f2a"
server_key_iv: "09ac0f93dd9b08bc80ffd73215b243cd"
server_key_version: "encryptionkey@0"
I20260808 02:36:42.450721 26671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:42.472262 26671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:42.476971 26671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:42.477283 26671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:42.505930 26671 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:43959
I20260808 02:36:42.506029 26777 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:43959 every 8 connection(s)
I20260808 02:36:42.507364 26671 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:36:42.512285 26778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:42.514659 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 26671
I20260808 02:36:42.514884 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:36:42.515348 25043 external_mini_cluster.cc:1428] Setting key 3203f598033d1b2a9a239c6021ef1500
I20260808 02:36:42.528296 26778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df4462ccd67e449cae0b5c25d104c65f: Bootstrap starting.
I20260808 02:36:42.532840 26778 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df4462ccd67e449cae0b5c25d104c65f: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:42.533466 26783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:42.517270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56381 (local address 127.24.116.254:43959)
0808 02:36:42.518158 (+ 888us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:42.518174 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:42.518224 (+ 50us) server_negotiation.cc:407] Connection header received
0808 02:36:42.520592 (+ 2368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:42.520623 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:42.521173 (+ 550us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:42.521603 (+ 430us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:42.522268 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:42.524493 (+ 2225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:42.526509 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:42.527728 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:42.528768 (+ 1040us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:42.529978 (+ 1210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:42.529989 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:42.530008 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:42.530817 (+ 809us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:42.530943 (+ 126us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:42.530981 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:42.531645 (+ 664us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:42.531831 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 02:36:42.532040 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":379,"threads_started":1}
I20260808 02:36:42.534382 26778 log.cc:824] T 00000000000000000000000000000000 P df4462ccd67e449cae0b5c25d104c65f: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:42.537966 26778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df4462ccd67e449cae0b5c25d104c65f: No bootstrap required, opened a new log
I20260808 02:36:42.540967 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:36:42.549676 26778 raft_consensus.cc:348] T 00000000000000000000000000000000 P df4462ccd67e449cae0b5c25d104c65f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df4462ccd67e449cae0b5c25d104c65f" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 43959 } }
I20260808 02:36:42.550287 26778 raft_consensus.cc:374] T 00000000000000000000000000000000 P df4462ccd67e449cae0b5c25d104c65f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:42.550505 26778 raft_consensus.cc:729] T 00000000000000000000000000000000 P df4462ccd67e449cae0b5c25d104c65f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4462ccd67e449cae0b5c25d104c65f, State: Initialized, Role: FOLLOWER
I20260808 02:36:42.551277 26778 consensus_queue.cc:260] T 00000000000000000000000000000000 P df4462ccd67e449cae0b5c25d104c65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df4462ccd67e449cae0b5c25d104c65f" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 43959 } }
I20260808 02:36:42.551676 26778 raft_consensus.cc:388] T 00000000000000000000000000000000 P df4462ccd67e449cae0b5c25d104c65f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:36:42.551877 26778 raft_consensus.cc:482] T 00000000000000000000000000000000 P df4462ccd67e449cae0b5c25d104c65f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:36:42.552176 26778 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df4462ccd67e449cae0b5c25d104c65f [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:42.556102 26783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:42.546704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45825 (local address 127.24.116.254:43959)
0808 02:36:42.546907 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:42.546913 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:42.547257 (+ 344us) server_negotiation.cc:407] Connection header received
0808 02:36:42.547508 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:42.547520 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:42.547613 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:42.547713 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:42.548564 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:42.549826 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:42.552000 (+ 2174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:42.552816 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:42.552941 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:42.555056 (+ 2115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:42.555065 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:42.555071 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:42.555096 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:42.555169 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:42.555191 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:42.555285 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:42.555638 (+ 353us) server_negotiation.cc:299] Negotiation successful
0808 02:36:42.555703 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 02:36:42.556772 26778 raft_consensus.cc:504] T 00000000000000000000000000000000 P df4462ccd67e449cae0b5c25d104c65f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df4462ccd67e449cae0b5c25d104c65f" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 43959 } }
I20260808 02:36:42.557570 26778 leader_election.cc:302] T 00000000000000000000000000000000 P df4462ccd67e449cae0b5c25d104c65f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: df4462ccd67e449cae0b5c25d104c65f; no voters:
I20260808 02:36:42.558338 26778 leader_election.cc:288] T 00000000000000000000000000000000 P df4462ccd67e449cae0b5c25d104c65f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:36:42.558481 26794 raft_consensus.cc:2781] T 00000000000000000000000000000000 P df4462ccd67e449cae0b5c25d104c65f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:36:42.559247 26794 raft_consensus.cc:686] T 00000000000000000000000000000000 P df4462ccd67e449cae0b5c25d104c65f [term 1 LEADER]: Becoming Leader. State: Replica: df4462ccd67e449cae0b5c25d104c65f, State: Running, Role: LEADER
I20260808 02:36:42.559939 26794 consensus_queue.cc:237] T 00000000000000000000000000000000 P df4462ccd67e449cae0b5c25d104c65f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df4462ccd67e449cae0b5c25d104c65f" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 43959 } }
I20260808 02:36:42.562002 26778 sys_catalog.cc:564] T 00000000000000000000000000000000 P df4462ccd67e449cae0b5c25d104c65f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:36:42.563535 26796 sys_catalog.cc:455] T 00000000000000000000000000000000 P df4462ccd67e449cae0b5c25d104c65f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "df4462ccd67e449cae0b5c25d104c65f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df4462ccd67e449cae0b5c25d104c65f" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 43959 } } }
I20260808 02:36:42.563468 26795 sys_catalog.cc:455] T 00000000000000000000000000000000 P df4462ccd67e449cae0b5c25d104c65f [sys.catalog]: SysCatalogTable state changed. Reason: New leader df4462ccd67e449cae0b5c25d104c65f. Latest consensus state: current_term: 1 leader_uuid: "df4462ccd67e449cae0b5c25d104c65f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df4462ccd67e449cae0b5c25d104c65f" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 43959 } } }
I20260808 02:36:42.563968 26796 sys_catalog.cc:458] T 00000000000000000000000000000000 P df4462ccd67e449cae0b5c25d104c65f [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:42.564051 26795 sys_catalog.cc:458] T 00000000000000000000000000000000 P df4462ccd67e449cae0b5c25d104c65f [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:42.566764 26803 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:36:42.572528 26803 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:36:42.587301 26803 catalog_manager.cc:1347] Generated new cluster ID: 6cd6e0d8cc0f4d1f8fc8f62a5b950f47
I20260808 02:36:42.587437 26803 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:36:42.618266 26803 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:36:42.620043 26803 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:36:42.631086 26803 catalog_manager.cc:5868] T 00000000000000000000000000000000 P df4462ccd67e449cae0b5c25d104c65f: Generated new TSK 0
I20260808 02:36:42.632277 26803 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:36:42.641798 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 26671
W20260808 02:36:42.642998 26769 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:56381
W20260808 02:36:42.644240 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 26671: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:36:42.644441 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 26671
W20260808 02:36:42.671257 26650 connection.cc:535] client connection to 127.24.116.254:43959 recv error: Network error: failed to read from TLS socket (remote: 127.24.116.254:43959): Connection reset by peer (error 104)
2026-08-08T02:36:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2358 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:36:42 dist-test-slave-45dx krb5kdc[26826](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:36:42 dist-test-slave-45dx krb5kdc[26826](info): set up 2 sockets
Aug 08 02:36:42 dist-test-slave-45dx krb5kdc[26826](info): commencing operation
krb5kdc: starting...
W20260808 02:36:44.004995 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.315s user 0.000s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:36:44 dist-test-slave-45dx krb5kdc[26826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:36:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:36:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:36:44.367758 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:40257
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:35017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:40257
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:36:44.734229 26845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:44.734512 26845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:44.734604 26845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:44.741681 26845 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:36:44.741815 26845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:44.741870 26845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:44.741938 26845 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:36:44.741983 26845 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:36:44.751874 26845 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:35017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:40257
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:40257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:44.753216 26845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:44.754498 26845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:44.766572 26850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:44.766631 26853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:44.766613 26851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:44.767716 26845 server_base.cc:1034] running on GCE node
I20260808 02:36:44.768595 26845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:44.769968 26845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:44.771212 26845 hybrid_clock.cc:648] HybridClock initialized: now 1786156604771164 us; error 59 us; skew 500 ppm
I20260808 02:36:44.771579 26845 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:44 dist-test-slave-45dx krb5kdc[26826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156604, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:44.774772 26845 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:36:44.776243 26845 webserver.cc:460] Webserver started at http://127.24.116.254:44139/ using document root <none> and password file <none>
I20260808 02:36:44.776955 26845 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:44.777112 26845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:44.777446 26845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:44.780499 26845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "32bd0a3f516c4676896254b08383891c"
format_stamp: "Formatted at 2026-08-08 02:36:44 on dist-test-slave-45dx"
server_key: "573b4ec4f74445112df410f35eb8e0d3"
server_key_iv: "672bd5bd1ac1ad4c2f8d64ff7592418b"
server_key_version: "encryptionkey@0"
I20260808 02:36:44.781281 26845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "32bd0a3f516c4676896254b08383891c"
format_stamp: "Formatted at 2026-08-08 02:36:44 on dist-test-slave-45dx"
server_key: "573b4ec4f74445112df410f35eb8e0d3"
server_key_iv: "672bd5bd1ac1ad4c2f8d64ff7592418b"
server_key_version: "encryptionkey@0"
I20260808 02:36:44.786549 26845 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260808 02:36:44.790063 26862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:44.791446 26845 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 02:36:44.791638 26845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "32bd0a3f516c4676896254b08383891c"
format_stamp: "Formatted at 2026-08-08 02:36:44 on dist-test-slave-45dx"
server_key: "573b4ec4f74445112df410f35eb8e0d3"
server_key_iv: "672bd5bd1ac1ad4c2f8d64ff7592418b"
server_key_version: "encryptionkey@0"
I20260808 02:36:44.791850 26845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:44.797575 26845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:44.801326 26845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:44.801584 26845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:44.820143 26845 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:40257
I20260808 02:36:44.820188 26944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:40257 every 8 connection(s)
I20260808 02:36:44.821547 26845 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:36:44.822928 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 26845
I20260808 02:36:44.823118 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:36:44.823745 25043 external_mini_cluster.cc:1428] Setting key 7d1164eedd6e6f3b07de3ad97492caf9
I20260808 02:36:44.826272 26945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:44.831485 26948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:44.825577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40251 (local address 127.24.116.254:40257)
0808 02:36:44.826385 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:44.826400 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:44.826451 (+ 51us) server_negotiation.cc:407] Connection header received
0808 02:36:44.828030 (+ 1579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:44.828051 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:44.828443 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:44.828778 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:44.829875 (+ 1097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:44.829881 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:44.829893 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:44.829910 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:44.830022 (+ 112us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:44.830042 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:44.830210 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:44.830345 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 02:36:44.830555 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":361,"threads_started":1}
I20260808 02:36:44.835183 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:36:44.839275 26945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32bd0a3f516c4676896254b08383891c: Bootstrap starting.
I20260808 02:36:44.843633 26945 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32bd0a3f516c4676896254b08383891c: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:44.843645 26948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:44.840699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33853 (local address 127.24.116.254:40257)
0808 02:36:44.840909 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:44.840916 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:44.841552 (+ 636us) server_negotiation.cc:407] Connection header received
0808 02:36:44.841760 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:44.841764 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:44.841819 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:44.841911 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:44.842934 (+ 1023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:44.842938 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:44.842941 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:44.842955 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:44.842996 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:44.843011 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:44.843109 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:44.843260 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 02:36:44.843309 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 02:36:44.844919 26945 log.cc:824] T 00000000000000000000000000000000 P 32bd0a3f516c4676896254b08383891c: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:44.848057 26945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32bd0a3f516c4676896254b08383891c: No bootstrap required, opened a new log
I20260808 02:36:44.855775 26945 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32bd0a3f516c4676896254b08383891c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32bd0a3f516c4676896254b08383891c" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40257 } }
I20260808 02:36:44.856262 26945 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32bd0a3f516c4676896254b08383891c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:44.856436 26945 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32bd0a3f516c4676896254b08383891c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32bd0a3f516c4676896254b08383891c, State: Initialized, Role: FOLLOWER
I20260808 02:36:44.857048 26945 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32bd0a3f516c4676896254b08383891c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32bd0a3f516c4676896254b08383891c" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40257 } }
I20260808 02:36:44.857285 26945 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32bd0a3f516c4676896254b08383891c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:36:44.857448 26945 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32bd0a3f516c4676896254b08383891c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:36:44.857641 26945 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32bd0a3f516c4676896254b08383891c [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:44.860245 26945 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32bd0a3f516c4676896254b08383891c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32bd0a3f516c4676896254b08383891c" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40257 } }
I20260808 02:36:44.860848 26945 leader_election.cc:302] T 00000000000000000000000000000000 P 32bd0a3f516c4676896254b08383891c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32bd0a3f516c4676896254b08383891c; no voters:
I20260808 02:36:44.861477 26945 leader_election.cc:288] T 00000000000000000000000000000000 P 32bd0a3f516c4676896254b08383891c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:36:44.861629 26962 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32bd0a3f516c4676896254b08383891c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:36:44.862383 26962 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32bd0a3f516c4676896254b08383891c [term 1 LEADER]: Becoming Leader. State: Replica: 32bd0a3f516c4676896254b08383891c, State: Running, Role: LEADER
I20260808 02:36:44.862955 26962 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32bd0a3f516c4676896254b08383891c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32bd0a3f516c4676896254b08383891c" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40257 } }
I20260808 02:36:44.863802 26945 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32bd0a3f516c4676896254b08383891c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:36:44.865854 26963 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32bd0a3f516c4676896254b08383891c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32bd0a3f516c4676896254b08383891c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32bd0a3f516c4676896254b08383891c" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40257 } } }
I20260808 02:36:44.866262 26963 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32bd0a3f516c4676896254b08383891c [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:44.866742 26965 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32bd0a3f516c4676896254b08383891c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32bd0a3f516c4676896254b08383891c. Latest consensus state: current_term: 1 leader_uuid: "32bd0a3f516c4676896254b08383891c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32bd0a3f516c4676896254b08383891c" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 40257 } } }
I20260808 02:36:44.867049 26965 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32bd0a3f516c4676896254b08383891c [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:44.868964 26972 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:36:44.874112 26972 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:36:44.883116 26972 catalog_manager.cc:1347] Generated new cluster ID: 39cf442bd75248bf9e5f2e5eb159e619
I20260808 02:36:44.883239 26972 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:36:44.898631 26972 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:36:44.899101 26972 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:36:44.906098 26972 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32bd0a3f516c4676896254b08383891c: Generated new TSK 0
I20260808 02:36:44.906991 26972 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:36:44.919077 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 26845
W20260808 02:36:44.920156 26938 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:40251
W20260808 02:36:44.920876 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 26845: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:36:44.921021 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 26845
2026-08-08T02:36:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2279 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:36:45 dist-test-slave-45dx krb5kdc[26994](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:36:45 dist-test-slave-45dx krb5kdc[26994](info): set up 2 sockets
Aug 08 02:36:45 dist-test-slave-45dx krb5kdc[26994](info): commencing operation
krb5kdc: starting...
W20260808 02:36:46.312080 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.342s user 0.007s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:36:46 dist-test-slave-45dx krb5kdc[26994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:36:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:36:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:36:46.675096 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:34317
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:36485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:34317
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:36:47.028144 27015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:47.028549 27015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:47.028734 27015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:47.036082 27015 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:36:47.036239 27015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:47.036363 27015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:47.036505 27015 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:36:47.036598 27015 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:36:47.046773 27015 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:36485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:34317
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:34317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:47.048228 27015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:47.049640 27015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:47.062139 27023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:47.062275 27025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:47.062551 27021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:47.063918 27015 server_base.cc:1034] running on GCE node
I20260808 02:36:47.064805 27015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:47.066219 27015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:47.067430 27015 hybrid_clock.cc:648] HybridClock initialized: now 1786156607067391 us; error 27 us; skew 500 ppm
I20260808 02:36:47.067800 27015 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:47 dist-test-slave-45dx krb5kdc[26994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156607, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:47.071201 27015 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:36:47.072844 27015 webserver.cc:460] Webserver started at http://127.24.116.254:32901/ using document root <none> and password file <none>
I20260808 02:36:47.073558 27015 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:47.073693 27015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:47.074038 27015 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:47.077167 27015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "12bbfa81a43043368a3206506663cd4c"
format_stamp: "Formatted at 2026-08-08 02:36:47 on dist-test-slave-45dx"
server_key: "2c74ef2d71ca5ea09acdaecb73985318"
server_key_iv: "600867c2e88804c03ada007172d1af57"
server_key_version: "encryptionkey@0"
I20260808 02:36:47.077972 27015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "12bbfa81a43043368a3206506663cd4c"
format_stamp: "Formatted at 2026-08-08 02:36:47 on dist-test-slave-45dx"
server_key: "2c74ef2d71ca5ea09acdaecb73985318"
server_key_iv: "600867c2e88804c03ada007172d1af57"
server_key_version: "encryptionkey@0"
I20260808 02:36:47.083240 27015 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 02:36:47.086709 27035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:47.088045 27015 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 02:36:47.088239 27015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "12bbfa81a43043368a3206506663cd4c"
format_stamp: "Formatted at 2026-08-08 02:36:47 on dist-test-slave-45dx"
server_key: "2c74ef2d71ca5ea09acdaecb73985318"
server_key_iv: "600867c2e88804c03ada007172d1af57"
server_key_version: "encryptionkey@0"
I20260808 02:36:47.088457 27015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:47.104399 27015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:47.108914 27015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:47.109215 27015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:47.128883 27015 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:34317
I20260808 02:36:47.128918 27112 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:34317 every 8 connection(s)
I20260808 02:36:47.130329 27015 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:36:47.134095 27113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:47.139596 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 27015
I20260808 02:36:47.139781 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:36:47.140265 25043 external_mini_cluster.cc:1428] Setting key 065ec5075be0748ab0e784e159b27932
I20260808 02:36:47.145191 27113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12bbfa81a43043368a3206506663cd4c: Bootstrap starting.
I20260808 02:36:47.148972 27113 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 12bbfa81a43043368a3206506663cd4c: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:47.150278 27113 log.cc:824] T 00000000000000000000000000000000 P 12bbfa81a43043368a3206506663cd4c: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:47.153825 27113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12bbfa81a43043368a3206506663cd4c: No bootstrap required, opened a new log
Aug 08 02:36:47 dist-test-slave-45dx krb5kdc[26994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:36:47.164772 27113 raft_consensus.cc:348] T 00000000000000000000000000000000 P 12bbfa81a43043368a3206506663cd4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12bbfa81a43043368a3206506663cd4c" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34317 } }
I20260808 02:36:47.165254 27113 raft_consensus.cc:374] T 00000000000000000000000000000000 P 12bbfa81a43043368a3206506663cd4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:47.165373 27113 raft_consensus.cc:729] T 00000000000000000000000000000000 P 12bbfa81a43043368a3206506663cd4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12bbfa81a43043368a3206506663cd4c, State: Initialized, Role: FOLLOWER
I20260808 02:36:47.165895 27122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:47.142206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38707 (local address 127.24.116.254:34317)
0808 02:36:47.143131 (+ 925us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:47.143145 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:47.143190 (+ 45us) server_negotiation.cc:407] Connection header received
0808 02:36:47.144927 (+ 1737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:47.144951 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:47.145314 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:47.145677 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:47.147583 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:47.148949 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:47.150833 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:47.151915 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:47.152061 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:47.157022 (+ 4961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:47.157037 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:47.157057 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:47.157101 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:47.161228 (+ 4127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:47.161906 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:47.161915 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:47.161924 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:47.162139 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:47.162529 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:47.162535 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:47.162544 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:47.163310 (+ 766us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:47.163628 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:47.163972 (+ 344us) server_negotiation.cc:299] Negotiation successful
0808 02:36:47.164451 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":700,"thread_start_us":433,"threads_started":1}
I20260808 02:36:47.166085 27113 consensus_queue.cc:260] T 00000000000000000000000000000000 P 12bbfa81a43043368a3206506663cd4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12bbfa81a43043368a3206506663cd4c" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34317 } }
I20260808 02:36:47.166412 27113 raft_consensus.cc:388] T 00000000000000000000000000000000 P 12bbfa81a43043368a3206506663cd4c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:36:47.166582 27113 raft_consensus.cc:482] T 00000000000000000000000000000000 P 12bbfa81a43043368a3206506663cd4c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:36:47.166786 27113 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 12bbfa81a43043368a3206506663cd4c [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:47.169780 27113 raft_consensus.cc:504] T 00000000000000000000000000000000 P 12bbfa81a43043368a3206506663cd4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12bbfa81a43043368a3206506663cd4c" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34317 } }
I20260808 02:36:47.169962 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:36:47.170337 27113 leader_election.cc:302] T 00000000000000000000000000000000 P 12bbfa81a43043368a3206506663cd4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 12bbfa81a43043368a3206506663cd4c; no voters:
I20260808 02:36:47.170959 27113 leader_election.cc:288] T 00000000000000000000000000000000 P 12bbfa81a43043368a3206506663cd4c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:36:47.171099 27125 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 12bbfa81a43043368a3206506663cd4c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:36:47.173028 27113 sys_catalog.cc:564] T 00000000000000000000000000000000 P 12bbfa81a43043368a3206506663cd4c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:36:47.181047 27125 raft_consensus.cc:686] T 00000000000000000000000000000000 P 12bbfa81a43043368a3206506663cd4c [term 1 LEADER]: Becoming Leader. State: Replica: 12bbfa81a43043368a3206506663cd4c, State: Running, Role: LEADER
I20260808 02:36:47.182009 27125 consensus_queue.cc:237] T 00000000000000000000000000000000 P 12bbfa81a43043368a3206506663cd4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12bbfa81a43043368a3206506663cd4c" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34317 } }
I20260808 02:36:47.185832 27127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12bbfa81a43043368a3206506663cd4c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 12bbfa81a43043368a3206506663cd4c. Latest consensus state: current_term: 1 leader_uuid: "12bbfa81a43043368a3206506663cd4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12bbfa81a43043368a3206506663cd4c" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34317 } } }
I20260808 02:36:47.186496 27127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12bbfa81a43043368a3206506663cd4c [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:47.186091 27126 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12bbfa81a43043368a3206506663cd4c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "12bbfa81a43043368a3206506663cd4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12bbfa81a43043368a3206506663cd4c" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 34317 } } }
I20260808 02:36:47.187117 27126 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12bbfa81a43043368a3206506663cd4c [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:47.189682 27151 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:36:47.195003 27151 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:36:47.196877 27160 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 02:36:47.202539 27122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:47.183549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41699 (local address 127.24.116.254:34317)
0808 02:36:47.183739 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:47.183745 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:47.183924 (+ 179us) server_negotiation.cc:407] Connection header received
0808 02:36:47.184182 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:47.184191 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:47.184296 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:47.184455 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:47.186733 (+ 2278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:47.187868 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:47.189951 (+ 2083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:47.190450 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:47.190561 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:47.194105 (+ 3544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:47.194112 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:47.194117 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:47.194158 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:47.198377 (+ 4219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:47.199311 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:47.199316 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:47.199320 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:47.199472 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:47.199923 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:47.199928 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:47.199931 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:47.200387 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:47.200635 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:47.201053 (+ 418us) server_negotiation.cc:299] Negotiation successful
0808 02:36:47.201281 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 02:36:47.204805 27151 catalog_manager.cc:1347] Generated new cluster ID: 3186e90a465d465484caa3145bde2c0e
I20260808 02:36:47.204948 27151 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:36:47.230748 27151 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:36:47.232142 27151 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:36:47.239104 27151 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 12bbfa81a43043368a3206506663cd4c: Generated new TSK 0
I20260808 02:36:47.240123 27151 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:36:47.252408 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 27015
I20260808 02:36:47.253773 27108 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:36:47.346398 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 27015
2026-08-08T02:36:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2419 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:36:47 dist-test-slave-45dx krb5kdc[27165](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:36:47 dist-test-slave-45dx krb5kdc[27165](info): set up 2 sockets
Aug 08 02:36:47 dist-test-slave-45dx krb5kdc[27165](info): commencing operation
krb5kdc: starting...
W20260808 02:36:48.706267 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.317s user 0.000s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:36:48 dist-test-slave-45dx krb5kdc[27165](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156608, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:36:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:36:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:36:49.063823 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:46431
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:40227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:46431
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:36:49.414441 27189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:49.414805 27189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:49.415141 27189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:49.422667 27189 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:36:49.422822 27189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:49.422931 27189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:49.423053 27189 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:36:49.423146 27189 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:36:49.432941 27189 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:40227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:46431
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:46431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:49.434332 27189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:49.435654 27189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:49.448415 27194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:49.448487 27195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:49.448377 27197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:49.454041 27189 server_base.cc:1034] running on GCE node
I20260808 02:36:49.454924 27189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:49.456467 27189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:49.457698 27189 hybrid_clock.cc:648] HybridClock initialized: now 1786156609457666 us; error 48 us; skew 500 ppm
I20260808 02:36:49.458060 27189 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:49 dist-test-slave-45dx krb5kdc[27165](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156609, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:49.461387 27189 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:36:49.462949 27189 webserver.cc:460] Webserver started at http://127.24.116.254:40201/ using document root <none> and password file <none>
I20260808 02:36:49.463676 27189 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:49.463825 27189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:49.464136 27189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:49.467216 27189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "08e456d559ac4d4999c1b3a3d223a669"
format_stamp: "Formatted at 2026-08-08 02:36:49 on dist-test-slave-45dx"
server_key: "2ccbb7ec3115b7db76109ef27ddd7057"
server_key_iv: "9539c696d9b8375ece6f7015d6d150c1"
server_key_version: "encryptionkey@0"
I20260808 02:36:49.468020 27189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "08e456d559ac4d4999c1b3a3d223a669"
format_stamp: "Formatted at 2026-08-08 02:36:49 on dist-test-slave-45dx"
server_key: "2ccbb7ec3115b7db76109ef27ddd7057"
server_key_iv: "9539c696d9b8375ece6f7015d6d150c1"
server_key_version: "encryptionkey@0"
I20260808 02:36:49.473459 27189 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 02:36:49.477243 27206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:49.478684 27189 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 02:36:49.478892 27189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "08e456d559ac4d4999c1b3a3d223a669"
format_stamp: "Formatted at 2026-08-08 02:36:49 on dist-test-slave-45dx"
server_key: "2ccbb7ec3115b7db76109ef27ddd7057"
server_key_iv: "9539c696d9b8375ece6f7015d6d150c1"
server_key_version: "encryptionkey@0"
I20260808 02:36:49.479101 27189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:49.502393 27189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:49.506587 27189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:49.506896 27189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:49.526023 27189 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:46431
I20260808 02:36:49.526067 27277 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:46431 every 8 connection(s)
I20260808 02:36:49.527421 27189 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:36:49.529176 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 27189
I20260808 02:36:49.529382 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:36:49.529984 25043 external_mini_cluster.cc:1428] Setting key 06e19dc61b3f9df15c3ab4d857f75a7d
I20260808 02:36:49.532091 27278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:49.543346 27282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:49.531784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51755 (local address 127.24.116.254:46431)
0808 02:36:49.532662 (+ 878us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:49.532673 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:49.532711 (+ 38us) server_negotiation.cc:407] Connection header received
0808 02:36:49.534384 (+ 1673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:49.534405 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:49.534776 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:49.535099 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:49.535702 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:49.537125 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:49.538971 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:49.539597 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:49.539724 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:49.541068 (+ 1344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:49.541075 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:49.541088 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:49.541634 (+ 546us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:49.541708 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:49.541754 (+ 46us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:49.541849 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:49.542089 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 02:36:49.542376 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":671,"thread_start_us":473,"threads_started":1}
I20260808 02:36:49.544910 27278 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08e456d559ac4d4999c1b3a3d223a669: Bootstrap starting.
I20260808 02:36:49.547374 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:36:49.548650 27278 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 08e456d559ac4d4999c1b3a3d223a669: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:49.549643 27278 log.cc:824] T 00000000000000000000000000000000 P 08e456d559ac4d4999c1b3a3d223a669: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:49.552237 27278 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08e456d559ac4d4999c1b3a3d223a669: No bootstrap required, opened a new log
I20260808 02:36:49.560353 27282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:49.554216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51115 (local address 127.24.116.254:46431)
0808 02:36:49.554399 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:49.554411 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:49.554819 (+ 408us) server_negotiation.cc:407] Connection header received
0808 02:36:49.555013 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:49.555022 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:49.555093 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:49.555212 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:49.555740 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:49.556563 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:49.557849 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:49.558326 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:49.558480 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:49.559568 (+ 1088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:49.559572 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:49.559575 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:49.559591 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:49.559627 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:49.559642 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:49.559756 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:49.559919 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 02:36:49.560006 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 02:36:49.560724 27278 raft_consensus.cc:348] T 00000000000000000000000000000000 P 08e456d559ac4d4999c1b3a3d223a669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08e456d559ac4d4999c1b3a3d223a669" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 46431 } }
I20260808 02:36:49.561106 27278 raft_consensus.cc:374] T 00000000000000000000000000000000 P 08e456d559ac4d4999c1b3a3d223a669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:49.561228 27278 raft_consensus.cc:729] T 00000000000000000000000000000000 P 08e456d559ac4d4999c1b3a3d223a669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e456d559ac4d4999c1b3a3d223a669, State: Initialized, Role: FOLLOWER
I20260808 02:36:49.561839 27278 consensus_queue.cc:260] T 00000000000000000000000000000000 P 08e456d559ac4d4999c1b3a3d223a669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08e456d559ac4d4999c1b3a3d223a669" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 46431 } }
I20260808 02:36:49.562130 27278 raft_consensus.cc:388] T 00000000000000000000000000000000 P 08e456d559ac4d4999c1b3a3d223a669 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:36:49.562281 27278 raft_consensus.cc:482] T 00000000000000000000000000000000 P 08e456d559ac4d4999c1b3a3d223a669 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:36:49.562467 27278 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 08e456d559ac4d4999c1b3a3d223a669 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:49.564646 27278 raft_consensus.cc:504] T 00000000000000000000000000000000 P 08e456d559ac4d4999c1b3a3d223a669 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08e456d559ac4d4999c1b3a3d223a669" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 46431 } }
I20260808 02:36:49.565181 27278 leader_election.cc:302] T 00000000000000000000000000000000 P 08e456d559ac4d4999c1b3a3d223a669 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 08e456d559ac4d4999c1b3a3d223a669; no voters:
I20260808 02:36:49.565728 27278 leader_election.cc:288] T 00000000000000000000000000000000 P 08e456d559ac4d4999c1b3a3d223a669 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:36:49.565888 27293 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 08e456d559ac4d4999c1b3a3d223a669 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:36:49.567349 27293 raft_consensus.cc:686] T 00000000000000000000000000000000 P 08e456d559ac4d4999c1b3a3d223a669 [term 1 LEADER]: Becoming Leader. State: Replica: 08e456d559ac4d4999c1b3a3d223a669, State: Running, Role: LEADER
I20260808 02:36:49.567911 27278 sys_catalog.cc:564] T 00000000000000000000000000000000 P 08e456d559ac4d4999c1b3a3d223a669 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:36:49.567826 27293 consensus_queue.cc:237] T 00000000000000000000000000000000 P 08e456d559ac4d4999c1b3a3d223a669 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08e456d559ac4d4999c1b3a3d223a669" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 46431 } }
I20260808 02:36:49.570979 27294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08e456d559ac4d4999c1b3a3d223a669 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "08e456d559ac4d4999c1b3a3d223a669" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08e456d559ac4d4999c1b3a3d223a669" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 46431 } } }
I20260808 02:36:49.571071 27297 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08e456d559ac4d4999c1b3a3d223a669 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 08e456d559ac4d4999c1b3a3d223a669. Latest consensus state: current_term: 1 leader_uuid: "08e456d559ac4d4999c1b3a3d223a669" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08e456d559ac4d4999c1b3a3d223a669" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 46431 } } }
I20260808 02:36:49.571406 27294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08e456d559ac4d4999c1b3a3d223a669 [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:49.571460 27297 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08e456d559ac4d4999c1b3a3d223a669 [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:49.581779 27304 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:36:49.587690 27304 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:36:49.596187 27304 catalog_manager.cc:1347] Generated new cluster ID: f2d04ba7fa1140feb3c6c3186624fa0c
I20260808 02:36:49.596376 27304 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:36:49.608922 27304 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:36:49.610258 27304 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:36:49.621996 27304 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 08e456d559ac4d4999c1b3a3d223a669: Generated new TSK 0
I20260808 02:36:49.622907 27304 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:36:49.640247 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 27189
W20260808 02:36:49.641417 27273 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:51755
W20260808 02:36:49.642292 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 27189: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:36:49.642450 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 27189
2026-08-08T02:36:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2293 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:36:49 dist-test-slave-45dx krb5kdc[27330](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:36:49 dist-test-slave-45dx krb5kdc[27330](info): set up 2 sockets
Aug 08 02:36:49 dist-test-slave-45dx krb5kdc[27330](info): commencing operation
krb5kdc: starting...
W20260808 02:36:50.986150 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.303s user 0.006s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:36:51 dist-test-slave-45dx krb5kdc[27330](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156611, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:36:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:36:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:36:51.353780 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:36129
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:38697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:36129
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:36:51.702855 27355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:51.703184 27355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:51.703369 27355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:51.710719 27355 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:36:51.710835 27355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:51.710935 27355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:51.711051 27355 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:36:51.711143 27355 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:36:51.721467 27355 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:38697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:36129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:36129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:51.722883 27355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:51.724257 27355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:51.736503 27362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:51.736457 27368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:51.736415 27363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:51.737454 27355 server_base.cc:1034] running on GCE node
I20260808 02:36:51.738338 27355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:51.739825 27355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:51.741062 27355 hybrid_clock.cc:648] HybridClock initialized: now 1786156611741025 us; error 38 us; skew 500 ppm
I20260808 02:36:51.741427 27355 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:51 dist-test-slave-45dx krb5kdc[27330](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156611, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:51.748786 27355 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:36:51.750396 27355 webserver.cc:460] Webserver started at http://127.24.116.254:37483/ using document root <none> and password file <none>
I20260808 02:36:51.751099 27355 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:51.751255 27355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:51.751593 27355 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:51.754675 27355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "57e4c0dbd5bf4655941e3eb259388eda"
format_stamp: "Formatted at 2026-08-08 02:36:51 on dist-test-slave-45dx"
server_key: "9b7737ab900ffa27b957a97ddcfd8312"
server_key_iv: "110bf4359944c50be5a24d18d64378d5"
server_key_version: "encryptionkey@0"
I20260808 02:36:51.755455 27355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "57e4c0dbd5bf4655941e3eb259388eda"
format_stamp: "Formatted at 2026-08-08 02:36:51 on dist-test-slave-45dx"
server_key: "9b7737ab900ffa27b957a97ddcfd8312"
server_key_iv: "110bf4359944c50be5a24d18d64378d5"
server_key_version: "encryptionkey@0"
I20260808 02:36:51.760851 27355 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.003s
I20260808 02:36:51.764394 27376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:51.765697 27355 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:36:51.765893 27355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "57e4c0dbd5bf4655941e3eb259388eda"
format_stamp: "Formatted at 2026-08-08 02:36:51 on dist-test-slave-45dx"
server_key: "9b7737ab900ffa27b957a97ddcfd8312"
server_key_iv: "110bf4359944c50be5a24d18d64378d5"
server_key_version: "encryptionkey@0"
I20260808 02:36:51.766103 27355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:51.772032 27355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:51.776001 27355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:51.776429 27355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:51.796445 27355 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:36129
I20260808 02:36:51.796550 27451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:36129 every 8 connection(s)
I20260808 02:36:51.797889 27355 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:36:51.799010 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 27355
I20260808 02:36:51.799192 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:36:51.799616 25043 external_mini_cluster.cc:1428] Setting key b15d1d81ba25d00d937d8357f6d7a938
I20260808 02:36:51.802783 27452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:51.809311 27455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:51.801518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47993 (local address 127.24.116.254:36129)
0808 02:36:51.802426 (+ 908us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:51.802443 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:51.802498 (+ 55us) server_negotiation.cc:407] Connection header received
0808 02:36:51.805088 (+ 2590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:51.805119 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:51.805556 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:51.806067 (+ 511us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:51.807168 (+ 1101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:51.807178 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:51.807195 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:51.807215 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:51.807313 (+ 98us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:51.807343 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:51.807588 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:51.807737 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 02:36:51.807959 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":354,"threads_started":1}
I20260808 02:36:51.812979 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:36:51.816745 27452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57e4c0dbd5bf4655941e3eb259388eda: Bootstrap starting.
I20260808 02:36:51.820128 27455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:51.817583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44051 (local address 127.24.116.254:36129)
0808 02:36:51.817770 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:51.817776 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:51.818160 (+ 384us) server_negotiation.cc:407] Connection header received
0808 02:36:51.818296 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:51.818302 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:51.818382 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:51.818523 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:51.819422 (+ 899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:51.819428 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:51.819432 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:36:51.819452 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:51.819506 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:36:51.819529 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:51.819657 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:51.819710 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 02:36:51.819792 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 02:36:51.821203 27452 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57e4c0dbd5bf4655941e3eb259388eda: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:51.822497 27452 log.cc:824] T 00000000000000000000000000000000 P 57e4c0dbd5bf4655941e3eb259388eda: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:51.825568 27452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57e4c0dbd5bf4655941e3eb259388eda: No bootstrap required, opened a new log
I20260808 02:36:51.834208 27452 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57e4c0dbd5bf4655941e3eb259388eda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57e4c0dbd5bf4655941e3eb259388eda" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 36129 } }
I20260808 02:36:51.834764 27452 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57e4c0dbd5bf4655941e3eb259388eda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:36:51.834889 27452 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57e4c0dbd5bf4655941e3eb259388eda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57e4c0dbd5bf4655941e3eb259388eda, State: Initialized, Role: FOLLOWER
I20260808 02:36:51.835541 27452 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57e4c0dbd5bf4655941e3eb259388eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57e4c0dbd5bf4655941e3eb259388eda" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 36129 } }
I20260808 02:36:51.835821 27452 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57e4c0dbd5bf4655941e3eb259388eda [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:36:51.835985 27452 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57e4c0dbd5bf4655941e3eb259388eda [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:36:51.836191 27452 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57e4c0dbd5bf4655941e3eb259388eda [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:51.838696 27452 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57e4c0dbd5bf4655941e3eb259388eda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57e4c0dbd5bf4655941e3eb259388eda" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 36129 } }
I20260808 02:36:51.839375 27452 leader_election.cc:302] T 00000000000000000000000000000000 P 57e4c0dbd5bf4655941e3eb259388eda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57e4c0dbd5bf4655941e3eb259388eda; no voters:
I20260808 02:36:51.840062 27452 leader_election.cc:288] T 00000000000000000000000000000000 P 57e4c0dbd5bf4655941e3eb259388eda [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:36:51.840211 27468 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57e4c0dbd5bf4655941e3eb259388eda [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:36:51.841029 27468 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57e4c0dbd5bf4655941e3eb259388eda [term 1 LEADER]: Becoming Leader. State: Replica: 57e4c0dbd5bf4655941e3eb259388eda, State: Running, Role: LEADER
I20260808 02:36:51.841681 27468 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57e4c0dbd5bf4655941e3eb259388eda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57e4c0dbd5bf4655941e3eb259388eda" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 36129 } }
I20260808 02:36:51.842509 27452 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57e4c0dbd5bf4655941e3eb259388eda [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:36:51.845641 27471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57e4c0dbd5bf4655941e3eb259388eda [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57e4c0dbd5bf4655941e3eb259388eda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57e4c0dbd5bf4655941e3eb259388eda" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 36129 } } }
I20260808 02:36:51.845546 27472 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57e4c0dbd5bf4655941e3eb259388eda [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57e4c0dbd5bf4655941e3eb259388eda. Latest consensus state: current_term: 1 leader_uuid: "57e4c0dbd5bf4655941e3eb259388eda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57e4c0dbd5bf4655941e3eb259388eda" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 36129 } } }
I20260808 02:36:51.846135 27471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57e4c0dbd5bf4655941e3eb259388eda [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:51.846196 27472 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57e4c0dbd5bf4655941e3eb259388eda [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:51.847688 27477 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:36:51.852077 27477 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:36:51.861938 27477 catalog_manager.cc:1347] Generated new cluster ID: 6cba0a087dd04f6e9a8a183c54ddca9b
I20260808 02:36:51.862063 27477 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:36:51.879391 27477 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:36:51.880283 27477 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:36:51.887002 27477 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57e4c0dbd5bf4655941e3eb259388eda: Generated new TSK 0
I20260808 02:36:51.887831 27477 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:36:51.897722 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 27355
W20260808 02:36:51.898988 27446 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:47993
W20260808 02:36:51.899797 25043 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 27355: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:36:51.899956 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 27355
2026-08-08T02:36:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2262 ms)
[----------] 18 tests from AuthTokenIssuingTest (42037 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:36:52 dist-test-slave-45dx krb5kdc[27500](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:36:52 dist-test-slave-45dx krb5kdc[27500](info): set up 2 sockets
Aug 08 02:36:52 dist-test-slave-45dx krb5kdc[27500](info): commencing operation
krb5kdc: starting...
W20260808 02:36:53.285734 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.339s user 0.000s sys 0.056s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:36:53 dist-test-slave-45dx krb5kdc[27500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:36:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:36:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:36:53.660600 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:38295
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:41029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:38295,127.24.116.253:45865,127.24.116.252:39609
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:36:54.026140 27520 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 02:36:54.026554 27520 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:54.026682 27520 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:54.026844 27520 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:54.034317 27520 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:36:54.034462 27520 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:54.034569 27520 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:54.034664 27520 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:36:54.034754 27520 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:36:54.045184 27520 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:41029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:38295,127.24.116.253:45865,127.24.116.252:39609
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:38295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:54.046599 27520 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:54.047993 27520 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:54.060052 27528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:54.060045 27529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:54.060261 27531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:54.061564 27520 server_base.cc:1034] running on GCE node
I20260808 02:36:54.062443 27520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:54.063916 27520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:54.065199 27520 hybrid_clock.cc:648] HybridClock initialized: now 1786156614065135 us; error 37 us; skew 500 ppm
I20260808 02:36:54.065568 27520 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:54 dist-test-slave-45dx krb5kdc[27500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156614, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:54.068989 27520 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:36:54.070643 27520 webserver.cc:460] Webserver started at http://127.24.116.254:35853/ using document root <none> and password file <none>
I20260808 02:36:54.071401 27520 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:54.071552 27520 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:54.071918 27520 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:54.075088 27520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "78420228a6be4d58975cadf9b6cbebc5"
format_stamp: "Formatted at 2026-08-08 02:36:54 on dist-test-slave-45dx"
server_key: "7d5904ae52b258644dda3646fe521651"
server_key_iv: "9fb43562c9f68d415eef3623efa0eb7d"
server_key_version: "encryptionkey@0"
I20260808 02:36:54.075944 27520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "78420228a6be4d58975cadf9b6cbebc5"
format_stamp: "Formatted at 2026-08-08 02:36:54 on dist-test-slave-45dx"
server_key: "7d5904ae52b258644dda3646fe521651"
server_key_iv: "9fb43562c9f68d415eef3623efa0eb7d"
server_key_version: "encryptionkey@0"
I20260808 02:36:54.081244 27520 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260808 02:36:54.084870 27541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:54.086212 27520 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 02:36:54.086402 27520 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "78420228a6be4d58975cadf9b6cbebc5"
format_stamp: "Formatted at 2026-08-08 02:36:54 on dist-test-slave-45dx"
server_key: "7d5904ae52b258644dda3646fe521651"
server_key_iv: "9fb43562c9f68d415eef3623efa0eb7d"
server_key_version: "encryptionkey@0"
I20260808 02:36:54.086627 27520 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:54.107472 27520 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:54.111727 27520 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:54.112042 27520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:54.131568 27520 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:38295
I20260808 02:36:54.131606 27629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:38295 every 8 connection(s)
I20260808 02:36:54.133034 27520 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:36:54.136896 27630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:54.137311 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 27520
I20260808 02:36:54.137550 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:36:54.138401 25043 external_mini_cluster.cc:1428] Setting key 57732e847898724e67f01c6cd4783c7b
I20260808 02:36:54.147593 27630 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38295 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:36:54 dist-test-slave-45dx krb5kdc[27500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156614, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.116.253@KRBTEST.COM; defaulting to no policy
I20260808 02:36:54.178602 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.151816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:38295 (local address 127.0.0.1:34912)
0808 02:36:54.157054 (+ 5238us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.157105 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:54.159195 (+ 2090us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:54.160278 (+ 1083us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:54.160283 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:54.160938 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:36:54.161287 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:54.161305 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:54.163713 (+ 2408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:54.163717 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:54.164897 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:54.164910 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:54.166253 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:54.166258 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:54.166405 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:54.167285 (+ 880us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:36:54.167314 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:36:54.169693 (+ 2379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:36:54.174397 (+ 4704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:54.174407 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:54.174417 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:54.174850 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:54.175367 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:54.175370 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:54.175373 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:54.175527 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:54.176579 (+ 1052us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:36:54.176585 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:36:54.176815 (+ 230us) client_negotiation.cc:769] Sending connection context
0808 02:36:54.177033 (+ 218us) client_negotiation.cc:240] Negotiation successful
0808 02:36:54.177417 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4927,"mutex_wait_us":1,"thread_start_us":4680,"threads_started":1}
I20260808 02:36:54.178635 27634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.151816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34912 (local address 127.24.116.254:38295)
0808 02:36:54.156645 (+ 4829us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:54.156673 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:54.157269 (+ 596us) server_negotiation.cc:407] Connection header received
0808 02:36:54.159617 (+ 2348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:54.159628 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:54.160000 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:54.160256 (+ 256us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:54.161534 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:54.163557 (+ 2023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:54.165042 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:54.166031 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:54.166265 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:54.169997 (+ 3732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:54.170018 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:54.170042 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:54.170097 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:54.174235 (+ 4138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:54.175008 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:54.175019 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:54.175025 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:54.175246 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:54.175667 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:54.175672 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:54.175676 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:54.176440 (+ 764us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:54.176662 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:54.177259 (+ 597us) server_negotiation.cc:299] Negotiation successful
0808 02:36:54.177574 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":4483,"spinlock_wait_cycles":17664,"thread_start_us":4189,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.253@KRBTEST.COM" created.
I20260808 02:36:54.181685 27630 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } has no permanent_uuid. Determining permanent_uuid...
I20260808 02:36:54.182891 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.182496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:45865 (local address 127.0.0.1:45512)
0808 02:36:54.182665 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.182771 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:45865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260808 02:36:54.183171 27544 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.116.253:45865: connect: Connection refused (error 111)
I20260808 02:36:54.184811 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.184462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:45865 (local address 127.0.0.1:45524)
0808 02:36:54.184604 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.184677 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:45865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 02:36:54.185020 27630 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.253:45865: Network error: Client connection negotiation failed: client connection to 127.24.116.253:45865: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.253.keytab.
Entry for principal kudu/127.24.116.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.253.keytab.
I20260808 02:36:54.219478 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.253:45865
--webserver_interface=127.24.116.253
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.253.keytab
--principal=kudu/127.24.116.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:41029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:38295,127.24.116.253:45865,127.24.116.252:39609
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:36:54.234355 27630 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } attempt: 1
I20260808 02:36:54.235836 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.235148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:45865 (local address 127.0.0.1:45536)
0808 02:36:54.235417 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.235614 (+ 197us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:45865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260808 02:36:54.236999 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.236595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:45865 (local address 127.0.0.1:45544)
0808 02:36:54.236794 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.236865 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:45865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260808 02:36:54.237197 27630 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.253:45865: Network error: Client connection negotiation failed: client connection to 127.24.116.253:45865: connect: Connection refused (error 111)
I20260808 02:36:54.305456 27630 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } attempt: 2
I20260808 02:36:54.306768 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.306235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:45865 (local address 127.0.0.1:45546)
0808 02:36:54.306520 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.306616 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:45865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260808 02:36:54.307853 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.307459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:45865 (local address 127.0.0.1:45558)
0808 02:36:54.307635 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.307702 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:45865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 02:36:54.308053 27630 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.253:45865: Network error: Client connection negotiation failed: client connection to 127.24.116.253:45865: connect: Connection refused (error 111)
I20260808 02:36:54.399323 27630 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } attempt: 3
I20260808 02:36:54.400745 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.400201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:45865 (local address 127.0.0.1:45572)
0808 02:36:54.400509 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.400606 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:45865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168}
I20260808 02:36:54.401889 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.401446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:45865 (local address 127.0.0.1:45576)
0808 02:36:54.401623 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.401697 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:45865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 02:36:54.402094 27630 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.253:45865: Network error: Client connection negotiation failed: client connection to 127.24.116.253:45865: connect: Connection refused (error 111)
I20260808 02:36:54.545338 27630 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } attempt: 4
I20260808 02:36:54.546676 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.546112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:45865 (local address 127.0.0.1:45578)
0808 02:36:54.546441 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.546533 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:45865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153}
I20260808 02:36:54.547686 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.547322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:45865 (local address 127.0.0.1:45592)
0808 02:36:54.547462 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.547553 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:45865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 02:36:54.547914 27630 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.253:45865: Network error: Client connection negotiation failed: client connection to 127.24.116.253:45865: connect: Connection refused (error 111)
W20260808 02:36:54.585843 27640 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 02:36:54.586256 27640 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:54.586386 27640 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:54.586521 27640 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:54.594269 27640 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:36:54.594416 27640 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:54.594535 27640 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:54.594628 27640 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:36:54.594743 27640 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:36:54.604810 27640 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:41029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:38295,127.24.116.253:45865,127.24.116.252:39609
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.253.keytab
--principal=kudu/127.24.116.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.253:45865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.24.116.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:54.606165 27640 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:54.607509 27640 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:54.619422 27653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:54.619560 27648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:54.619585 27651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:54.620601 27640 server_base.cc:1034] running on GCE node
I20260808 02:36:54.621516 27640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:54.622936 27640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:54.624284 27640 hybrid_clock.cc:648] HybridClock initialized: now 1786156614624202 us; error 49 us; skew 500 ppm
I20260808 02:36:54.624711 27640 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:54 dist-test-slave-45dx krb5kdc[27500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156614, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:54.628201 27640 init.cc:377] Logged in from keytab as kudu/127.24.116.253@KRBTEST.COM (short username kudu)
I20260808 02:36:54.629703 27640 webserver.cc:460] Webserver started at http://127.24.116.253:33987/ using document root <none> and password file <none>
I20260808 02:36:54.630431 27640 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:54.630570 27640 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:54.630934 27640 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:54.633973 27640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-1/data/instance:
uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042"
format_stamp: "Formatted at 2026-08-08 02:36:54 on dist-test-slave-45dx"
server_key: "87409c8485614d5cbd95ddfe824dd035"
server_key_iv: "64fa595ad507b92b90bb57cea6762bbd"
server_key_version: "encryptionkey@0"
I20260808 02:36:54.634800 27640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-1/wal/instance:
uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042"
format_stamp: "Formatted at 2026-08-08 02:36:54 on dist-test-slave-45dx"
server_key: "87409c8485614d5cbd95ddfe824dd035"
server_key_iv: "64fa595ad507b92b90bb57cea6762bbd"
server_key_version: "encryptionkey@0"
I20260808 02:36:54.640130 27640 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260808 02:36:54.643606 27664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:54.644995 27640 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:36:54.645205 27640 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-1/wal
uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042"
format_stamp: "Formatted at 2026-08-08 02:36:54 on dist-test-slave-45dx"
server_key: "87409c8485614d5cbd95ddfe824dd035"
server_key_iv: "64fa595ad507b92b90bb57cea6762bbd"
server_key_version: "encryptionkey@0"
I20260808 02:36:54.645449 27640 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:54.661599 27640 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:54.665814 27640 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:54.666150 27640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:54.685559 27640 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.253:45865
I20260808 02:36:54.685582 27736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.253:45865 every 8 connection(s)
I20260808 02:36:54.686939 27640 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-1/data/info.pb
I20260808 02:36:54.690768 27742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:54.696738 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 27640
I20260808 02:36:54.696946 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-1/wal/instance
I20260808 02:36:54.697417 25043 external_mini_cluster.cc:1428] Setting key ad6ab6aeaf4b677697bff7d4a867fa1f
I20260808 02:36:54.697700 27742 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38295 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:36:54 dist-test-slave-45dx krb5kdc[27500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156614, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.253@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:36:54.722553 27745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.700341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34926 (local address 127.24.116.254:38295)
0808 02:36:54.700907 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:54.700916 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:54.702030 (+ 1114us) server_negotiation.cc:407] Connection header received
0808 02:36:54.705009 (+ 2979us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:54.705014 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:54.705085 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:54.705197 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:54.707479 (+ 2282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:54.708221 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:54.710723 (+ 2502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:54.711145 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:54.711266 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:54.716054 (+ 4788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:54.716060 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:54.716064 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:54.716112 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:54.718977 (+ 2865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:54.719985 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:54.719990 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:54.719992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:54.720121 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:54.720727 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:54.720732 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:54.720734 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:54.721028 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:54.721148 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:54.722100 (+ 952us) server_negotiation.cc:299] Negotiation successful
0808 02:36:54.722283 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":271,"threads_started":1}
I20260808 02:36:54.724198 27747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.700956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:38295 (local address 127.0.0.1:34926)
0808 02:36:54.701818 (+ 862us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.701871 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:54.704663 (+ 2792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:54.705482 (+ 819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:54.705496 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:54.706358 (+ 862us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:36:54.707203 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:54.707231 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:54.708499 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:54.708507 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:54.710543 (+ 2036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:54.710567 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:54.711384 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:54.711393 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:54.711730 (+ 337us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:54.712624 (+ 894us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:36:54.712660 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:36:54.715786 (+ 3126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:36:54.719136 (+ 3350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:54.719148 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:54.719169 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:54.719847 (+ 678us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:54.720240 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:54.720248 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:54.720254 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:54.720598 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:54.721167 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:36:54.721178 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:36:54.721654 (+ 476us) client_negotiation.cc:769] Sending connection context
0808 02:36:54.721997 (+ 343us) client_negotiation.cc:240] Negotiation successful
0808 02:36:54.722637 (+ 640us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":298,"threads_started":1}
I20260808 02:36:54.726143 27742 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.24.116.252@KRBTEST.COM; defaulting to no policy
Aug 08 02:36:54 dist-test-slave-45dx krb5kdc[27500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156614, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.253@KRBTEST.COM for kudu/127.24.116.253@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.252@KRBTEST.COM" created.
I20260808 02:36:54.741557 27747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.727017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:45865 (local address 127.0.0.1:45604)
0808 02:36:54.727193 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.727214 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:54.727316 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:54.728351 (+ 1035us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:54.728356 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:54.728801 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:36:54.728931 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:54.728939 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:54.730349 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:54.730357 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:54.731198 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:54.731209 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:54.732014 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:54.732020 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:54.732237 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:54.732905 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:36:54.732921 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:36:54.734906 (+ 1985us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:36:54.738978 (+ 4072us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:54.738982 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:54.738985 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:54.739381 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:54.739846 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:54.739849 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:54.739852 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:54.740000 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:54.740788 (+ 788us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:36:54.740797 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:36:54.740923 (+ 126us) client_negotiation.cc:769] Sending connection context
0808 02:36:54.741046 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 02:36:54.741256 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59,"mutex_wait_us":4}
I20260808 02:36:54.742044 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.727266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45604 (local address 127.24.116.253:45865)
0808 02:36:54.727944 (+ 678us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:54.727950 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:54.727973 (+ 23us) server_negotiation.cc:407] Connection header received
0808 02:36:54.728013 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:54.728018 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:54.728178 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:54.728355 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:54.729133 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:54.730207 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:54.731339 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:54.731868 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:54.732008 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:54.735121 (+ 3113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:54.735132 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:54.735144 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:54.735171 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:54.738801 (+ 3630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:54.739538 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:54.739550 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:54.739556 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:54.739721 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:54.740115 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:54.740122 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:54.740128 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:54.740648 (+ 520us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:54.740886 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:54.741240 (+ 354us) server_negotiation.cc:299] Negotiation successful
0808 02:36:54.741540 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":534,"thread_start_us":391,"threads_started":1}
I20260808 02:36:54.744501 27742 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } has no permanent_uuid. Determining permanent_uuid...
I20260808 02:36:54.745846 27747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.745282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:39609 (local address 127.0.0.1:60944)
0808 02:36:54.745518 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.745656 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260808 02:36:54.746147 27665 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
I20260808 02:36:54.747905 27747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.747467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:39609 (local address 127.0.0.1:60956)
0808 02:36:54.747663 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.747762 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 02:36:54.748219 27742 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:39609: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.252.keytab.
Entry for principal kudu/127.24.116.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.252.keytab.
I20260808 02:36:54.777702 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.252:39609
--webserver_interface=127.24.116.252
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.252.keytab
--principal=kudu/127.24.116.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:41029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:38295,127.24.116.253:45865,127.24.116.252:39609
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:36:54.797626 27742 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } attempt: 1
I20260808 02:36:54.798995 27747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.798386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:39609 (local address 127.0.0.1:60962)
0808 02:36:54.798639 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.798775 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260808 02:36:54.800233 27747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.799773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:39609 (local address 127.0.0.1:60972)
0808 02:36:54.799975 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.800080 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 02:36:54.800480 27742 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:39609: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
I20260808 02:36:54.847152 27630 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } attempt: 5
Aug 08 02:36:54 dist-test-slave-45dx krb5kdc[27500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156614, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for kudu/127.24.116.253@KRBTEST.COM
I20260808 02:36:54.861795 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.847941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:45865 (local address 127.0.0.1:45614)
0808 02:36:54.848175 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.848194 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:54.848341 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:54.848736 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:54.848739 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:54.849134 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:36:54.849367 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:54.849376 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:54.850784 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:54.850788 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:54.851635 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:54.851646 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:54.852623 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:54.852628 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:54.852793 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:54.853462 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:36:54.853479 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:36:54.855480 (+ 2001us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:36:54.859443 (+ 3963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:54.859447 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:54.859449 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:54.859806 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:54.860204 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:54.860207 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:54.860210 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:54.860408 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:54.861062 (+ 654us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:36:54.861066 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:36:54.861194 (+ 128us) client_negotiation.cc:769] Sending connection context
0808 02:36:54.861306 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 02:36:54.861524 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260808 02:36:54.862071 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.848067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45614 (local address 127.24.116.253:45865)
0808 02:36:54.848285 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:54.848292 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:54.848350 (+ 58us) server_negotiation.cc:407] Connection header received
0808 02:36:54.848479 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:54.848485 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:54.848567 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:54.848677 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:54.849556 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:54.850650 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:54.851795 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:54.852475 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:54.852613 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:54.855684 (+ 3071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:54.855691 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:54.855696 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:54.855735 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:54.859280 (+ 3545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:54.859929 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:54.859934 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:54.859938 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:54.860091 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:54.860512 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:54.860517 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:54.860520 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:54.860935 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:54.861113 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:54.861480 (+ 367us) server_negotiation.cc:299] Negotiation successful
0808 02:36:54.861751 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 02:36:54.863063 27630 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } has no permanent_uuid. Determining permanent_uuid...
I20260808 02:36:54.864123 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.863736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:39609 (local address 127.0.0.1:60974)
0808 02:36:54.863904 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.863994 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 02:36:54.865095 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.864778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:39609 (local address 127.0.0.1:60990)
0808 02:36:54.864935 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.865002 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 02:36:54.865300 27630 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:39609: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
I20260808 02:36:54.868700 27742 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } attempt: 2
I20260808 02:36:54.869656 27747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.869193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:39609 (local address 127.0.0.1:60996)
0808 02:36:54.869390 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.869492 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 02:36:54.870644 27747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.870259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:39609 (local address 127.0.0.1:32780)
0808 02:36:54.870415 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.870498 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 02:36:54.870867 27742 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:39609: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
I20260808 02:36:54.916561 27630 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } attempt: 1
I20260808 02:36:54.917832 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.917316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:39609 (local address 127.0.0.1:32790)
0808 02:36:54.917545 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.917654 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260808 02:36:54.918948 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.918568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:39609 (local address 127.0.0.1:32800)
0808 02:36:54.918728 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.918809 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260808 02:36:54.919271 27630 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:39609: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
I20260808 02:36:54.962144 27742 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } attempt: 3
I20260808 02:36:54.963657 27747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.962963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:39609 (local address 127.0.0.1:32810)
0808 02:36:54.963241 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.963412 (+ 171us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260808 02:36:54.965135 27747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.964575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:39609 (local address 127.0.0.1:32814)
0808 02:36:54.964856 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.964966 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157}
W20260808 02:36:54.965418 27742 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:39609: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
I20260808 02:36:54.987519 27630 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } attempt: 2
I20260808 02:36:54.989128 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.988394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:39609 (local address 127.0.0.1:32830)
0808 02:36:54.988701 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.988845 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260808 02:36:54.991575 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:54.990994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:39609 (local address 127.0.0.1:32844)
0808 02:36:54.991277 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:54.991421 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260808 02:36:54.996666 27630 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:39609: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
I20260808 02:36:55.103062 27630 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } attempt: 3
I20260808 02:36:55.104192 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.103720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:39609 (local address 127.0.0.1:32850)
0808 02:36:55.103925 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:55.104018 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260808 02:36:55.105281 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.104932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:39609 (local address 127.0.0.1:32852)
0808 02:36:55.105111 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:55.105184 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
W20260808 02:36:55.105506 27630 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:39609: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
I20260808 02:36:55.108659 27742 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } attempt: 4
I20260808 02:36:55.109802 27747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.109273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:39609 (local address 127.0.0.1:32858)
0808 02:36:55.109507 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:55.109626 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260808 02:36:55.110882 27747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.110502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:39609 (local address 127.0.0.1:32874)
0808 02:36:55.110660 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:55.110750 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 02:36:55.111111 27742 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:39609: Network error: Client connection negotiation failed: client connection to 127.24.116.252:39609: connect: Connection refused (error 111)
W20260808 02:36:55.146143 27753 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 02:36:55.146466 27753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:55.146546 27753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:55.146627 27753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:55.154064 27753 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:36:55.154158 27753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:55.154214 27753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:55.154265 27753 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:36:55.154320 27753 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:36:55.164099 27753 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:41029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:38295,127.24.116.253:45865,127.24.116.252:39609
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.252.keytab
--principal=kudu/127.24.116.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.252:39609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.24.116.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:55.165504 27753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:55.166821 27753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:55.178584 27761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:55.178632 27768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:55.178810 27765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:55.180104 27753 server_base.cc:1034] running on GCE node
I20260808 02:36:55.180994 27753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:55.182382 27753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:55.183612 27753 hybrid_clock.cc:648] HybridClock initialized: now 1786156615183543 us; error 42 us; skew 500 ppm
I20260808 02:36:55.184010 27753 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:55 dist-test-slave-45dx krb5kdc[27500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156615, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:55.187325 27753 init.cc:377] Logged in from keytab as kudu/127.24.116.252@KRBTEST.COM (short username kudu)
I20260808 02:36:55.188915 27753 webserver.cc:460] Webserver started at http://127.24.116.252:36689/ using document root <none> and password file <none>
I20260808 02:36:55.189668 27753 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:55.189821 27753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:55.190155 27753 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:55.193221 27753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-2/data/instance:
uuid: "4adf2ea5eb39426cb8a06960b09e16f4"
format_stamp: "Formatted at 2026-08-08 02:36:55 on dist-test-slave-45dx"
server_key: "8405564781006a46f9dc91a516dee9d6"
server_key_iv: "144887098a118f17a33de5c3730c059e"
server_key_version: "encryptionkey@0"
I20260808 02:36:55.194037 27753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-2/wal/instance:
uuid: "4adf2ea5eb39426cb8a06960b09e16f4"
format_stamp: "Formatted at 2026-08-08 02:36:55 on dist-test-slave-45dx"
server_key: "8405564781006a46f9dc91a516dee9d6"
server_key_iv: "144887098a118f17a33de5c3730c059e"
server_key_version: "encryptionkey@0"
I20260808 02:36:55.199216 27753 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 02:36:55.202816 27779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:55.204259 27753 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 02:36:55.204541 27753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-2/wal
uuid: "4adf2ea5eb39426cb8a06960b09e16f4"
format_stamp: "Formatted at 2026-08-08 02:36:55 on dist-test-slave-45dx"
server_key: "8405564781006a46f9dc91a516dee9d6"
server_key_iv: "144887098a118f17a33de5c3730c059e"
server_key_version: "encryptionkey@0"
I20260808 02:36:55.204769 27753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:55.224884 27753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:55.229521 27753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:55.229791 27753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:55.248896 27753 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.252:39609
I20260808 02:36:55.248878 27849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.252:39609 every 8 connection(s)
I20260808 02:36:55.250447 27753 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-2/data/info.pb
I20260808 02:36:55.254137 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 27753
I20260808 02:36:55.254344 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156232048520-25043-0/minicluster-data/master-2/wal/instance
I20260808 02:36:55.254865 27850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:55.254928 25043 external_mini_cluster.cc:1428] Setting key ae2f7c6dab2a406cd3f6bb8f3cf4c3fc
I20260808 02:36:55.265183 27850 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38295 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:36:55 dist-test-slave-45dx krb5kdc[27500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.252@KRBTEST.COM
Aug 08 02:36:55 dist-test-slave-45dx krb5kdc[27500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156615, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.252@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:36:55.278810 27857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.257106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32876 (local address 127.24.116.252:39609)
0808 02:36:55.257915 (+ 809us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.257926 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.257969 (+ 43us) server_negotiation.cc:407] Connection header received
0808 02:36:55.259907 (+ 1938us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.259930 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.260377 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.260732 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:55.262629 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.263891 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.265752 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.266476 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.266601 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:55.271171 (+ 4570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:55.271180 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:55.271193 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:55.271237 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:55.274876 (+ 3639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:55.275586 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:55.275592 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:55.275601 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:55.275767 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:55.276171 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:55.276176 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:55.276178 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:55.276712 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:55.277017 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:55.277451 (+ 434us) server_negotiation.cc:299] Negotiation successful
0808 02:36:55.277791 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":370,"threads_started":1}
I20260808 02:36:55.282753 27630 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } attempt: 4
I20260808 02:36:55.284019 27859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.268163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34932 (local address 127.24.116.254:38295)
0808 02:36:55.269567 (+ 1404us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.269572 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.269588 (+ 16us) server_negotiation.cc:407] Connection header received
0808 02:36:55.269646 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.269650 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.269705 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.269837 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:55.270996 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.272049 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.273747 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.274400 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.274557 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:55.277882 (+ 3325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:55.277888 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:55.277891 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:55.277923 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:55.280829 (+ 2906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:55.281549 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:55.281554 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:55.281557 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:55.281735 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:55.282242 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:55.282248 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:55.282251 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:55.282627 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:55.282775 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:55.283426 (+ 651us) server_negotiation.cc:299] Negotiation successful
0808 02:36:55.283634 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1303,"thread_start_us":1164,"threads_started":1}
I20260808 02:36:55.284046 27858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.268065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:38295 (local address 127.0.0.1:34932)
0808 02:36:55.268838 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:55.268896 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:55.269078 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:55.269906 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:55.269913 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:55.270585 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:36:55.270838 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:55.270849 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.272241 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.272245 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:55.273590 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:55.273603 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.274587 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.274591 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:55.274710 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:55.275301 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:36:55.275318 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:36:55.277625 (+ 2307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:36:55.280962 (+ 3337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:55.280970 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:55.280976 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:55.281422 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:55.281894 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:55.281897 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:55.281900 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:55.282073 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:55.282770 (+ 697us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:36:55.282781 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:36:55.283048 (+ 267us) client_negotiation.cc:769] Sending connection context
0808 02:36:55.283288 (+ 240us) client_negotiation.cc:240] Negotiation successful
0808 02:36:55.283596 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":337,"threads_started":1}
I20260808 02:36:55.285918 27850 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:36:55 dist-test-slave-45dx krb5kdc[27500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156614, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for kudu/127.24.116.252@KRBTEST.COM
Aug 08 02:36:55 dist-test-slave-45dx krb5kdc[27500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
Aug 08 02:36:55 dist-test-slave-45dx krb5kdc[27500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156615, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.252@KRBTEST.COM for kudu/127.24.116.253@KRBTEST.COM
I20260808 02:36:55.299643 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.283367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:39609 (local address 127.0.0.1:32880)
0808 02:36:55.283706 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:55.283728 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:55.283830 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:55.284789 (+ 959us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:55.284794 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:55.285340 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:36:55.285500 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:55.285509 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.286514 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.286521 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:55.287993 (+ 1472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:55.288015 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.288792 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.288797 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:55.288997 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:55.289598 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:36:55.289622 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:36:55.292117 (+ 2495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:36:55.296354 (+ 4237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:55.296359 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:55.296363 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:55.297007 (+ 644us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:55.297468 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:55.297475 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:55.297481 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:55.297672 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:55.298392 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:36:55.298397 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:36:55.298597 (+ 200us) client_negotiation.cc:769] Sending connection context
0808 02:36:55.298766 (+ 169us) client_negotiation.cc:240] Negotiation successful
0808 02:36:55.299070 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226}
I20260808 02:36:55.300021 27857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.284201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32880 (local address 127.24.116.252:39609)
0808 02:36:55.284440 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.284445 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.284463 (+ 18us) server_negotiation.cc:407] Connection header received
0808 02:36:55.284510 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.284516 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.284584 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.284747 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:55.285639 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.286389 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.288140 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.288646 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.288781 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:55.292379 (+ 3598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:55.292385 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:55.292390 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:55.292425 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:55.296148 (+ 3723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:55.297147 (+ 999us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:55.297154 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:55.297159 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:55.297317 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:55.297840 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:55.297848 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:55.297853 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:55.298234 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:55.298387 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:55.299444 (+ 1057us) server_negotiation.cc:299] Negotiation successful
0808 02:36:55.299683 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133}
I20260808 02:36:55.301601 27863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.281792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34934 (local address 127.24.116.254:38295)
0808 02:36:55.282477 (+ 685us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.282483 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.282505 (+ 22us) server_negotiation.cc:407] Connection header received
0808 02:36:55.282547 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.282551 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.282625 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.282750 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:55.284784 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.286064 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.288044 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.288762 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.288883 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:55.294139 (+ 5256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:55.294147 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:55.294151 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:55.294193 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:55.297847 (+ 3654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:55.298589 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:55.298594 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:55.298597 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:55.298761 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:55.299209 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:55.299215 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:55.299218 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:55.299624 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:55.299895 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:55.301008 (+ 1113us) server_negotiation.cc:299] Negotiation successful
0808 02:36:55.301169 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":507,"thread_start_us":297,"threads_started":1}
I20260808 02:36:55.303627 27858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.286703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:45865 (local address 127.0.0.1:45622)
0808 02:36:55.287712 (+ 1009us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:55.287730 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:55.287846 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:55.288341 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:55.288348 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:55.288834 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:36:55.289021 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:55.289035 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.290426 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.290432 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:55.292048 (+ 1616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:55.292067 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.293092 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.293098 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:55.293350 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:55.294011 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:36:55.294050 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:36:55.296608 (+ 2558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:36:55.300589 (+ 3981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:55.300596 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:55.300602 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:55.301223 (+ 621us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:55.301758 (+ 535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:55.301762 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:55.301765 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:55.301939 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:55.302701 (+ 762us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:36:55.302706 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:36:55.302856 (+ 150us) client_negotiation.cc:769] Sending connection context
0808 02:36:55.303024 (+ 168us) client_negotiation.cc:240] Negotiation successful
0808 02:36:55.303296 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":878}
I20260808 02:36:55.303750 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.287089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45622 (local address 127.24.116.253:45865)
0808 02:36:55.287265 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.287270 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.287815 (+ 545us) server_negotiation.cc:407] Connection header received
0808 02:36:55.287961 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.287970 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.288052 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.288150 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:55.289193 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.290260 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.292215 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.292910 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.293067 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:55.296846 (+ 3779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:55.296854 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:55.296869 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:55.296916 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:55.300430 (+ 3514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:55.301372 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:55.301378 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:55.301382 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:55.301572 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:55.302081 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:55.302086 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:55.302089 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:55.302467 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:55.302593 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:55.303152 (+ 559us) server_negotiation.cc:299] Negotiation successful
0808 02:36:55.303380 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 02:36:55.305657 27850 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } has no permanent_uuid. Determining permanent_uuid...
I20260808 02:36:55.306998 27630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5: Bootstrap starting.
I20260808 02:36:55.311568 27630 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5: Neither blocks nor log segments found. Creating new log.
Aug 08 02:36:55 dist-test-slave-45dx krb5kdc[27500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156615, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.252@KRBTEST.COM for kudu/127.24.116.252@KRBTEST.COM
I20260808 02:36:55.313062 27630 log.cc:824] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5: Log is configured to *not* fsync() on all Append() calls
Aug 08 02:36:55 dist-test-slave-45dx krb5kdc[27500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.253@KRBTEST.COM
I20260808 02:36:55.316620 27630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5: No bootstrap required, opened a new log
I20260808 02:36:55.319578 27858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.306366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:39609 (local address 127.0.0.1:32896)
0808 02:36:55.306523 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:55.306542 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:55.306662 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:55.306998 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:55.307002 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:55.307451 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:36:55.307622 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:55.307633 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.308746 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.308751 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:55.309607 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:55.309618 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.310328 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.310333 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:55.310560 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:55.311180 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:36:55.311206 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:36:55.313375 (+ 2169us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:36:55.317050 (+ 3675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:55.317057 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:55.317060 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:55.317435 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:55.317791 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:55.317798 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:55.317801 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:55.317972 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:55.318522 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:36:55.318528 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:36:55.318655 (+ 127us) client_negotiation.cc:769] Sending connection context
0808 02:36:55.318836 (+ 181us) client_negotiation.cc:240] Negotiation successful
0808 02:36:55.319150 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 02:36:55.319885 27857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.306522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32896 (local address 127.24.116.252:39609)
0808 02:36:55.306679 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.306685 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.306713 (+ 28us) server_negotiation.cc:407] Connection header received
0808 02:36:55.306773 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.306777 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.306840 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.306942 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:55.307771 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.308598 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.309745 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.310165 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.310312 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:55.313563 (+ 3251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:55.313567 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:55.313570 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:55.313597 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:55.316928 (+ 3331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:55.317550 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:55.317557 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:55.317561 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:55.317682 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:55.318101 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:55.318107 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:55.318110 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:55.318394 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:55.318558 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:55.318939 (+ 381us) server_negotiation.cc:299] Negotiation successful
0808 02:36:55.319280 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":142,"server-negotiator.queue_time_us":62}
I20260808 02:36:55.323212 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.304478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45632 (local address 127.24.116.253:45865)
0808 02:36:55.304657 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.304663 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.304681 (+ 18us) server_negotiation.cc:407] Connection header received
0808 02:36:55.304729 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.304733 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.304801 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.304905 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:55.306806 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.307746 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.309564 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.310206 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.310329 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:55.315905 (+ 5576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:55.315914 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:55.315922 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:55.315967 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:55.319733 (+ 3766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:55.320993 (+ 1260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:55.320998 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:55.321001 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:55.321180 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:55.321656 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:55.321662 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:55.321665 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:55.322026 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:55.322322 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:55.322647 (+ 325us) server_negotiation.cc:299] Negotiation successful
0808 02:36:55.322881 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 02:36:55.325241 27850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4adf2ea5eb39426cb8a06960b09e16f4: Bootstrap starting.
I20260808 02:36:55.326707 27630 raft_consensus.cc:348] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78420228a6be4d58975cadf9b6cbebc5" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38295 } } peers { permanent_uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } } peers { permanent_uuid: "4adf2ea5eb39426cb8a06960b09e16f4" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } }
I20260808 02:36:55.327137 27630 raft_consensus.cc:729] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78420228a6be4d58975cadf9b6cbebc5, State: Initialized, Role: FOLLOWER
I20260808 02:36:55.327627 27630 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78420228a6be4d58975cadf9b6cbebc5" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38295 } } peers { permanent_uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } } peers { permanent_uuid: "4adf2ea5eb39426cb8a06960b09e16f4" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } }
I20260808 02:36:55.329491 27850 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4adf2ea5eb39426cb8a06960b09e16f4: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:55.329679 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:36:55.330340 27630 sys_catalog.cc:564] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:36:55.330660 27850 log.cc:824] T 00000000000000000000000000000000 P 4adf2ea5eb39426cb8a06960b09e16f4: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:55.332863 27865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78420228a6be4d58975cadf9b6cbebc5" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38295 } } peers { permanent_uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } } peers { permanent_uuid: "4adf2ea5eb39426cb8a06960b09e16f4" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } } }
I20260808 02:36:55.333463 27865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:36:55.333537 27587 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "78420228a6be4d58975cadf9b6cbebc5"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34934
I20260808 02:36:55.333832 27850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4adf2ea5eb39426cb8a06960b09e16f4: No bootstrap required, opened a new log
I20260808 02:36:55.333936 27587 raft_consensus.cc:482] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 02:36:55.334123 27587 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:55.337700 27587 raft_consensus.cc:504] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78420228a6be4d58975cadf9b6cbebc5" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38295 } } peers { permanent_uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } } peers { permanent_uuid: "4adf2ea5eb39426cb8a06960b09e16f4" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } }
I20260808 02:36:55.340272 27587 leader_election.cc:288] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5 [CANDIDATE]: Term 1 election: Requested vote from peers 3bbe702e7f0b4b07a3c28b4b03d9b042 (127.24.116.253:45865), 4adf2ea5eb39426cb8a06960b09e16f4 (127.24.116.252:39609)
I20260808 02:36:55.346041 27850 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4adf2ea5eb39426cb8a06960b09e16f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78420228a6be4d58975cadf9b6cbebc5" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38295 } } peers { permanent_uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } } peers { permanent_uuid: "4adf2ea5eb39426cb8a06960b09e16f4" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } }
I20260808 02:36:55.346604 27850 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4adf2ea5eb39426cb8a06960b09e16f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4adf2ea5eb39426cb8a06960b09e16f4, State: Initialized, Role: FOLLOWER
I20260808 02:36:55.347266 27850 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4adf2ea5eb39426cb8a06960b09e16f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78420228a6be4d58975cadf9b6cbebc5" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38295 } } peers { permanent_uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } } peers { permanent_uuid: "4adf2ea5eb39426cb8a06960b09e16f4" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } }
I20260808 02:36:55.354470 27884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4adf2ea5eb39426cb8a06960b09e16f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78420228a6be4d58975cadf9b6cbebc5" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38295 } } peers { permanent_uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } } peers { permanent_uuid: "4adf2ea5eb39426cb8a06960b09e16f4" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } } }
I20260808 02:36:55.355002 27884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4adf2ea5eb39426cb8a06960b09e16f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:36:55.357266 27813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "78420228a6be4d58975cadf9b6cbebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4adf2ea5eb39426cb8a06960b09e16f4"
I20260808 02:36:55.357982 27813 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4adf2ea5eb39426cb8a06960b09e16f4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:55.347062 27520 master_runner.cc:186] Error getting master registration for 127.24.116.253:45865: OK, instance_id { permanent_uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042" instance_seqno: 1786156614679782 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 02:36:55.360515 27520 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 02:36:55.362643 27813 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4adf2ea5eb39426cb8a06960b09e16f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78420228a6be4d58975cadf9b6cbebc5 in term 1.
I20260808 02:36:55.363469 27542 leader_election.cc:302] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4adf2ea5eb39426cb8a06960b09e16f4, 78420228a6be4d58975cadf9b6cbebc5; no voters:
I20260808 02:36:55.364040 27865 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:36:55.357240 27850 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4adf2ea5eb39426cb8a06960b09e16f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:36:55.364894 27865 raft_consensus.cc:686] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5 [term 1 LEADER]: Becoming Leader. State: Replica: 78420228a6be4d58975cadf9b6cbebc5, State: Running, Role: LEADER
W20260808 02:36:55.365023 27549 tablet.cc:2369] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:36:55.365553 27865 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78420228a6be4d58975cadf9b6cbebc5" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38295 } } peers { permanent_uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } } peers { permanent_uuid: "4adf2ea5eb39426cb8a06960b09e16f4" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } }
W20260808 02:36:55.375263 27881 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 02:36:55.375411 27881 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 02:36:55.384227 27890 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78420228a6be4d58975cadf9b6cbebc5. Latest consensus state: current_term: 1 leader_uuid: "78420228a6be4d58975cadf9b6cbebc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78420228a6be4d58975cadf9b6cbebc5" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38295 } } peers { permanent_uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } } peers { permanent_uuid: "4adf2ea5eb39426cb8a06960b09e16f4" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } } }
I20260808 02:36:55.384778 27890 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5 [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:55.386279 27899 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:36:55.389134 27899 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:36:55.405304 27813 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4adf2ea5eb39426cb8a06960b09e16f4 [term 1 FOLLOWER]: Refusing update from remote peer 78420228a6be4d58975cadf9b6cbebc5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:36:55.406479 27865 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4adf2ea5eb39426cb8a06960b09e16f4" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:36:55.407382 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.367435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45636 (local address 127.24.116.253:45865)
0808 02:36:55.367620 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.367629 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.375739 (+ 8110us) server_negotiation.cc:407] Connection header received
0808 02:36:55.377895 (+ 2156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.377906 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.378027 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.378124 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:55.385585 (+ 7461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.386778 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.393388 (+ 6610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.394361 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.394495 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:55.399286 (+ 4791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:55.399295 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:55.399302 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:55.399360 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:55.402999 (+ 3639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:55.404815 (+ 1816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:55.404821 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:55.404824 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:55.404983 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:55.405422 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:55.405427 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:55.405431 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:55.405883 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:55.406144 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:55.406742 (+ 598us) server_negotiation.cc:299] Negotiation successful
0808 02:36:55.406995 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 02:36:55.410321 27742 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } attempt: 5
I20260808 02:36:55.414651 27857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.366530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32904 (local address 127.24.116.252:39609)
0808 02:36:55.366709 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.366715 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.377516 (+ 10801us) server_negotiation.cc:407] Connection header received
0808 02:36:55.379681 (+ 2165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.379691 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.379799 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.379888 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:55.388921 (+ 9033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.390415 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.394305 (+ 3890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.395129 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.395253 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:55.401921 (+ 6668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:55.401930 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:55.401938 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:55.401995 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:55.406249 (+ 4254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:55.409654 (+ 3405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:55.409659 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:55.409664 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:55.409837 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:55.412010 (+ 2173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:55.412017 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:55.412021 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:55.412473 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:55.412834 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:55.413947 (+ 1113us) server_negotiation.cc:299] Negotiation successful
0808 02:36:55.414223 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":57}
Aug 08 02:36:55 dist-test-slave-45dx krb5kdc[27500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156614, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.253@KRBTEST.COM for kudu/127.24.116.252@KRBTEST.COM
I20260808 02:36:55.425678 27884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4adf2ea5eb39426cb8a06960b09e16f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78420228a6be4d58975cadf9b6cbebc5. Latest consensus state: current_term: 1 leader_uuid: "78420228a6be4d58975cadf9b6cbebc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78420228a6be4d58975cadf9b6cbebc5" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38295 } } peers { permanent_uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } } peers { permanent_uuid: "4adf2ea5eb39426cb8a06960b09e16f4" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } } }
I20260808 02:36:55.426081 27884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4adf2ea5eb39426cb8a06960b09e16f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:36:55.434484 27863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.370074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34940 (local address 127.24.116.254:38295)
0808 02:36:55.370269 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.370275 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.381243 (+ 10968us) server_negotiation.cc:407] Connection header received
0808 02:36:55.381745 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.381755 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.381870 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.381959 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:55.390612 (+ 8653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.391671 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.412617 (+ 20946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.413327 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.413454 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:55.427040 (+ 13586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:55.427049 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:55.427057 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:55.427110 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:55.431009 (+ 3899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:55.431939 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:55.431945 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:55.431949 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:55.432097 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:55.432580 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:55.432587 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:55.432590 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:55.433052 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:55.433289 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:55.433898 (+ 609us) server_negotiation.cc:299] Negotiation successful
0808 02:36:55.434141 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 02:36:55.437000 27902 mvcc.cc:205] Tried to move back new op lower bound from 7316097496685580288 to 7316097496542896128. Current Snapshot: MvccSnapshot[applied={T|T < 7316097496685580288}]
I20260808 02:36:55.439669 27910 mvcc.cc:205] Tried to move back new op lower bound from 7316097496685580288 to 7316097496542896128. Current Snapshot: MvccSnapshot[applied={T|T < 7316097496685580288}]
I20260808 02:36:55.442332 27747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.410870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:39609 (local address 127.0.0.1:32908)
0808 02:36:55.411429 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:55.411449 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:55.411556 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:55.412587 (+ 1031us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:55.412592 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:55.413068 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:36:55.413271 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:55.413284 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.417219 (+ 3935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.417227 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:55.419192 (+ 1965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:55.419212 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.421412 (+ 2200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.421418 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:55.421673 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:55.422481 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:36:55.422515 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:36:55.426109 (+ 3594us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:36:55.436743 (+ 10634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:55.436749 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:55.436753 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:55.437284 (+ 531us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:55.438011 (+ 727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:55.438039 (+ 28us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:55.438043 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:55.438376 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:55.439502 (+ 1126us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:36:55.439508 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:36:55.439769 (+ 261us) client_negotiation.cc:769] Sending connection context
0808 02:36:55.439990 (+ 221us) client_negotiation.cc:240] Negotiation successful
0808 02:36:55.440766 (+ 776us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426}
I20260808 02:36:55.443847 27909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.410988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32908 (local address 127.24.116.252:39609)
0808 02:36:55.411966 (+ 978us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.411975 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.412045 (+ 70us) server_negotiation.cc:407] Connection header received
0808 02:36:55.412138 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.412173 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.412339 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.413629 (+ 1290us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:55.414263 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.416918 (+ 2655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.419633 (+ 2715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.421163 (+ 1530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.422183 (+ 1020us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:55.426345 (+ 4162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:55.426352 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:55.426357 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:55.426395 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:55.436497 (+ 10102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:55.437519 (+ 1022us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:55.437524 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:55.437528 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:55.437829 (+ 301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:55.438630 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:55.438639 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:55.438642 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:55.439304 (+ 662us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:55.440566 (+ 1262us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:55.441161 (+ 595us) server_negotiation.cc:299] Negotiation successful
0808 02:36:55.442000 (+ 839us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":733,"thread_start_us":642,"threads_started":1}
I20260808 02:36:55.451195 27865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "78420228a6be4d58975cadf9b6cbebc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78420228a6be4d58975cadf9b6cbebc5" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38295 } } peers { permanent_uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } } peers { permanent_uuid: "4adf2ea5eb39426cb8a06960b09e16f4" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } } }
I20260808 02:36:55.451586 27865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5 [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:55.452595 27899 catalog_manager.cc:1347] Generated new cluster ID: 08d771ece7af45a4938e710f438ddce7
I20260808 02:36:55.452721 27899 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:36:55.452596 27742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bbe702e7f0b4b07a3c28b4b03d9b042: Bootstrap starting.
I20260808 02:36:55.454375 27920 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 02:36:55.460090 27742 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3bbe702e7f0b4b07a3c28b4b03d9b042: Neither blocks nor log segments found. Creating new log.
I20260808 02:36:55.461603 27742 log.cc:824] T 00000000000000000000000000000000 P 3bbe702e7f0b4b07a3c28b4b03d9b042: Log is configured to *not* fsync() on all Append() calls
I20260808 02:36:55.469503 27884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4adf2ea5eb39426cb8a06960b09e16f4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "78420228a6be4d58975cadf9b6cbebc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78420228a6be4d58975cadf9b6cbebc5" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38295 } } peers { permanent_uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } } peers { permanent_uuid: "4adf2ea5eb39426cb8a06960b09e16f4" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } } }
I20260808 02:36:55.469799 27884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4adf2ea5eb39426cb8a06960b09e16f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:36:55.472208 27742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bbe702e7f0b4b07a3c28b4b03d9b042: No bootstrap required, opened a new log
I20260808 02:36:55.476262 27899 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:36:55.467856 27753 master_runner.cc:186] Error getting master registration for 127.24.116.253:45865: OK, instance_id { permanent_uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042" instance_seqno: 1786156614679782 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 02:36:55.479527 27899 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:36:55.487182 27742 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3bbe702e7f0b4b07a3c28b4b03d9b042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78420228a6be4d58975cadf9b6cbebc5" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38295 } } peers { permanent_uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } } peers { permanent_uuid: "4adf2ea5eb39426cb8a06960b09e16f4" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } }
I20260808 02:36:55.487658 27742 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3bbe702e7f0b4b07a3c28b4b03d9b042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bbe702e7f0b4b07a3c28b4b03d9b042, State: Initialized, Role: FOLLOWER
I20260808 02:36:55.488204 27742 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3bbe702e7f0b4b07a3c28b4b03d9b042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78420228a6be4d58975cadf9b6cbebc5" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38295 } } peers { permanent_uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } } peers { permanent_uuid: "4adf2ea5eb39426cb8a06960b09e16f4" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } }
I20260808 02:36:55.488515 27753 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 02:36:55.489642 27928 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bbe702e7f0b4b07a3c28b4b03d9b042 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78420228a6be4d58975cadf9b6cbebc5" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38295 } } peers { permanent_uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } } peers { permanent_uuid: "4adf2ea5eb39426cb8a06960b09e16f4" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } } }
I20260808 02:36:55.490198 27928 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bbe702e7f0b4b07a3c28b4b03d9b042 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:36:55.491055 27742 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3bbe702e7f0b4b07a3c28b4b03d9b042 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:36:55.491375 27701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "78420228a6be4d58975cadf9b6cbebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042"
I20260808 02:36:55.491921 27701 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3bbe702e7f0b4b07a3c28b4b03d9b042 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:36:55.495611 27701 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3bbe702e7f0b4b07a3c28b4b03d9b042 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78420228a6be4d58975cadf9b6cbebc5 in term 1.
I20260808 02:36:55.496692 27699 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3bbe702e7f0b4b07a3c28b4b03d9b042 [term 1 FOLLOWER]: Refusing update from remote peer 78420228a6be4d58975cadf9b6cbebc5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:36:55.497619 27865 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:36:55.504753 27899 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5: Generated new TSK 0
I20260808 02:36:55.505779 27899 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:36:55.531620 27928 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bbe702e7f0b4b07a3c28b4b03d9b042 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78420228a6be4d58975cadf9b6cbebc5. Latest consensus state: current_term: 1 leader_uuid: "78420228a6be4d58975cadf9b6cbebc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78420228a6be4d58975cadf9b6cbebc5" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38295 } } peers { permanent_uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } } peers { permanent_uuid: "4adf2ea5eb39426cb8a06960b09e16f4" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } } }
I20260808 02:36:55.531970 27928 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bbe702e7f0b4b07a3c28b4b03d9b042 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:36:55.532354 27958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bbe702e7f0b4b07a3c28b4b03d9b042 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "78420228a6be4d58975cadf9b6cbebc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78420228a6be4d58975cadf9b6cbebc5" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38295 } } peers { permanent_uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } } peers { permanent_uuid: "4adf2ea5eb39426cb8a06960b09e16f4" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } } }
I20260808 02:36:55.532799 27958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bbe702e7f0b4b07a3c28b4b03d9b042 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:36:55.540220 27961 catalog_manager.cc:1259] Loaded cluster ID: 08d771ece7af45a4938e710f438ddce7
I20260808 02:36:55.540406 27961 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3bbe702e7f0b4b07a3c28b4b03d9b042: loading cluster ID for follower catalog manager: success
I20260808 02:36:55.544062 27961 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3bbe702e7f0b4b07a3c28b4b03d9b042: acquiring CA information for follower catalog manager: success
I20260808 02:36:55.546553 27961 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3bbe702e7f0b4b07a3c28b4b03d9b042: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 02:36:55.611678 27863 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:36:55.595891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34950 (local address 127.24.116.254:38295)
0808 02:36:55.596071 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.596084 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.608918 (+ 12834us) server_negotiation.cc:407] Connection header received
0808 02:36:55.609273 (+ 355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.609283 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.609426 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.609517 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:55.611280 (+ 1763us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34950: BlockingRecv error: recv got EOF from 127.0.0.1:34950 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260808 02:36:55.614915 27749 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:36:55.595418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45652 (local address 127.24.116.253:45865)
0808 02:36:55.595693 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.595701 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.612736 (+ 17035us) server_negotiation.cc:407] Connection header received
0808 02:36:55.613061 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.613069 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.613175 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.613268 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:55.614547 (+ 1279us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45652: BlockingRecv error: recv got EOF from 127.0.0.1:45652 (error 108)
Metrics: {"server-negotiator.queue_time_us":112}
W20260808 02:36:55.619014 27909 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:36:55.602685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32918 (local address 127.24.116.252:39609)
0808 02:36:55.602920 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.602926 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.617202 (+ 14276us) server_negotiation.cc:407] Connection header received
0808 02:36:55.617478 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.617484 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.617575 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.617651 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:55.618827 (+ 1176us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32918: BlockingRecv error: recv got EOF from 127.0.0.1:32918 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 02:36:55.630431 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.624180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45666 (local address 127.24.116.253:45865)
0808 02:36:55.624408 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.624417 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.624859 (+ 442us) server_negotiation.cc:407] Connection header received
0808 02:36:55.625099 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.625103 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.625259 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.625439 (+ 180us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:36:55.625880 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.626649 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.628010 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.628509 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.628649 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:55.629158 (+ 509us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:36:55.629692 (+ 534us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:36:55.629881 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:55.629933 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 02:36:55.630022 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260808 02:36:55.646540 27909 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:36:55.637246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32928 (local address 127.24.116.252:39609)
0808 02:36:55.637464 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.637473 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.644861 (+ 7388us) server_negotiation.cc:407] Connection header received
0808 02:36:55.645102 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.645109 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.645252 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.645375 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:55.646279 (+ 904us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32928: BlockingRecv error: recv got EOF from 127.0.0.1:32928 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 02:36:55.662420 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.654933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45682 (local address 127.24.116.253:45865)
0808 02:36:55.655137 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.655143 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.655681 (+ 538us) server_negotiation.cc:407] Connection header received
0808 02:36:55.655884 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.655891 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.656030 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.656145 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:36:55.656687 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.657884 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.659998 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.660779 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.660924 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:55.661511 (+ 587us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:36:55.661680 (+ 169us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:36:55.661793 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:55.661963 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 02:36:55.662053 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260808 02:36:55.673563 27909 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:36:55.671243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32942 (local address 127.24.116.252:39609)
0808 02:36:55.671470 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.671477 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.671995 (+ 518us) server_negotiation.cc:407] Connection header received
0808 02:36:55.672193 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.672199 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.672330 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.672446 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:55.673322 (+ 876us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32942: BlockingRecv error: recv got EOF from 127.0.0.1:32942 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 02:36:55.709251 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.686443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45690 (local address 127.24.116.253:45865)
0808 02:36:55.686626 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.686632 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.701666 (+ 15034us) server_negotiation.cc:407] Connection header received
0808 02:36:55.702230 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.702236 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.702354 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.702427 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:36:55.703129 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.704434 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.706626 (+ 2192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.707422 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.707543 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:55.708282 (+ 739us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:36:55.708458 (+ 176us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:36:55.708531 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:55.708777 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 02:36:55.708890 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260808 02:36:55.726733 27909 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:36:55.724432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32948 (local address 127.24.116.252:39609)
0808 02:36:55.724622 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.724629 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.725168 (+ 539us) server_negotiation.cc:407] Connection header received
0808 02:36:55.725352 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.725360 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.725461 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.725571 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:55.726499 (+ 928us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32948: BlockingRecv error: recv got EOF from 127.0.0.1:32948 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 02:36:55.741092 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.733928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45704 (local address 127.24.116.253:45865)
0808 02:36:55.734124 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.734130 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.734668 (+ 538us) server_negotiation.cc:407] Connection header received
0808 02:36:55.734872 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.734878 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.734965 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.735069 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:36:55.735514 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.736697 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.738777 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.739574 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.739710 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:55.740239 (+ 529us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:36:55.740432 (+ 193us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:36:55.740534 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:55.740696 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 02:36:55.740784 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260808 02:36:55.750607 27909 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:36:55.748287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32960 (local address 127.24.116.252:39609)
0808 02:36:55.748605 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.748611 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.748974 (+ 363us) server_negotiation.cc:407] Connection header received
0808 02:36:55.749146 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.749151 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.749241 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.749351 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:55.750367 (+ 1016us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32960: BlockingRecv error: recv got EOF from 127.0.0.1:32960 (error 108)
Metrics: {"server-negotiator.queue_time_us":171}
I20260808 02:36:55.769755 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.762498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45714 (local address 127.24.116.253:45865)
0808 02:36:55.762690 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.762696 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.763206 (+ 510us) server_negotiation.cc:407] Connection header received
0808 02:36:55.763399 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.763404 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.763495 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.763606 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:36:55.764083 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.765354 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.767392 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.768203 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.768402 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:55.768867 (+ 465us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:36:55.769052 (+ 185us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:36:55.769155 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:55.769323 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 02:36:55.769419 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260808 02:36:55.784623 27909 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:36:55.782206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32964 (local address 127.24.116.252:39609)
0808 02:36:55.782418 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.782426 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.783011 (+ 585us) server_negotiation.cc:407] Connection header received
0808 02:36:55.783207 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.783214 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.783316 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.783434 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:55.784366 (+ 932us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32964: BlockingRecv error: recv got EOF from 127.0.0.1:32964 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 02:36:55.813671 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.806272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45716 (local address 127.24.116.253:45865)
0808 02:36:55.806453 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.806460 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.807052 (+ 592us) server_negotiation.cc:407] Connection header received
0808 02:36:55.807253 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.807259 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.807365 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.807472 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:36:55.808053 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.809379 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.811362 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.812073 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.812225 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:55.812801 (+ 576us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:36:55.812986 (+ 185us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:36:55.813084 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:55.813274 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 02:36:55.813381 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260808 02:36:55.823784 27909 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:36:55.821684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32976 (local address 127.24.116.252:39609)
0808 02:36:55.821896 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.821902 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.822142 (+ 240us) server_negotiation.cc:407] Connection header received
0808 02:36:55.822429 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.822435 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.822546 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.822663 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:55.823548 (+ 885us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32976: BlockingRecv error: recv got EOF from 127.0.0.1:32976 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 02:36:55.869876 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.862266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45728 (local address 127.24.116.253:45865)
0808 02:36:55.862493 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.862505 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.863086 (+ 581us) server_negotiation.cc:407] Connection header received
0808 02:36:55.863331 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.863339 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.863466 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.863592 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:36:55.864131 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.865355 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.867399 (+ 2044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.868132 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.868252 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:55.868977 (+ 725us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:36:55.869124 (+ 147us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:36:55.869226 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:55.869419 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 02:36:55.869514 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260808 02:36:55.880905 27909 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:36:55.878398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32980 (local address 127.24.116.252:39609)
0808 02:36:55.878600 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.878606 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.879184 (+ 578us) server_negotiation.cc:407] Connection header received
0808 02:36:55.879415 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.879421 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.879529 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.879651 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:55.880627 (+ 976us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32980: BlockingRecv error: recv got EOF from 127.0.0.1:32980 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 02:36:55.955608 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:55.948972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45738 (local address 127.24.116.253:45865)
0808 02:36:55.949218 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.949226 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.949810 (+ 584us) server_negotiation.cc:407] Connection header received
0808 02:36:55.950039 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.950046 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.950157 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.950273 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:36:55.950783 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.951937 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.953398 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:55.954122 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:55.954278 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:55.954736 (+ 458us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:36:55.954925 (+ 189us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:36:55.955045 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:55.955178 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 02:36:55.955280 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260808 02:36:55.965337 27909 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:36:55.963177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32994 (local address 127.24.116.252:39609)
0808 02:36:55.963408 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:55.963414 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:55.963750 (+ 336us) server_negotiation.cc:407] Connection header received
0808 02:36:55.963981 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:55.963993 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:55.964082 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:55.964169 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:55.965092 (+ 923us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32994: BlockingRecv error: recv got EOF from 127.0.0.1:32994 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
I20260808 02:36:56.026629 27865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "78420228a6be4d58975cadf9b6cbebc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78420228a6be4d58975cadf9b6cbebc5" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 38295 } } peers { permanent_uuid: "3bbe702e7f0b4b07a3c28b4b03d9b042" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 45865 } } peers { permanent_uuid: "4adf2ea5eb39426cb8a06960b09e16f4" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 39609 } } }
I20260808 02:36:56.026959 27865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78420228a6be4d58975cadf9b6cbebc5 [sys.catalog]: This master's current role is: LEADER
I20260808 02:36:56.102816 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:56.096980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45754 (local address 127.24.116.253:45865)
0808 02:36:56.097271 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:56.097281 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:56.097878 (+ 597us) server_negotiation.cc:407] Connection header received
0808 02:36:56.098057 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:56.098061 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:56.098132 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:56.098226 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:36:56.098621 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:56.099402 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:56.100831 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:56.101337 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:56.101469 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:56.102041 (+ 572us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:36:56.102182 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:36:56.102298 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:56.102470 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 02:36:56.102553 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
W20260808 02:36:56.111292 27909 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:36:56.109099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33010 (local address 127.24.116.252:39609)
0808 02:36:56.109368 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:56.109395 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:56.109750 (+ 355us) server_negotiation.cc:407] Connection header received
0808 02:36:56.109965 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:56.109970 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:56.110058 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:56.110169 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:56.111068 (+ 899us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33010: BlockingRecv error: recv got EOF from 127.0.0.1:33010 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
I20260808 02:36:56.379930 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:56.374357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45764 (local address 127.24.116.253:45865)
0808 02:36:56.374633 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:56.374641 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:56.374866 (+ 225us) server_negotiation.cc:407] Connection header received
0808 02:36:56.375039 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:56.375087 (+ 48us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:56.375201 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:56.375331 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:36:56.375926 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:56.376734 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:56.378148 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:56.378599 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:56.378713 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:56.379178 (+ 465us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:36:56.379298 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:36:56.379380 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:56.379528 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 02:36:56.379594 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
W20260808 02:36:56.387916 27909 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:36:56.385971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33014 (local address 127.24.116.252:39609)
0808 02:36:56.386200 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:56.386206 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:56.386431 (+ 225us) server_negotiation.cc:407] Connection header received
0808 02:36:56.386582 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:56.386586 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:56.386667 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:56.386752 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:56.387688 (+ 936us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33014: BlockingRecv error: recv got EOF from 127.0.0.1:33014 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 02:36:56.458882 27920 catalog_manager.cc:1259] Loaded cluster ID: 08d771ece7af45a4938e710f438ddce7
I20260808 02:36:56.459090 27920 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4adf2ea5eb39426cb8a06960b09e16f4: loading cluster ID for follower catalog manager: success
I20260808 02:36:56.461925 27920 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4adf2ea5eb39426cb8a06960b09e16f4: acquiring CA information for follower catalog manager: success
I20260808 02:36:56.463831 27920 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4adf2ea5eb39426cb8a06960b09e16f4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 02:36:56.911443 28153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:56.905695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45772 (local address 127.24.116.253:45865)
0808 02:36:56.906428 (+ 733us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:56.906433 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:56.906452 (+ 19us) server_negotiation.cc:407] Connection header received
0808 02:36:56.906611 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:56.906615 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:56.906683 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:56.906772 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:36:56.907272 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:56.908020 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:56.909753 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:56.910153 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:56.910250 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:56.910739 (+ 489us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:36:56.910845 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:36:56.910915 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:56.911052 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 02:36:56.911114 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":630,"thread_start_us":501,"threads_started":1}
I20260808 02:36:56.922981 28163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:56.917343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33024 (local address 127.24.116.252:39609)
0808 02:36:56.917841 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:56.917846 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:56.917863 (+ 17us) server_negotiation.cc:407] Connection header received
0808 02:36:56.917990 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:56.917994 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:56.918141 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:56.918245 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:36:56.918637 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:56.919353 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:56.920749 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:56.921146 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:56.921250 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:56.921857 (+ 607us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:36:56.922402 (+ 545us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:36:56.922546 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:56.922600 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 02:36:56.922676 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":249,"threads_started":1}
I20260808 02:36:56.937851 28173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:56.929949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34958 (local address 127.24.116.254:38295)
0808 02:36:56.931186 (+ 1237us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:56.931194 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:56.931224 (+ 30us) server_negotiation.cc:407] Connection header received
0808 02:36:56.931405 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:56.931413 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:56.931675 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:56.931909 (+ 234us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:36:56.932547 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:56.933278 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:56.935227 (+ 1949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:56.935883 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:56.936022 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:56.936685 (+ 663us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:36:56.937164 (+ 479us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:36:56.937306 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:56.937414 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 02:36:56.937542 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1070,"thread_start_us":936,"threads_started":1}
I20260808 02:36:56.939605 28163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:56.930088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33032 (local address 127.24.116.252:39609)
0808 02:36:56.930314 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:56.930322 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:56.933591 (+ 3269us) server_negotiation.cc:407] Connection header received
0808 02:36:56.933795 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:56.933805 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:56.933872 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:56.933969 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:36:56.934799 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:56.935674 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:56.937570 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:56.938185 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:56.938321 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:56.938819 (+ 498us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:36:56.938984 (+ 165us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:36:56.939079 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:56.939241 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 02:36:56.939339 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 02:36:56.939985 28153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:56.929711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45780 (local address 127.24.116.253:45865)
0808 02:36:56.929913 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:56.929920 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:56.932129 (+ 2209us) server_negotiation.cc:407] Connection header received
0808 02:36:56.932407 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:56.932413 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:56.932513 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:56.932606 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:36:56.933093 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:56.934128 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:56.936280 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:56.936892 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:56.937027 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:56.938506 (+ 1479us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:36:56.938638 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:36:56.938707 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:56.938921 (+ 214us) server_negotiation.cc:299] Negotiation successful
0808 02:36:56.939701 (+ 780us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 02:36:56.949812 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 27520
I20260808 02:36:56.951344 27625 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:36:57.067258 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 27520
I20260808 02:36:57.097600 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 27640
I20260808 02:36:57.098865 27730 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:36:57.207952 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 27640
I20260808 02:36:57.238507 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 27753
I20260808 02:36:57.239748 27843 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:36:57.347970 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 27753
2026-08-08T02:36:57Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5449 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:36:57 dist-test-slave-45dx krb5kdc[28188](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:36:57 dist-test-slave-45dx krb5kdc[28188](info): set up 2 sockets
Aug 08 02:36:57 dist-test-slave-45dx krb5kdc[28188](info): commencing operation
krb5kdc: starting...
W20260808 02:36:58.717172 25043 mini_kdc.cc:121] Time spent starting KDC: real 1.322s user 0.000s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/krb5kdc/test-user.keytab.
Aug 08 02:36:58 dist-test-slave-45dx krb5kdc[28188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:36:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:36:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.116.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
Entry for principal kudu/127.24.116.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab.
I20260808 02:36:59.088263 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:33443
--webserver_interface=127.24.116.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:45409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:33443,127.24.116.253:35453,127.24.116.252:37249
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:36:59.442400 28203 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 02:36:59.442771 28203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:36:59.442902 28203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:36:59.443033 28203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:36:59.450222 28203 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:36:59.450327 28203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:36:59.450441 28203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:36:59.450520 28203 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:36:59.450613 28203 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:36:59.460995 28203 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:45409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:33443,127.24.116.253:35453,127.24.116.252:37249
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.254.keytab
--principal=kudu/127.24.116.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.254:33443
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.116.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:36:59.462462 28203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:36:59.463966 28203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:36:59.476058 28214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:59.476080 28209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:36:59.476135 28211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:36:59.476884 28203 server_base.cc:1034] running on GCE node
I20260808 02:36:59.477613 28203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:36:59.478945 28203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:36:59.480171 28203 hybrid_clock.cc:648] HybridClock initialized: now 1786156619480096 us; error 45 us; skew 500 ppm
I20260808 02:36:59.480552 28203 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:36:59 dist-test-slave-45dx krb5kdc[28188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156619, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:36:59.483763 28203 init.cc:377] Logged in from keytab as kudu/127.24.116.254@KRBTEST.COM (short username kudu)
I20260808 02:36:59.485255 28203 webserver.cc:460] Webserver started at http://127.24.116.254:44167/ using document root <none> and password file <none>
I20260808 02:36:59.485958 28203 fs_manager.cc:359] Metadata directory not provided
I20260808 02:36:59.486073 28203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:36:59.486421 28203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:36:59.489472 28203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-0/data/instance:
uuid: "d6841140801e46cb906e160194301bc6"
format_stamp: "Formatted at 2026-08-08 02:36:59 on dist-test-slave-45dx"
server_key: "c4945de1ccbb59934c4d9c5154e907b8"
server_key_iv: "d1a1cbee21f823ca2b428efcec6f7847"
server_key_version: "encryptionkey@0"
I20260808 02:36:59.490301 28203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-0/wal/instance:
uuid: "d6841140801e46cb906e160194301bc6"
format_stamp: "Formatted at 2026-08-08 02:36:59 on dist-test-slave-45dx"
server_key: "c4945de1ccbb59934c4d9c5154e907b8"
server_key_iv: "d1a1cbee21f823ca2b428efcec6f7847"
server_key_version: "encryptionkey@0"
I20260808 02:36:59.495602 28203 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260808 02:36:59.499308 28224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:36:59.500716 28203 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:36:59.500903 28203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-0/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-0/wal
uuid: "d6841140801e46cb906e160194301bc6"
format_stamp: "Formatted at 2026-08-08 02:36:59 on dist-test-slave-45dx"
server_key: "c4945de1ccbb59934c4d9c5154e907b8"
server_key_iv: "d1a1cbee21f823ca2b428efcec6f7847"
server_key_version: "encryptionkey@0"
I20260808 02:36:59.501124 28203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:36:59.537405 28203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:36:59.542477 28203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:36:59.542774 28203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:36:59.562374 28203 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.254:33443
I20260808 02:36:59.562398 28299 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.254:33443 every 8 connection(s)
I20260808 02:36:59.563833 28203 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-0/data/info.pb
I20260808 02:36:59.564996 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 28203
I20260808 02:36:59.565213 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-0/wal/instance
I20260808 02:36:59.565816 25043 external_mini_cluster.cc:1428] Setting key eebe77cbe69173b96667b67b7ec32d92
I20260808 02:36:59.568943 28302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:36:59.579355 28302 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33443 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:36:59 dist-test-slave-45dx krb5kdc[28188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156619, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.116.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.253@KRBTEST.COM" created.
I20260808 02:36:59.603866 28307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:59.583484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33443 (local address 127.0.0.1:41944)
0808 02:36:59.584425 (+ 941us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:59.584473 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 02:36:59.586564 (+ 2091us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:36:59.587443 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:36:59.587450 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:36:59.588163 (+ 713us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:36:59.588568 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:59.588588 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:59.590209 (+ 1621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:59.590213 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:59.591270 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:36:59.591282 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:36:59.592234 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:36:59.592241 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:36:59.592490 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:59.593216 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:36:59.593239 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:36:59.595616 (+ 2377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:36:59.599206 (+ 3590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:59.599219 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:59.599233 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:59.599653 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:59.600095 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:36:59.600103 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:36:59.600106 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:36:59.600279 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:36:59.601128 (+ 849us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:36:59.601141 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:36:59.601399 (+ 258us) client_negotiation.cc:769] Sending connection context
0808 02:36:59.601661 (+ 262us) client_negotiation.cc:240] Negotiation successful
0808 02:36:59.602333 (+ 672us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"mutex_wait_us":161,"thread_start_us":349,"threads_started":1}
I20260808 02:36:59.603885 28310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:59.584805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41944 (local address 127.24.116.254:33443)
0808 02:36:59.585533 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0808 02:36:59.585541 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:36:59.585596 (+ 55us) server_negotiation.cc:407] Connection header received
0808 02:36:59.586954 (+ 1358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:36:59.586959 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:36:59.587200 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:36:59.587418 (+ 218us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:36:59.588791 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:59.589993 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:59.591423 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:36:59.591982 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:36:59.592193 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:36:59.595868 (+ 3675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:36:59.595876 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:36:59.595889 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:36:59.595919 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:36:59.599061 (+ 3142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:59.599810 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:59.599817 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:59.599819 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:59.599973 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:36:59.600427 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:36:59.600437 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:36:59.600439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:36:59.600982 (+ 543us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:36:59.601214 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0808 02:36:59.601820 (+ 606us) server_negotiation.cc:299] Negotiation successful
0808 02:36:59.602174 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":343,"threads_started":1}
I20260808 02:36:59.607843 28302 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } has no permanent_uuid. Determining permanent_uuid...
I20260808 02:36:59.609186 28307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:59.608641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:35453 (local address 127.0.0.1:60500)
0808 02:36:59.608859 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:59.609014 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:35453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260808 02:36:59.609544 28226 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.116.253:35453: connect: Connection refused (error 111)
I20260808 02:36:59.611353 28307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:59.610848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:35453 (local address 127.0.0.1:60506)
0808 02:36:59.611038 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:59.611135 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:35453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 02:36:59.611582 28302 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.253:35453: Network error: Client connection negotiation failed: client connection to 127.24.116.253:35453: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.253.keytab.
Entry for principal kudu/127.24.116.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.253.keytab.
I20260808 02:36:59.645776 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.253:35453
--webserver_interface=127.24.116.253
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.253.keytab
--principal=kudu/127.24.116.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:45409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:33443,127.24.116.253:35453,127.24.116.252:37249
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:36:59.660956 28302 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } attempt: 1
I20260808 02:36:59.662230 28307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:59.661705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:35453 (local address 127.0.0.1:60520)
0808 02:36:59.661974 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:59.662095 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:35453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147}
I20260808 02:36:59.663328 28307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:59.662916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:35453 (local address 127.0.0.1:60522)
0808 02:36:59.663062 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:59.663135 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:35453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 02:36:59.663563 28302 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.253:35453: Network error: Client connection negotiation failed: client connection to 127.24.116.253:35453: connect: Connection refused (error 111)
I20260808 02:36:59.731887 28302 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } attempt: 2
I20260808 02:36:59.733258 28307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:59.732721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:35453 (local address 127.0.0.1:60528)
0808 02:36:59.733013 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:59.733114 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:35453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 02:36:59.734414 28307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:59.734045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:35453 (local address 127.0.0.1:60534)
0808 02:36:59.734198 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:59.734268 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:35453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 02:36:59.734692 28302 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.253:35453: Network error: Client connection negotiation failed: client connection to 127.24.116.253:35453: connect: Connection refused (error 111)
I20260808 02:36:59.825978 28302 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } attempt: 3
I20260808 02:36:59.827224 28307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:59.826784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:35453 (local address 127.0.0.1:60544)
0808 02:36:59.826990 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:59.827085 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:35453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260808 02:36:59.828357 28307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:59.827927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:35453 (local address 127.0.0.1:60548)
0808 02:36:59.828088 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:59.828165 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:35453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 02:36:59.828559 28302 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.253:35453: Network error: Client connection negotiation failed: client connection to 127.24.116.253:35453: connect: Connection refused (error 111)
I20260808 02:36:59.971813 28302 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } attempt: 4
I20260808 02:36:59.973233 28307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:59.972640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:35453 (local address 127.0.0.1:60556)
0808 02:36:59.973008 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:59.973100 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:35453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212}
I20260808 02:36:59.974359 28307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:36:59.973994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:35453 (local address 127.0.0.1:60568)
0808 02:36:59.974156 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 02:36:59.974233 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.253:35453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 02:36:59.974543 28302 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.253:35453: Network error: Client connection negotiation failed: client connection to 127.24.116.253:35453: connect: Connection refused (error 111)
W20260808 02:37:00.000661 28317 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 02:37:00.001070 28317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:00.001201 28317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:00.001340 28317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:00.009550 28317 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:37:00.009711 28317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:00.009853 28317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:00.009955 28317 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:37:00.010107 28317 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:37:00.021893 28317 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:45409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:33443,127.24.116.253:35453,127.24.116.252:37249
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.253.keytab
--principal=kudu/127.24.116.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.253:35453
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.24.116.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:00.023330 28317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:00.024788 28317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:00.037463 28323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:00.037616 28326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:00.037403 28324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:00.038468 28317 server_base.cc:1034] running on GCE node
I20260808 02:37:00.039322 28317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:00.040902 28317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:00.042172 28317 hybrid_clock.cc:648] HybridClock initialized: now 1786156620042104 us; error 38 us; skew 500 ppm
I20260808 02:37:00.042544 28317 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:00 dist-test-slave-45dx krb5kdc[28188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156620, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:00.046118 28317 init.cc:377] Logged in from keytab as kudu/127.24.116.253@KRBTEST.COM (short username kudu)
I20260808 02:37:00.047719 28317 webserver.cc:460] Webserver started at http://127.24.116.253:43653/ using document root <none> and password file <none>
I20260808 02:37:00.048623 28317 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:00.048781 28317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:00.049157 28317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:00.052750 28317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-1/data/instance:
uuid: "048fbde868c645199a59bc40ddb72e16"
format_stamp: "Formatted at 2026-08-08 02:37:00 on dist-test-slave-45dx"
server_key: "338a8b761d2ae0d21b932eb922db8d89"
server_key_iv: "efb061a01981eae757aaa19fa3fac142"
server_key_version: "encryptionkey@0"
I20260808 02:37:00.053699 28317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-1/wal/instance:
uuid: "048fbde868c645199a59bc40ddb72e16"
format_stamp: "Formatted at 2026-08-08 02:37:00 on dist-test-slave-45dx"
server_key: "338a8b761d2ae0d21b932eb922db8d89"
server_key_iv: "efb061a01981eae757aaa19fa3fac142"
server_key_version: "encryptionkey@0"
I20260808 02:37:00.059397 28317 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 02:37:00.063231 28337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:00.064872 28317 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:37:00.065080 28317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-1/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-1/wal
uuid: "048fbde868c645199a59bc40ddb72e16"
format_stamp: "Formatted at 2026-08-08 02:37:00 on dist-test-slave-45dx"
server_key: "338a8b761d2ae0d21b932eb922db8d89"
server_key_iv: "efb061a01981eae757aaa19fa3fac142"
server_key_version: "encryptionkey@0"
I20260808 02:37:00.065313 28317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:00.080461 28317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:00.085152 28317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:00.085455 28317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:00.104830 28317 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.253:35453
I20260808 02:37:00.104779 28413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.253:35453 every 8 connection(s)
I20260808 02:37:00.106359 28317 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-1/data/info.pb
I20260808 02:37:00.110078 28414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:00.113052 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 28317
I20260808 02:37:00.113248 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-1/wal/instance
I20260808 02:37:00.113796 25043 external_mini_cluster.cc:1428] Setting key 19a0a15c3700caf831b9049308f1a7a3
I20260808 02:37:00.119153 28414 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33443 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:37:00 dist-test-slave-45dx krb5kdc[28188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156620, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.253@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:37:00.143435 28417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.122549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41954 (local address 127.24.116.254:33443)
0808 02:37:00.123109 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:00.123116 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:00.124271 (+ 1155us) server_negotiation.cc:407] Connection header received
0808 02:37:00.127084 (+ 2813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:00.127089 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:00.127173 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:00.127295 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:00.129493 (+ 2198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.130203 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.131764 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.132186 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.132351 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:00.136269 (+ 3918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:00.136274 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:00.136277 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:00.136373 (+ 96us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:00.139422 (+ 3049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.140745 (+ 1323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.140749 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.140752 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.140917 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.141472 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.141475 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.141477 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.141807 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:00.141921 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:00.142990 (+ 1069us) server_negotiation.cc:299] Negotiation successful
0808 02:37:00.143159 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":266,"threads_started":1}
I20260808 02:37:00.145201 28419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.123135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33443 (local address 127.0.0.1:41954)
0808 02:37:00.123981 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.124043 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:00.126769 (+ 2726us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:00.127591 (+ 822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:00.127606 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:00.128457 (+ 851us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:00.129235 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:00.129264 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.130388 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.130396 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:00.131602 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:00.131614 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.132471 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.132479 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:00.132709 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:00.133461 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:00.133487 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:00.136026 (+ 2539us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:00.139683 (+ 3657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:00.139697 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:00.139718 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:00.140604 (+ 886us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:00.141046 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:00.141054 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:00.141061 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:00.141345 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:00.141967 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:00.141979 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:00.142538 (+ 559us) client_negotiation.cc:769] Sending connection context
0808 02:37:00.142887 (+ 349us) client_negotiation.cc:240] Negotiation successful
0808 02:37:00.143553 (+ 666us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":326,"threads_started":1}
I20260808 02:37:00.147200 28414 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.24.116.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.116.252@KRBTEST.COM" created.
Aug 08 02:37:00 dist-test-slave-45dx krb5kdc[28188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156620, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.253@KRBTEST.COM for kudu/127.24.116.253@KRBTEST.COM
I20260808 02:37:00.164566 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.148358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60580 (local address 127.24.116.253:35453)
0808 02:37:00.149245 (+ 887us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:00.149258 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:00.149300 (+ 42us) server_negotiation.cc:407] Connection header received
0808 02:37:00.149363 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:00.149374 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:00.149652 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:00.149838 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:00.150570 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.152686 (+ 2116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.153849 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.154836 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.154948 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:00.158657 (+ 3709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:00.158669 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:00.158683 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:00.158713 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:00.161520 (+ 2807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.162375 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.162382 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.162384 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.162497 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.162915 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.162919 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.162921 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.163251 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:00.163427 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:00.163875 (+ 448us) server_negotiation.cc:299] Negotiation successful
0808 02:37:00.164169 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":88,"server-negotiator.queue_time_us":625,"thread_start_us":472,"threads_started":1}
I20260808 02:37:00.164588 28419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.148137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:35453 (local address 127.0.0.1:60580)
0808 02:37:00.148372 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.148392 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:00.148507 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:00.149822 (+ 1315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:00.149825 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:00.150241 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:00.150375 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:00.150383 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.152860 (+ 2477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.152863 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:00.153693 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:00.153705 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.154995 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.154999 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:00.155117 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:00.155760 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:00.155776 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:00.158435 (+ 2659us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:00.161670 (+ 3235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:00.161678 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:00.161685 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:00.162236 (+ 551us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:00.162608 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:00.162615 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:00.162620 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:00.162808 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:00.163400 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:00.163407 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:00.163570 (+ 163us) client_negotiation.cc:769] Sending connection context
0808 02:37:00.163726 (+ 156us) client_negotiation.cc:240] Negotiation successful
0808 02:37:00.164050 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72}
I20260808 02:37:00.167224 28414 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } has no permanent_uuid. Determining permanent_uuid...
I20260808 02:37:00.168391 28419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.167901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:37249 (local address 127.0.0.1:36182)
0808 02:37:00.168070 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.168182 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260808 02:37:00.168813 28338 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
I20260808 02:37:00.183202 28419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.182754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:37249 (local address 127.0.0.1:36186)
0808 02:37:00.182942 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.183065 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260808 02:37:00.183442 28414 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:37249: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.116.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.252.keytab.
Entry for principal kudu/127.24.116.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.252.keytab.
I20260808 02:37:00.199967 25043 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5C7FBY/build/asan/bin/kudu
/tmp/dist-test-task5C7FBY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.252:37249
--webserver_interface=127.24.116.252
--webserver_port=0
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.252.keytab
--principal=kudu/127.24.116.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.116.212:45409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.116.254:33443,127.24.116.253:35453,127.24.116.252:37249
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:37:00.232787 28414 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } attempt: 1
I20260808 02:37:00.234122 28419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.233500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:37249 (local address 127.0.0.1:36194)
0808 02:37:00.233763 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.233911 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 02:37:00.235374 28419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.234873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:37249 (local address 127.0.0.1:36196)
0808 02:37:00.235081 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.235193 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260808 02:37:00.235668 28414 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:37249: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
I20260808 02:37:00.273798 28302 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } attempt: 5
Aug 08 02:37:00 dist-test-slave-45dx krb5kdc[28188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156619, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for kudu/127.24.116.253@KRBTEST.COM
I20260808 02:37:00.289242 28307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.274645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:35453 (local address 127.0.0.1:60582)
0808 02:37:00.274887 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.274913 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:00.275059 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:00.275618 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:00.275622 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:00.276016 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:00.276198 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:00.276207 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.277639 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.277643 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:00.278543 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:00.278555 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.279590 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.279595 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:00.279886 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:00.280589 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:00.280608 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:00.282700 (+ 2092us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:00.286640 (+ 3940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:00.286644 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:00.286647 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:00.287080 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:00.287526 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:00.287530 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:00.287533 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:00.287678 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:00.288445 (+ 767us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:00.288449 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:00.288572 (+ 123us) client_negotiation.cc:769] Sending connection context
0808 02:37:00.288709 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 02:37:00.288976 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260808 02:37:00.289399 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.275005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60582 (local address 127.24.116.253:35453)
0808 02:37:00.275224 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:00.275230 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:00.275275 (+ 45us) server_negotiation.cc:407] Connection header received
0808 02:37:00.275375 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:00.275381 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:00.275463 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:00.275571 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:00.276394 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.277478 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.278704 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.279407 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.279541 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:00.282913 (+ 3372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:00.282919 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:00.282924 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:00.282965 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:00.286464 (+ 3499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.287207 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.287213 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.287216 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.287379 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.287837 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.287845 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.287851 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.288237 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:00.288464 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:00.288857 (+ 393us) server_negotiation.cc:299] Negotiation successful
0808 02:37:00.289087 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 02:37:00.290555 28302 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } has no permanent_uuid. Determining permanent_uuid...
I20260808 02:37:00.291639 28307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.291262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:37249 (local address 127.0.0.1:36206)
0808 02:37:00.291435 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.291522 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 02:37:00.292594 28307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.292245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:37249 (local address 127.0.0.1:36212)
0808 02:37:00.292403 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.292476 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 02:37:00.292793 28302 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:37249: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
I20260808 02:37:00.303965 28414 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } attempt: 2
I20260808 02:37:00.305167 28419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.304639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:37249 (local address 127.0.0.1:36228)
0808 02:37:00.304855 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.304970 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 02:37:00.306409 28419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.305990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:37249 (local address 127.0.0.1:36236)
0808 02:37:00.306153 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.306258 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 02:37:00.306646 28414 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:37249: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
I20260808 02:37:00.344043 28302 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } attempt: 1
I20260808 02:37:00.345399 28307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.344842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:37249 (local address 127.0.0.1:36244)
0808 02:37:00.345067 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.345183 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260808 02:37:00.346565 28307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.346215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:37249 (local address 127.0.0.1:36260)
0808 02:37:00.346378 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.346458 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 02:37:00.346870 28302 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:37249: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
I20260808 02:37:00.397900 28414 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } attempt: 3
I20260808 02:37:00.399278 28419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.398626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:37249 (local address 127.0.0.1:36276)
0808 02:37:00.398894 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.399038 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260808 02:37:00.400655 28419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.400047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:37249 (local address 127.0.0.1:36286)
0808 02:37:00.400384 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.400494 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162}
W20260808 02:37:00.400941 28414 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:37249: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
I20260808 02:37:00.415133 28302 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } attempt: 2
I20260808 02:37:00.416427 28307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.415846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:37249 (local address 127.0.0.1:36292)
0808 02:37:00.416080 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.416173 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260808 02:37:00.417464 28307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.417106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:37249 (local address 127.0.0.1:36306)
0808 02:37:00.417263 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.417353 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 02:37:00.417685 28302 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:37249: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
I20260808 02:37:00.523936 28302 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } attempt: 3
I20260808 02:37:00.525309 28307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.524690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:37249 (local address 127.0.0.1:36312)
0808 02:37:00.524958 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.525087 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260808 02:37:00.526562 28307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.526057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:37249 (local address 127.0.0.1:36322)
0808 02:37:00.526292 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.526405 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
W20260808 02:37:00.526846 28302 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:37249: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
I20260808 02:37:00.544209 28414 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } attempt: 4
I20260808 02:37:00.545619 28419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.544961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:37249 (local address 127.0.0.1:36326)
0808 02:37:00.545260 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.545401 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260808 02:37:00.546782 28419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.546328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:37249 (local address 127.0.0.1:36334)
0808 02:37:00.546523 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.546626 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260808 02:37:00.547070 28414 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.116.252:37249: Network error: Client connection negotiation failed: client connection to 127.24.116.252:37249: connect: Connection refused (error 111)
W20260808 02:37:00.574703 28428 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 02:37:00.575057 28428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:00.575165 28428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:00.575250 28428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:00.582511 28428 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:37:00.582597 28428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:00.582653 28428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:00.582705 28428 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:37:00.582767 28428 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:37:00.592692 28428 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.116.212:45409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.24.116.254:33443,127.24.116.253:35453,127.24.116.252:37249
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/krb5kdc/kudu_127.24.116.252.keytab
--principal=kudu/127.24.116.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.116.252:37249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.24.116.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:00.593930 28428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:00.595351 28428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:00.607543 28437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:00.607606 28433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:00.607630 28435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:00.608929 28428 server_base.cc:1034] running on GCE node
I20260808 02:37:00.609809 28428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:00.611419 28428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:00.612753 28428 hybrid_clock.cc:648] HybridClock initialized: now 1786156620612661 us; error 53 us; skew 500 ppm
I20260808 02:37:00.613197 28428 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:00 dist-test-slave-45dx krb5kdc[28188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156620, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:00.616811 28428 init.cc:377] Logged in from keytab as kudu/127.24.116.252@KRBTEST.COM (short username kudu)
I20260808 02:37:00.618255 28428 webserver.cc:460] Webserver started at http://127.24.116.252:38795/ using document root <none> and password file <none>
I20260808 02:37:00.619007 28428 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:00.619102 28428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:00.619395 28428 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:00.622682 28428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-2/data/instance:
uuid: "c1d3748b9f09409883f52203b7ac9eb3"
format_stamp: "Formatted at 2026-08-08 02:37:00 on dist-test-slave-45dx"
server_key: "589e6235310ddaa45c317218f4ef327f"
server_key_iv: "04e616dbc6f894e3ef33ab75698676ce"
server_key_version: "encryptionkey@0"
I20260808 02:37:00.623514 28428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-2/wal/instance:
uuid: "c1d3748b9f09409883f52203b7ac9eb3"
format_stamp: "Formatted at 2026-08-08 02:37:00 on dist-test-slave-45dx"
server_key: "589e6235310ddaa45c317218f4ef327f"
server_key_iv: "04e616dbc6f894e3ef33ab75698676ce"
server_key_version: "encryptionkey@0"
I20260808 02:37:00.629077 28428 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260808 02:37:00.632858 28446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:00.634289 28428 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 02:37:00.634457 28428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-2/data,/tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-2/wal
uuid: "c1d3748b9f09409883f52203b7ac9eb3"
format_stamp: "Formatted at 2026-08-08 02:37:00 on dist-test-slave-45dx"
server_key: "589e6235310ddaa45c317218f4ef327f"
server_key_iv: "04e616dbc6f894e3ef33ab75698676ce"
server_key_version: "encryptionkey@0"
I20260808 02:37:00.634661 28428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:00.655421 28428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:00.660334 28428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:00.660583 28428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:00.680490 28428 rpc_server.cc:307] RPC server started. Bound to: 127.24.116.252:37249
I20260808 02:37:00.680510 28525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.116.252:37249 every 8 connection(s)
I20260808 02:37:00.681962 28428 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-2/data/info.pb
I20260808 02:37:00.685846 28530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:00.687264 25043 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5C7FBY/build/asan/bin/kudu as pid 28428
I20260808 02:37:00.687487 25043 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5C7FBY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156232048520-25043-0/minicluster-data/master-2/wal/instance
I20260808 02:37:00.688060 25043 external_mini_cluster.cc:1428] Setting key 72b4481f1b27f08e761b5832dec51855
I20260808 02:37:00.696091 28530 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33443 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:37:00 dist-test-slave-45dx krb5kdc[28188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.252@KRBTEST.COM
I20260808 02:37:00.704092 28302 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } attempt: 4
Aug 08 02:37:00 dist-test-slave-45dx krb5kdc[28188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156620, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.252@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
Aug 08 02:37:00 dist-test-slave-45dx krb5kdc[28188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156619, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.254@KRBTEST.COM for kudu/127.24.116.252@KRBTEST.COM
I20260808 02:37:00.715595 28534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.690028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36350 (local address 127.24.116.252:37249)
0808 02:37:00.690946 (+ 918us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:00.690958 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:00.691007 (+ 49us) server_negotiation.cc:407] Connection header received
0808 02:37:00.692853 (+ 1846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:00.692878 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:00.693331 (+ 453us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:00.693692 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:00.695511 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.697074 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.698792 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.700119 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.700372 (+ 253us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:00.704963 (+ 4591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:00.704977 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:00.704993 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:00.705052 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:00.709809 (+ 4757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.710721 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.710732 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.710744 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.710980 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.711479 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.711484 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.711488 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.712326 (+ 838us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:00.712650 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:00.713730 (+ 1080us) server_negotiation.cc:299] Negotiation successful
0808 02:37:00.714091 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":690,"thread_start_us":446,"threads_started":1}
I20260808 02:37:00.718155 28535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.698955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.254:33443 (local address 127.0.0.1:41960)
0808 02:37:00.699821 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.699866 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:00.700039 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:00.701078 (+ 1039us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:00.701086 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:00.701786 (+ 700us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:00.702051 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:00.702061 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.703189 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.703202 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:00.704630 (+ 1428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:00.704643 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.705970 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.705980 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:00.706224 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:00.706976 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:00.707000 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:00.709744 (+ 2744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:00.714575 (+ 4831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:00.714586 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:00.714594 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:00.715257 (+ 663us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:00.715697 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:00.715703 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:00.715706 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:00.715886 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:00.716640 (+ 754us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:00.716651 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:00.716912 (+ 261us) client_negotiation.cc:769] Sending connection context
0808 02:37:00.717189 (+ 277us) client_negotiation.cc:240] Negotiation successful
0808 02:37:00.717640 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":611,"thread_start_us":406,"threads_started":1}
I20260808 02:37:00.718348 28538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.698983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41960 (local address 127.24.116.254:33443)
0808 02:37:00.700610 (+ 1627us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:00.700617 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:00.700639 (+ 22us) server_negotiation.cc:407] Connection header received
0808 02:37:00.700708 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:00.700713 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:00.700873 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:00.701005 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:00.702225 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.703022 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.704927 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.705546 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.705720 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:00.709974 (+ 4254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:00.709981 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:00.709986 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:00.710038 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:00.714417 (+ 4379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.715406 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.715411 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.715415 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.715553 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.716009 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.716015 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.716019 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.716409 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:00.716561 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:00.717607 (+ 1046us) server_negotiation.cc:299] Negotiation successful
0808 02:37:00.717851 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1478,"thread_start_us":1252,"threads_started":1}
I20260808 02:37:00.719904 28530 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } has no permanent_uuid. Determining permanent_uuid...
I20260808 02:37:00.724766 28307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.704813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:37249 (local address 127.0.0.1:36362)
0808 02:37:00.705026 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.705046 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:00.705144 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:00.706479 (+ 1335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:00.706487 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:00.707295 (+ 808us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:00.707531 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:00.707543 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.709559 (+ 2016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.709568 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:00.711181 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:00.711198 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.712153 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.712159 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:00.712412 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:00.713047 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:00.713071 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:00.715661 (+ 2590us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:00.720435 (+ 4774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:00.720442 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:00.720445 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:00.721014 (+ 569us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:00.721420 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:00.721427 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:00.721431 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:00.721612 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:00.723724 (+ 2112us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:00.723732 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:00.723899 (+ 167us) client_negotiation.cc:769] Sending connection context
0808 02:37:00.724053 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 02:37:00.724375 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260808 02:37:00.725260 28539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.705213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36362 (local address 127.24.116.252:37249)
0808 02:37:00.706091 (+ 878us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:00.706099 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:00.706127 (+ 28us) server_negotiation.cc:407] Connection header received
0808 02:37:00.706189 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:00.706195 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:00.706263 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:00.706424 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:00.707737 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.709384 (+ 1647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.711357 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.711967 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.712123 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:00.715925 (+ 3802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:00.715931 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:00.715937 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:00.715975 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:00.720231 (+ 4256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.721116 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.721123 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.721126 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.721275 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.721856 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.721863 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.721868 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.722298 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:00.722491 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:00.724155 (+ 1664us) server_negotiation.cc:299] Negotiation successful
0808 02:37:00.724407 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":704,"thread_start_us":453,"threads_started":1}
Aug 08 02:37:00 dist-test-slave-45dx krb5kdc[28188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156620, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.252@KRBTEST.COM for kudu/127.24.116.253@KRBTEST.COM
Aug 08 02:37:00 dist-test-slave-45dx krb5kdc[28188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.254@KRBTEST.COM
I20260808 02:37:00.731838 28302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6: Bootstrap starting.
I20260808 02:37:00.736056 28302 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:00.737052 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.721262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60592 (local address 127.24.116.253:35453)
0808 02:37:00.721479 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:00.721484 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:00.721499 (+ 15us) server_negotiation.cc:407] Connection header received
0808 02:37:00.721547 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:00.721550 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:00.721608 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:00.721721 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:00.722466 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.723542 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.725577 (+ 2035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.726132 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.726252 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:00.730197 (+ 3945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:00.730203 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:00.730206 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:00.730265 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:00.733816 (+ 3551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.734483 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.734490 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.734495 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.734680 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.735194 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.735199 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.735202 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.735586 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:00.735748 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:00.736367 (+ 619us) server_negotiation.cc:299] Negotiation successful
0808 02:37:00.736654 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 02:37:00.737651 28302 log.cc:824] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6: Log is configured to *not* fsync() on all Append() calls
I20260808 02:37:00.738005 28535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.720793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.253:35453 (local address 127.0.0.1:60592)
0808 02:37:00.720985 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.721005 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:00.721112 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:00.721757 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:00.721762 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:00.722158 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:00.722297 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:00.722307 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.723693 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.723697 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:00.725363 (+ 1666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:00.725380 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.726552 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.726559 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:00.726757 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:00.727345 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:00.727371 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:00.729999 (+ 2628us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:00.733953 (+ 3954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:00.733959 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:00.733963 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:00.734352 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:00.734839 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:00.734845 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:00.734849 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:00.735052 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:00.735738 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:00.735747 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:00.735958 (+ 211us) client_negotiation.cc:769] Sending connection context
0808 02:37:00.737271 (+ 1313us) client_negotiation.cc:240] Negotiation successful
0808 02:37:00.737653 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 02:37:00.739333 28530 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } has no permanent_uuid. Determining permanent_uuid...
I20260808 02:37:00.739696 28538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.720194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41976 (local address 127.24.116.254:33443)
0808 02:37:00.720390 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:00.720398 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:00.720417 (+ 19us) server_negotiation.cc:407] Connection header received
0808 02:37:00.720472 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:00.720476 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:00.720591 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:00.720696 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:00.722667 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.723672 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.725752 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.726391 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.726508 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:00.731497 (+ 4989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:00.731503 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:00.731507 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:00.731543 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:00.735965 (+ 4422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.736739 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.736745 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.736748 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.736886 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.737458 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.737461 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.737463 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.737735 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:00.738056 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:00.739217 (+ 1161us) server_negotiation.cc:299] Negotiation successful
0808 02:37:00.739414 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 02:37:00.741475 28302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6: No bootstrap required, opened a new log
Aug 08 02:37:00 dist-test-slave-45dx krb5kdc[28188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156620, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.252@KRBTEST.COM for kudu/127.24.116.252@KRBTEST.COM
Aug 08 02:37:00 dist-test-slave-45dx krb5kdc[28188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.116.253@KRBTEST.COM
I20260808 02:37:00.753789 28535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.740102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:37249 (local address 127.0.0.1:36364)
0808 02:37:00.740277 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.740297 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:00.740438 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:00.741025 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:00.741030 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:00.741538 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:00.741755 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:00.741772 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.743253 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.743261 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:00.744374 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:00.744388 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.745107 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.745113 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:00.745364 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:00.745963 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:00.745979 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:00.748196 (+ 2217us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:00.751190 (+ 2994us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:00.751196 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:00.751199 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:00.751575 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:00.751941 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:00.751947 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:00.751950 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:00.752081 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:00.752726 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:00.752731 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:00.752890 (+ 159us) client_negotiation.cc:769] Sending connection context
0808 02:37:00.753032 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 02:37:00.753350 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 02:37:00.753859 28539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.740484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36364 (local address 127.24.116.252:37249)
0808 02:37:00.740680 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:00.740686 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:00.740705 (+ 19us) server_negotiation.cc:407] Connection header received
0808 02:37:00.740754 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:00.740761 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:00.740847 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:00.740956 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:00.741950 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.743096 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.744521 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.744950 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.745092 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:00.748433 (+ 3341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:00.748442 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:00.748449 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:00.748488 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:00.751046 (+ 2558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.751702 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.751707 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.751711 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.751834 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.752184 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.752191 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.752193 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.752614 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:00.752763 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:00.753138 (+ 375us) server_negotiation.cc:299] Negotiation successful
0808 02:37:00.753494 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":155,"server-negotiator.queue_time_us":65}
I20260808 02:37:00.753549 28302 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6841140801e46cb906e160194301bc6" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33443 } } peers { permanent_uuid: "048fbde868c645199a59bc40ddb72e16" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } } peers { permanent_uuid: "c1d3748b9f09409883f52203b7ac9eb3" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } }
I20260808 02:37:00.754010 28302 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6841140801e46cb906e160194301bc6, State: Initialized, Role: FOLLOWER
I20260808 02:37:00.754649 28302 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6841140801e46cb906e160194301bc6" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33443 } } peers { permanent_uuid: "048fbde868c645199a59bc40ddb72e16" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } } peers { permanent_uuid: "c1d3748b9f09409883f52203b7ac9eb3" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } }
I20260808 02:37:00.755756 28541 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6841140801e46cb906e160194301bc6" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33443 } } peers { permanent_uuid: "048fbde868c645199a59bc40ddb72e16" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } } peers { permanent_uuid: "c1d3748b9f09409883f52203b7ac9eb3" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } } }
I20260808 02:37:00.756320 28541 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:37:00.757354 28302 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:37:00.759727 28530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1d3748b9f09409883f52203b7ac9eb3: Bootstrap starting.
I20260808 02:37:00.761749 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.742064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60596 (local address 127.24.116.253:35453)
0808 02:37:00.742213 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:00.742217 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:00.742230 (+ 13us) server_negotiation.cc:407] Connection header received
0808 02:37:00.742267 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:00.742270 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:00.742319 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:00.742434 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:00.743784 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.745029 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.747007 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.747711 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.747841 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:00.753765 (+ 5924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:00.753772 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:00.753777 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:00.753834 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:00.757822 (+ 3988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.758745 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.758751 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.758754 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.758938 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.759468 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.759473 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.759477 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.759907 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:00.760154 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:00.760914 (+ 760us) server_negotiation.cc:299] Negotiation successful
0808 02:37:00.761184 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 02:37:00.764217 28530 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c1d3748b9f09409883f52203b7ac9eb3: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:00.765661 28530 log.cc:824] T 00000000000000000000000000000000 P c1d3748b9f09409883f52203b7ac9eb3: Log is configured to *not* fsync() on all Append() calls
I20260808 02:37:00.767647 25043 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:37:00.769398 28530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1d3748b9f09409883f52203b7ac9eb3: No bootstrap required, opened a new log
I20260808 02:37:00.771091 28259 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "d6841140801e46cb906e160194301bc6"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41976
I20260808 02:37:00.771548 28259 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 02:37:00.771741 28259 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6 [term 0 FOLLOWER]: Advancing to term 1
W20260808 02:37:00.775378 28564 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 02:37:00.775530 28564 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 02:37:00.775800 28259 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6841140801e46cb906e160194301bc6" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33443 } } peers { permanent_uuid: "048fbde868c645199a59bc40ddb72e16" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } } peers { permanent_uuid: "c1d3748b9f09409883f52203b7ac9eb3" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } }
I20260808 02:37:00.779876 28259 leader_election.cc:288] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 048fbde868c645199a59bc40ddb72e16 (127.24.116.253:35453), c1d3748b9f09409883f52203b7ac9eb3 (127.24.116.252:37249)
I20260808 02:37:00.781323 28530 raft_consensus.cc:348] T 00000000000000000000000000000000 P c1d3748b9f09409883f52203b7ac9eb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6841140801e46cb906e160194301bc6" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33443 } } peers { permanent_uuid: "048fbde868c645199a59bc40ddb72e16" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } } peers { permanent_uuid: "c1d3748b9f09409883f52203b7ac9eb3" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } }
I20260808 02:37:00.781780 28530 raft_consensus.cc:729] T 00000000000000000000000000000000 P c1d3748b9f09409883f52203b7ac9eb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1d3748b9f09409883f52203b7ac9eb3, State: Initialized, Role: FOLLOWER
I20260808 02:37:00.782297 28530 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1d3748b9f09409883f52203b7ac9eb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6841140801e46cb906e160194301bc6" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33443 } } peers { permanent_uuid: "048fbde868c645199a59bc40ddb72e16" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } } peers { permanent_uuid: "c1d3748b9f09409883f52203b7ac9eb3" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } }
I20260808 02:37:00.783579 28568 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1d3748b9f09409883f52203b7ac9eb3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6841140801e46cb906e160194301bc6" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33443 } } peers { permanent_uuid: "048fbde868c645199a59bc40ddb72e16" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } } peers { permanent_uuid: "c1d3748b9f09409883f52203b7ac9eb3" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } } }
I20260808 02:37:00.784433 28568 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1d3748b9f09409883f52203b7ac9eb3 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:37:00.784701 28530 sys_catalog.cc:564] T 00000000000000000000000000000000 P c1d3748b9f09409883f52203b7ac9eb3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:37:00.784790 28487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d6841140801e46cb906e160194301bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c1d3748b9f09409883f52203b7ac9eb3"
I20260808 02:37:00.785311 28487 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c1d3748b9f09409883f52203b7ac9eb3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:00.789201 28487 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c1d3748b9f09409883f52203b7ac9eb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6841140801e46cb906e160194301bc6 in term 1.
I20260808 02:37:00.789865 28225 leader_election.cc:302] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1d3748b9f09409883f52203b7ac9eb3, d6841140801e46cb906e160194301bc6; no voters:
I20260808 02:37:00.790460 28541 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:37:00.792407 28541 raft_consensus.cc:686] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6 [term 1 LEADER]: Becoming Leader. State: Replica: d6841140801e46cb906e160194301bc6, State: Running, Role: LEADER
W20260808 02:37:00.796034 28232 tablet.cc:2369] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:37:00.797492 28541 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6841140801e46cb906e160194301bc6" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33443 } } peers { permanent_uuid: "048fbde868c645199a59bc40ddb72e16" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } } peers { permanent_uuid: "c1d3748b9f09409883f52203b7ac9eb3" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } }
I20260808 02:37:00.780441 28203 master_runner.cc:186] Error getting master registration for 127.24.116.253:35453: OK, instance_id { permanent_uuid: "048fbde868c645199a59bc40ddb72e16" instance_seqno: 1786156620099105 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 02:37:00.804184 28203 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 02:37:00.841037 28571 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6841140801e46cb906e160194301bc6. Latest consensus state: current_term: 1 leader_uuid: "d6841140801e46cb906e160194301bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6841140801e46cb906e160194301bc6" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33443 } } peers { permanent_uuid: "048fbde868c645199a59bc40ddb72e16" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } } peers { permanent_uuid: "c1d3748b9f09409883f52203b7ac9eb3" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } } }
I20260808 02:37:00.841600 28571 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6 [sys.catalog]: This master's current role is: LEADER
I20260808 02:37:00.846263 28414 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } attempt: 5
I20260808 02:37:00.849687 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.813787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60602 (local address 127.24.116.253:35453)
0808 02:37:00.814021 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:00.814030 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:00.825051 (+ 11021us) server_negotiation.cc:407] Connection header received
0808 02:37:00.825432 (+ 381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:00.825440 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:00.825539 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:00.825625 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:00.828394 (+ 2769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.829664 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.832238 (+ 2574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.833135 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.833253 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:00.839911 (+ 6658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:00.839920 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:00.839926 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:00.839977 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:00.844592 (+ 4615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.845827 (+ 1235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.845834 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.845838 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.846027 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.846693 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.846700 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.846703 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.847165 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:00.847416 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:00.848976 (+ 1560us) server_negotiation.cc:299] Negotiation successful
0808 02:37:00.849231 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 02:37:00.855283 28584 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:37:00.858153 28584 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 02:37:00 dist-test-slave-45dx krb5kdc[28188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156620, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.116.253@KRBTEST.COM for kudu/127.24.116.252@KRBTEST.COM
I20260808 02:37:00.867470 28538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.813066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41988 (local address 127.24.116.254:33443)
0808 02:37:00.813273 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:00.813281 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:00.827139 (+ 13858us) server_negotiation.cc:407] Connection header received
0808 02:37:00.828212 (+ 1073us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:00.828218 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:00.828337 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:00.828425 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:00.837738 (+ 9313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.839109 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.843827 (+ 4718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.844654 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.844767 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:00.853919 (+ 9152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:00.853929 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:00.853936 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:00.854013 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:00.859821 (+ 5808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.863726 (+ 3905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.863735 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.863740 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.863942 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.864857 (+ 915us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.864864 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.864870 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.865353 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:00.865675 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:00.866751 (+ 1076us) server_negotiation.cc:299] Negotiation successful
0808 02:37:00.867034 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 02:37:00.867470 28539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.822030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36374 (local address 127.24.116.252:37249)
0808 02:37:00.822249 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:00.822257 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:00.831875 (+ 9618us) server_negotiation.cc:407] Connection header received
0808 02:37:00.832425 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:00.832434 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:00.832551 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:00.832645 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:00.837491 (+ 4846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.838950 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.850944 (+ 11994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.851657 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.851765 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:00.857485 (+ 5720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:00.857491 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:00.857515 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:00.857558 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:00.861974 (+ 4416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.862956 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.862962 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.862965 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.863184 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.863686 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.863691 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.863693 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.864106 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:00.864424 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:00.865021 (+ 597us) server_negotiation.cc:299] Negotiation successful
0808 02:37:00.867026 (+ 2005us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 02:37:00.871448 28419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.846947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.116.252:37249 (local address 127.0.0.1:36390)
0808 02:37:00.847386 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:00.847408 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:00.847518 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:00.848496 (+ 978us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:00.848502 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:00.849102 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:00.849330 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:00.849345 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.850931 (+ 1586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.850939 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:00.852675 (+ 1736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:00.852693 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.854017 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.854024 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:00.854281 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:00.855372 (+ 1091us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:00.855403 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:00.862456 (+ 7053us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:00.867796 (+ 5340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:00.867802 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:00.867806 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:00.868499 (+ 693us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:00.869111 (+ 612us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:00.869116 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:00.869119 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:00.869389 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:00.870283 (+ 894us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:00.870289 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:00.870484 (+ 195us) client_negotiation.cc:769] Sending connection context
0808 02:37:00.870646 (+ 162us) client_negotiation.cc:240] Negotiation successful
0808 02:37:00.870982 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272}
I20260808 02:37:00.873391 28534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:00.847754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36390 (local address 127.24.116.252:37249)
0808 02:37:00.847968 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:00.847974 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:00.847992 (+ 18us) server_negotiation.cc:407] Connection header received
0808 02:37:00.848050 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:00.848055 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:00.848140 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:00.848250 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:00.849541 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.850735 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.852885 (+ 2150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:00.853657 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:00.853807 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:00.862708 (+ 8901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:00.862716 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:00.862720 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:00.862764 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:00.866871 (+ 4107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.868668 (+ 1797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.868674 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.868678 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.868855 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:00.869547 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:00.869552 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:00.869556 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:00.870054 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:00.870213 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:00.870894 (+ 681us) server_negotiation.cc:299] Negotiation successful
0808 02:37:00.871337 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 02:37:00.874434 28487 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c1d3748b9f09409883f52203b7ac9eb3 [term 1 FOLLOWER]: Refusing update from remote peer d6841140801e46cb906e160194301bc6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:37:00.879508 28414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 048fbde868c645199a59bc40ddb72e16: Bootstrap starting.
I20260808 02:37:00.881093 28571 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1d3748b9f09409883f52203b7ac9eb3" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:37:00.889715 28414 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 048fbde868c645199a59bc40ddb72e16: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:00.891867 28414 log.cc:824] T 00000000000000000000000000000000 P 048fbde868c645199a59bc40ddb72e16: Log is configured to *not* fsync() on all Append() calls
I20260808 02:37:00.903493 28568 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1d3748b9f09409883f52203b7ac9eb3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6841140801e46cb906e160194301bc6. Latest consensus state: current_term: 1 leader_uuid: "d6841140801e46cb906e160194301bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6841140801e46cb906e160194301bc6" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33443 } } peers { permanent_uuid: "048fbde868c645199a59bc40ddb72e16" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } } peers { permanent_uuid: "c1d3748b9f09409883f52203b7ac9eb3" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } } }
I20260808 02:37:00.903883 28568 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1d3748b9f09409883f52203b7ac9eb3 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 02:37:00.912724 28457 tablet.cc:2369] T 00000000000000000000000000000000 P c1d3748b9f09409883f52203b7ac9eb3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:37:00.913197 28585 mvcc.cc:205] Tried to move back new op lower bound from 7316097519066853376 to 7316097518835826688. Current Snapshot: MvccSnapshot[applied={T|T < 7316097519066853376}]
I20260808 02:37:00.918603 28595 mvcc.cc:205] Tried to move back new op lower bound from 7316097519066853376 to 7316097518835826688. Current Snapshot: MvccSnapshot[applied={T|T < 7316097519066853376}]
I20260808 02:37:00.924443 28568 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1d3748b9f09409883f52203b7ac9eb3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d6841140801e46cb906e160194301bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6841140801e46cb906e160194301bc6" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33443 } } peers { permanent_uuid: "048fbde868c645199a59bc40ddb72e16" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } } peers { permanent_uuid: "c1d3748b9f09409883f52203b7ac9eb3" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } } }
I20260808 02:37:00.924750 28568 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1d3748b9f09409883f52203b7ac9eb3 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:37:00.930744 28584 catalog_manager.cc:1347] Generated new cluster ID: 88a50beeba8147458bf06a680a67a124
I20260808 02:37:00.930867 28584 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:37:00.931313 28571 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d6841140801e46cb906e160194301bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6841140801e46cb906e160194301bc6" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33443 } } peers { permanent_uuid: "048fbde868c645199a59bc40ddb72e16" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } } peers { permanent_uuid: "c1d3748b9f09409883f52203b7ac9eb3" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } } }
I20260808 02:37:00.931634 28571 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6 [sys.catalog]: This master's current role is: LEADER
I20260808 02:37:00.931674 28414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 048fbde868c645199a59bc40ddb72e16: No bootstrap required, opened a new log
I20260808 02:37:00.942873 28414 raft_consensus.cc:348] T 00000000000000000000000000000000 P 048fbde868c645199a59bc40ddb72e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6841140801e46cb906e160194301bc6" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33443 } } peers { permanent_uuid: "048fbde868c645199a59bc40ddb72e16" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } } peers { permanent_uuid: "c1d3748b9f09409883f52203b7ac9eb3" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } }
I20260808 02:37:00.943404 28414 raft_consensus.cc:729] T 00000000000000000000000000000000 P 048fbde868c645199a59bc40ddb72e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 048fbde868c645199a59bc40ddb72e16, State: Initialized, Role: FOLLOWER
I20260808 02:37:00.944006 28414 consensus_queue.cc:260] T 00000000000000000000000000000000 P 048fbde868c645199a59bc40ddb72e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6841140801e46cb906e160194301bc6" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33443 } } peers { permanent_uuid: "048fbde868c645199a59bc40ddb72e16" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } } peers { permanent_uuid: "c1d3748b9f09409883f52203b7ac9eb3" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } }
I20260808 02:37:00.953352 28584 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:37:00.956030 28584 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:37:00.956947 28606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 048fbde868c645199a59bc40ddb72e16 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6841140801e46cb906e160194301bc6" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33443 } } peers { permanent_uuid: "048fbde868c645199a59bc40ddb72e16" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } } peers { permanent_uuid: "c1d3748b9f09409883f52203b7ac9eb3" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } } }
I20260808 02:37:00.957481 28606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 048fbde868c645199a59bc40ddb72e16 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:37:00.958395 28414 sys_catalog.cc:564] T 00000000000000000000000000000000 P 048fbde868c645199a59bc40ddb72e16 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:37:00.958936 28376 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 048fbde868c645199a59bc40ddb72e16 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:00.963295 28376 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 048fbde868c645199a59bc40ddb72e16 [term 1 FOLLOWER]: Refusing update from remote peer d6841140801e46cb906e160194301bc6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:37:00.964334 28377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d6841140801e46cb906e160194301bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "048fbde868c645199a59bc40ddb72e16"
I20260808 02:37:00.968441 28571 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "048fbde868c645199a59bc40ddb72e16" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:37:00.968273 28377 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 048fbde868c645199a59bc40ddb72e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6841140801e46cb906e160194301bc6 in term 1.
I20260808 02:37:00.980720 28608 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 02:37:00.999634 28584 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6: Generated new TSK 0
I20260808 02:37:01.001542 28584 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:37:00.991361 28428 master_runner.cc:186] Error getting master registration for 127.24.116.253:35453: OK, instance_id { permanent_uuid: "048fbde868c645199a59bc40ddb72e16" instance_seqno: 1786156620099105 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 02:37:01.041986 28606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 048fbde868c645199a59bc40ddb72e16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6841140801e46cb906e160194301bc6. Latest consensus state: current_term: 1 leader_uuid: "d6841140801e46cb906e160194301bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6841140801e46cb906e160194301bc6" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33443 } } peers { permanent_uuid: "048fbde868c645199a59bc40ddb72e16" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } } peers { permanent_uuid: "c1d3748b9f09409883f52203b7ac9eb3" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } } }
I20260808 02:37:01.042397 28606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 048fbde868c645199a59bc40ddb72e16 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:37:01.042387 28541 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d6841140801e46cb906e160194301bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6841140801e46cb906e160194301bc6" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33443 } } peers { permanent_uuid: "048fbde868c645199a59bc40ddb72e16" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } } peers { permanent_uuid: "c1d3748b9f09409883f52203b7ac9eb3" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } } }
I20260808 02:37:01.042742 28541 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6841140801e46cb906e160194301bc6 [sys.catalog]: This master's current role is: LEADER
I20260808 02:37:01.042822 28615 sys_catalog.cc:455] T 00000000000000000000000000000000 P 048fbde868c645199a59bc40ddb72e16 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d6841140801e46cb906e160194301bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6841140801e46cb906e160194301bc6" member_type: VOTER last_known_addr { host: "127.24.116.254" port: 33443 } } peers { permanent_uuid: "048fbde868c645199a59bc40ddb72e16" member_type: VOTER last_known_addr { host: "127.24.116.253" port: 35453 } } peers { permanent_uuid: "c1d3748b9f09409883f52203b7ac9eb3" member_type: VOTER last_known_addr { host: "127.24.116.252" port: 37249 } } }
I20260808 02:37:01.043272 28615 sys_catalog.cc:458] T 00000000000000000000000000000000 P 048fbde868c645199a59bc40ddb72e16 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:37:01.044616 28428 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 02:37:01.063457 28634 catalog_manager.cc:1259] Loaded cluster ID: 88a50beeba8147458bf06a680a67a124
I20260808 02:37:01.063591 28634 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 048fbde868c645199a59bc40ddb72e16: loading cluster ID for follower catalog manager: success
I20260808 02:37:01.067510 28634 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 048fbde868c645199a59bc40ddb72e16: acquiring CA information for follower catalog manager: success
I20260808 02:37:01.070195 28634 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 048fbde868c645199a59bc40ddb72e16: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 02:37:01.159545 28538 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:37:01.145579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41994 (local address 127.24.116.254:33443)
0808 02:37:01.145794 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:01.145800 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:01.156771 (+ 10971us) server_negotiation.cc:407] Connection header received
0808 02:37:01.157385 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:01.157396 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:01.157519 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:01.157613 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:01.159186 (+ 1573us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41994: BlockingRecv error: recv got EOF from 127.0.0.1:41994 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260808 02:37:01.160219 28425 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:37:01.147316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60614 (local address 127.24.116.253:35453)
0808 02:37:01.147542 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:01.147547 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:01.158185 (+ 10638us) server_negotiation.cc:407] Connection header received
0808 02:37:01.158491 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:01.158498 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:01.158618 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:01.158694 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:01.159971 (+ 1277us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60614: BlockingRecv error: recv got EOF from 127.0.0.1:60614 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260808 02:37:01.162883 28534 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:37:01.148850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36402 (local address 127.24.116.252:37249)
0808 02:37:01.149037 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:01.149043 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:01.160390 (+ 11347us) server_negotiation.cc:407] Connection header received
0808 02:37:01.160703 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:01.160712 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:01.160825 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:01.160932 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:01.162504 (+ 1572us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36402: BlockingRecv error: recv got EOF from 127.0.0.1:36402 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 02:37:01.174818 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:01.168356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60626 (local address 127.24.116.253:35453)
0808 02:37:01.168597 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:01.168606 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:01.169124 (+ 518us) server_negotiation.cc:407] Connection header received
0808 02:37:01.169397 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:01.169401 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:01.169628 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:01.169881 (+ 253us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:01.170324 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:01.171096 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:01.172513 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:01.172976 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:01.173121 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:01.173621 (+ 500us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:01.174130 (+ 509us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:01.174308 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:01.174380 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 02:37:01.174465 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
W20260808 02:37:01.186723 28534 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:37:01.181937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36408 (local address 127.24.116.252:37249)
0808 02:37:01.182200 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:01.182210 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:01.184950 (+ 2740us) server_negotiation.cc:407] Connection header received
0808 02:37:01.185320 (+ 370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:01.185325 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:01.185467 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:01.185578 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:01.186501 (+ 923us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36408: BlockingRecv error: recv got EOF from 127.0.0.1:36408 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 02:37:01.196849 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:01.190924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60638 (local address 127.24.116.253:35453)
0808 02:37:01.191218 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:01.191228 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:01.191766 (+ 538us) server_negotiation.cc:407] Connection header received
0808 02:37:01.191985 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:01.191995 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:01.192078 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:01.192180 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:01.192651 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:01.193465 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:01.194926 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:01.195419 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:01.195559 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:01.195969 (+ 410us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:01.196107 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:01.196217 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:01.196414 (+ 197us) server_negotiation.cc:299] Negotiation successful
0808 02:37:01.196498 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
W20260808 02:37:01.209753 28534 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:37:01.207413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36412 (local address 127.24.116.252:37249)
0808 02:37:01.207663 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:01.207673 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:01.208253 (+ 580us) server_negotiation.cc:407] Connection header received
0808 02:37:01.208541 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:01.208546 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:01.208619 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:01.208733 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:01.209547 (+ 814us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36412: BlockingRecv error: recv got EOF from 127.0.0.1:36412 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 02:37:01.222345 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:01.215828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60648 (local address 127.24.116.253:35453)
0808 02:37:01.216082 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:01.216093 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:01.216719 (+ 626us) server_negotiation.cc:407] Connection header received
0808 02:37:01.216980 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:01.216986 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:01.217072 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:01.217202 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:01.217701 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:01.218554 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:01.220268 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:01.220837 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:01.220990 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:01.221443 (+ 453us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:01.221565 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:01.221679 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:01.221854 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 02:37:01.221957 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
W20260808 02:37:01.236402 28534 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:37:01.234105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36428 (local address 127.24.116.252:37249)
0808 02:37:01.234326 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:01.234334 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:01.234857 (+ 523us) server_negotiation.cc:407] Connection header received
0808 02:37:01.235083 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:01.235089 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:01.235182 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:01.235309 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:01.236104 (+ 795us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36428: BlockingRecv error: recv got EOF from 127.0.0.1:36428 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 02:37:01.250975 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:01.244526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60654 (local address 127.24.116.253:35453)
0808 02:37:01.244871 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:01.244882 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:01.245461 (+ 579us) server_negotiation.cc:407] Connection header received
0808 02:37:01.245710 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:01.245715 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:01.245795 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:01.245903 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:01.246342 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:01.247166 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:01.248712 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:01.249345 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:01.249518 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:01.250155 (+ 637us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:01.250268 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:01.250382 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:01.250544 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 02:37:01.250636 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157}
W20260808 02:37:01.269910 28534 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:37:01.266791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36444 (local address 127.24.116.252:37249)
0808 02:37:01.267169 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:01.267179 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:01.268171 (+ 992us) server_negotiation.cc:407] Connection header received
0808 02:37:01.268500 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:01.268506 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:01.268625 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:01.268777 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:01.269634 (+ 857us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36444: BlockingRecv error: recv got EOF from 127.0.0.1:36444 (error 108)
Metrics: {"server-negotiator.queue_time_us":193}
I20260808 02:37:01.288467 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:01.282144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60670 (local address 127.24.116.253:35453)
0808 02:37:01.282424 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:01.282434 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:01.283047 (+ 613us) server_negotiation.cc:407] Connection header received
0808 02:37:01.283288 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:01.283293 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:01.283373 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:01.283480 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:01.283950 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:01.284926 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:01.286504 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:01.287004 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:01.287152 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:01.287607 (+ 455us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:01.287721 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:01.287844 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:01.287988 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 02:37:01.288072 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
W20260808 02:37:01.298266 28534 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:37:01.294811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36448 (local address 127.24.116.252:37249)
0808 02:37:01.295059 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:01.295068 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:01.296812 (+ 1744us) server_negotiation.cc:407] Connection header received
0808 02:37:01.297039 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:01.297043 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:01.297121 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:01.297231 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:01.298041 (+ 810us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36448: BlockingRecv error: recv got EOF from 127.0.0.1:36448 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
I20260808 02:37:01.332394 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:01.326445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60682 (local address 127.24.116.253:35453)
0808 02:37:01.326689 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:01.326699 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:01.327305 (+ 606us) server_negotiation.cc:407] Connection header received
0808 02:37:01.327550 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:01.327555 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:01.327629 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:01.327739 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:01.328213 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:01.329091 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:01.330472 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:01.330943 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:01.331106 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:01.331541 (+ 435us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:01.331675 (+ 134us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:01.331791 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:01.331959 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 02:37:01.332045 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260808 02:37:01.342461 28534 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:37:01.339033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36462 (local address 127.24.116.252:37249)
0808 02:37:01.339249 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:01.339255 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:01.340830 (+ 1575us) server_negotiation.cc:407] Connection header received
0808 02:37:01.341157 (+ 327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:01.341164 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:01.341308 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:01.341437 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:01.342205 (+ 768us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36462: BlockingRecv error: recv got EOF from 127.0.0.1:36462 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 02:37:01.387648 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:01.379770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60694 (local address 127.24.116.253:35453)
0808 02:37:01.379961 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:01.379968 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:01.380578 (+ 610us) server_negotiation.cc:407] Connection header received
0808 02:37:01.380852 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:01.380860 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:01.380959 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:01.381085 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:01.381630 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:01.382946 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:01.385010 (+ 2064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:01.385899 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:01.386113 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:01.386706 (+ 593us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:01.386858 (+ 152us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:01.386961 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:01.387154 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 02:37:01.387250 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260808 02:37:01.398309 28534 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:37:01.395968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36466 (local address 127.24.116.252:37249)
0808 02:37:01.396160 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:01.396169 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:01.396677 (+ 508us) server_negotiation.cc:407] Connection header received
0808 02:37:01.396868 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:01.396875 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:01.396985 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:01.397107 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:01.398045 (+ 938us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36466: BlockingRecv error: recv got EOF from 127.0.0.1:36466 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 02:37:01.475910 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:01.469924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60710 (local address 127.24.116.253:35453)
0808 02:37:01.470147 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:01.470155 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:01.470638 (+ 483us) server_negotiation.cc:407] Connection header received
0808 02:37:01.470893 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:01.470898 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:01.470976 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:01.471100 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:01.471569 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:01.472465 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:01.473820 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:01.474509 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:01.474670 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:01.475101 (+ 431us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:01.475204 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:01.475322 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:01.475469 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 02:37:01.475557 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260808 02:37:01.483956 28534 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:37:01.481949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36468 (local address 127.24.116.252:37249)
0808 02:37:01.482159 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:01.482166 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:01.482508 (+ 342us) server_negotiation.cc:407] Connection header received
0808 02:37:01.482664 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:01.482670 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:01.482778 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:01.482898 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:01.483682 (+ 784us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36468: BlockingRecv error: recv got EOF from 127.0.0.1:36468 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 02:37:01.621455 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:01.616133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60722 (local address 127.24.116.253:35453)
0808 02:37:01.616374 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:01.616384 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:01.616719 (+ 335us) server_negotiation.cc:407] Connection header received
0808 02:37:01.616952 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:01.616956 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:01.617026 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:01.617126 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:01.617553 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:01.618242 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:01.619619 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:01.620068 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:01.620208 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:01.620701 (+ 493us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:01.620813 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:01.620917 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:01.621074 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 02:37:01.621159 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260808 02:37:01.628677 28534 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:37:01.626883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36470 (local address 127.24.116.252:37249)
0808 02:37:01.627130 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:01.627137 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:01.627386 (+ 249us) server_negotiation.cc:407] Connection header received
0808 02:37:01.627526 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:01.627530 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:01.627605 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:01.627687 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:01.628443 (+ 756us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36470: BlockingRecv error: recv got EOF from 127.0.0.1:36470 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
I20260808 02:37:01.895172 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:01.889896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60732 (local address 127.24.116.253:35453)
0808 02:37:01.890116 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:01.890121 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:01.890475 (+ 354us) server_negotiation.cc:407] Connection header received
0808 02:37:01.890616 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:01.890620 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:01.890696 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:01.890795 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:01.891323 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:01.892057 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:01.893510 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:01.893929 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:01.894037 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:01.894467 (+ 430us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:01.894585 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:01.894657 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:01.894891 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 02:37:01.894965 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
W20260808 02:37:01.904582 28534 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:37:01.901974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36480 (local address 127.24.116.252:37249)
0808 02:37:01.902236 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:01.902241 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:01.902511 (+ 270us) server_negotiation.cc:407] Connection header received
0808 02:37:01.902661 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:01.902666 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:01.902773 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:01.902899 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:01.904040 (+ 1141us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36480: BlockingRecv error: recv got EOF from 127.0.0.1:36480 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 02:37:01.985483 28608 catalog_manager.cc:1259] Loaded cluster ID: 88a50beeba8147458bf06a680a67a124
I20260808 02:37:01.985610 28608 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c1d3748b9f09409883f52203b7ac9eb3: loading cluster ID for follower catalog manager: success
I20260808 02:37:01.988246 28608 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c1d3748b9f09409883f52203b7ac9eb3: acquiring CA information for follower catalog manager: success
I20260808 02:37:01.990263 28608 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c1d3748b9f09409883f52203b7ac9eb3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 02:37:02.427413 28820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:02.422177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42622 (local address 127.24.116.253:35453)
0808 02:37:02.422890 (+ 713us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:02.422895 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:02.422913 (+ 18us) server_negotiation.cc:407] Connection header received
0808 02:37:02.422979 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:02.422982 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:02.423061 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:02.423150 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:02.423673 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:02.424453 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:02.425799 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:02.426236 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:02.426338 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:02.426735 (+ 397us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:02.426868 (+ 133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:02.426941 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:02.427092 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 02:37:02.427157 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":601,"thread_start_us":487,"threads_started":1}
I20260808 02:37:02.439157 28833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:02.433095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38612 (local address 127.24.116.252:37249)
0808 02:37:02.433607 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:02.433615 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:02.433688 (+ 73us) server_negotiation.cc:407] Connection header received
0808 02:37:02.433937 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:02.433941 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:02.434113 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:02.434249 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:02.434718 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:02.435460 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:02.436883 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:02.437293 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:02.437441 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:02.437960 (+ 519us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:02.438510 (+ 550us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:02.438679 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:02.438770 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 02:37:02.438868 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":250,"threads_started":1}
I20260808 02:37:02.453197 28833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:02.445465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38614 (local address 127.24.116.252:37249)
0808 02:37:02.445667 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:02.445677 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:02.446945 (+ 1268us) server_negotiation.cc:407] Connection header received
0808 02:37:02.447274 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:02.447282 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:02.447407 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:02.447529 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:02.448412 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:02.449481 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:02.450863 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:02.451461 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:02.451597 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:02.452343 (+ 746us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:02.452478 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:02.452572 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:02.452799 (+ 227us) server_negotiation.cc:299] Negotiation successful
0808 02:37:02.452895 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 02:37:02.456548 28841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:02.445443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58350 (local address 127.24.116.254:33443)
0808 02:37:02.446955 (+ 1512us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:02.446963 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:02.448021 (+ 1058us) server_negotiation.cc:407] Connection header received
0808 02:37:02.448254 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:02.448260 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:02.448559 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:02.448797 (+ 238us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:02.449686 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:02.450947 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:02.452808 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:02.453480 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:02.453632 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:02.454435 (+ 803us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:02.455053 (+ 618us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:02.455200 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:02.455436 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 02:37:02.455764 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1388,"thread_start_us":1287,"threads_started":1}
I20260808 02:37:02.458485 28820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:02.445469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42638 (local address 127.24.116.253:35453)
0808 02:37:02.445720 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:02.445729 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:02.446425 (+ 696us) server_negotiation.cc:407] Connection header received
0808 02:37:02.446769 (+ 344us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:02.446779 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:02.446882 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:02.446950 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:02.447877 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:02.449052 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:02.455333 (+ 6281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:02.456008 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:02.456141 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:02.456884 (+ 743us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:02.457035 (+ 151us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:02.457159 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:02.458026 (+ 867us) server_negotiation.cc:299] Negotiation successful
0808 02:37:02.458158 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 02:37:02.467350 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 28203
I20260808 02:37:02.468581 28293 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:37:02.580751 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 28203
W20260808 02:37:02.611258 28449 connection.cc:535] server connection from 127.0.0.1:36362 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 02:37:02.611289 28341 connection.cc:535] server connection from 127.0.0.1:60582 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 02:37:02.611980 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 28317
I20260808 02:37:02.613236 28407 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:37:02.727063 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 28317
I20260808 02:37:02.763662 25043 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5C7FBY/build/asan/bin/kudu pid 28428
I20260808 02:37:02.765022 28520 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:37:02.878821 25043 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5C7FBY/build/asan/bin/kudu with pid 28428
2026-08-08T02:37:02Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5533 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (10982 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (390792 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST